Skip to content
ProductArena

How Composio’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score33/100

Agent-ready 63.8 × 0.30 = 19.14

API quality 25.7 × 0.20 = 5.14

Openness 7.2 × 0.20 = 1.44

Built-in AI 30.0 × 0.15 = 4.50

Automation 18.8 × 0.15 = 2.82

(19.14 + 5.14 + 1.44 + 4.50 + 2.82) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 33.04 ÷ 1.00 = 33.0

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready63.8/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.composio.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.composio.dev/llms.txt # Composio Documentation > Composio powers 1,400+ toolkits, tool search, context management, authentication, and a sand”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“session = composio.sessions.create(user_id="user_123")”
  • [claimed-docs] https://docs.composio.dev/docs/cli“The Composio CLI gives coding agents and terminals a local tool surface. Codex, Claude Code, or a person at the terminal can connect apps, execute tools, inspect schemas, call authenticated APIs, and debug Composio projects.”
  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”
  • [probe] https://docs.composio.dev/docs/cli“official CLI documented at https://docs.composio.dev/docs/cli”
  • [probe] https://docs.composio.dev/docs/quickstart“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/composio/): `npm install @composio/core` and `uv pip install composio` (v0.21.1) both completed into throwaway fixtures and imported cleanly — the TypeScript package exports a Composio client class and the Python package imports as `composio`.”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.composio.dev/docs/sessions-via-mcp“Opt into MCP by passing `mcp: true` when you create the session. The session then exposes its hosted MCP server.”
  • [probe] https://docs.composio.dev/docs/composio-connect“official MCP server documented at https://docs.composio.dev/docs/composio-connect”
  • [probe] https://connect.composio.dev/mcp“PROBE mcp-endpoint (2026-09-05): POST initialize to https://connect.composio.dev/mcp returned HTTP 401 with an OAuth challenge — the hosted MCP endpoint is live and vaults access behind managed auth ({"error":"Authorization required","reason":"No Authorization: Bearer header on request"}). Composio Connect is the shared hosted endpoint documented for MCP clients.”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Use Composio Connect when you already have an MCP-compatible client and want the shared Composio MCP URL, without creating an SDK session.”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.composio.dev/docs/sessions-via-mcp“Opt into MCP by passing `mcp: true` when you create the session. The session then exposes its hosted MCP server.”
  • [claimed-docs] https://docs.composio.dev/docs/sessions-via-mcp“Combine `mcp: true` with the direct-tools preset to get one MCP URL that serves exactly the tools you list”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Use Composio Connect when you already have an MCP-compatible client and want the shared Composio MCP URL, without creating an SDK session.”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Composio exposes **7 meta-tools** that let the agent discover what's available, authorize apps on demand, and execute tools across apps in parallel.”
  • [probe] https://docs.composio.dev/docs/composio-connect“official MCP server documented at https://docs.composio.dev/docs/composio-connect”
  • [probe] https://connect.composio.dev/mcp“PROBE mcp-endpoint (2026-09-05): POST initialize to https://connect.composio.dev/mcp returned HTTP 401 with an OAuth challenge — the hosted MCP endpoint is live and vaults access behind managed auth ({"error":"Authorization required","reason":"No Authorization: Bearer header on request"}). Composio Connect is the shared hosted endpoint documented for MCP clients.”

Use an official CLIweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/cli“The Composio CLI gives coding agents and terminals a local tool surface. Codex, Claude Code, or a person at the terminal can connect apps, execute tools, inspect schemas, call authenticated APIs, and debug Composio projects.”
  • [claimed-docs] https://docs.composio.dev/docs/cli“Install the native plugin for Codex or Claude Code: composio setup --target auto”
  • [probe] https://docs.composio.dev/docs/cli“official CLI documented at https://docs.composio.dev/docs/cli”

Drive the product through a documented public APIweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“session = composio.sessions.create(user_id="user_123")”
  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“A session gives your agent meta tools, a small fixed set that discover, authenticate, and execute tools at runtime”
  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”
  • [probe] https://docs.composio.dev/docs/quickstart“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/composio/): `npm install @composio/core` and `uv pip install composio` (v0.21.1) both completed into throwaway fixtures and imported cleanly — the TypeScript package exports a Composio client class and the Python package imports as `composio`.”
  • [probe] https://connect.composio.dev/mcp“PROBE mcp-endpoint (2026-09-05): POST initialize to https://connect.composio.dev/mcp returned HTTP 401 with an OAuth challenge — the hosted MCP endpoint is live and vaults access behind managed auth ({"error":"Authorization required","reason":"No Authorization: Bearer header on request"}). Composio Connect is the shared hosted endpoint documented for MCP clients.”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Composio exposes **7 meta-tools** that let the agent discover what's available, authorize apps on demand, and execute tools across apps in parallel.”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 5 (quality) × 0.3 (disputed) = 3.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“To restrict the set, pass `toolkits` when you create the session.”
  • [claimed-docs] https://docs.composio.dev/docs/sessions-via-mcp“Combine `mcp: true` with the direct-tools preset to get one MCP URL that serves exactly the tools you list”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Composio exposes **7 meta-tools** that let the agent discover what's available, authorize apps on demand, and execute tools across apps in parallel.”
  • [community] https://hn.algolia.com/api/v1/items/49317473“A leaked Composio key returned live Gmail, GitHub and CircleCI tokens (security research on exposed credentials in Composio's agent integration platform).”

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://docs.composio.dev/docs/quickstart“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/composio/): `npm install @composio/core` and `uv pip install composio` (v0.21.1) both completed into throwaway fixtures and imported cleanly — the TypeScript package exports a Composio client class and the Python package imports as `composio`.”
  • [claimed-docs] https://docs.composio.dev/docs/providers“A provider is the adapter that turns Composio tools into the native tool format your framework expects, so you don't write glue code.”
  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”
  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“session = composio.sessions.create(user_id="user_123")”

Subscribe to events via webhooksweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/triggers“Composio delivers every event to one destination you control: your webhook URL. You register it once per project, and Composio `POST`s every trigger event there, signed so you can verify it.”

Agent-ready = 134.0 ÷ 210 × 100 = 63.8

API quality25.7/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”
  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“session = composio.sessions.create(user_id="user_123")”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“COMPOSIO_REMOTE_WORKBENCH** — Run Python in a remote sandbox for bulk operations or processing large tool responses.”
  • [probe] https://docs.composio.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.composio.dev/llms.txt # Composio Documentation > Composio powers 1,400+ toolkits, tool search, context management, authentication, and a sand”
  • [community] https://hn.algolia.com/api/v1/items/45264867“I tried using your cloud solution to test this and I couldnt pass the connect to Instagram through Composio. I got a 400 error. I checked Reddit and it never worked. Got tired after trying for a while :(”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”

API quality = 18.0 ÷ 70 × 100 = 25.7

Openness7.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“session = composio.sessions.create(user_id="user_123")”
  • [claimed-docs] https://docs.composio.dev/docs/triggers“Composio delivers every event to one destination you control: your webhook URL. You register it once per project, and Composio `POST`s every trigger event there, signed so you can verify it.”
  • [claimed-docs] https://docs.composio.dev/docs/cli“The Composio CLI gives coding agents and terminals a local tool surface. Codex, Claude Code, or a person at the terminal can connect apps, execute tools, inspect schemas, call authenticated APIs, and debug Composio projects.”
  • [probe] https://docs.composio.dev/openapi.json“PROBE openapi: HTTP 200 at https://docs.composio.dev/openapi.json — contains "openapi" key”
  • [probe] https://docs.composio.dev/docs/composio-connect“official MCP server documented at https://docs.composio.dev/docs/composio-connect”
  • [probe] https://docs.composio.dev/docs/cli“official CLI documented at https://docs.composio.dev/docs/cli”
  • [community] https://hn.algolia.com/api/v1/items/45264867“I tried using your cloud solution to test this and I couldnt pass the connect to Instagram through Composio. I got a 400 error. I checked Reddit and it never worked. Got tired after trying for a while :(”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.composio.dev/docs/how-composio-works“session = composio.sessions.create(user_id="user_123")”
  • [claimed-docs] https://docs.composio.dev/docs/sessions-via-mcp“Opt into MCP by passing `mcp: true` when you create the session. The session then exposes its hosted MCP server.”
  • [claimed-docs] https://docs.composio.dev/docs/triggers“Composio delivers every event to one destination you control: your webhook URL. You register it once per project, and Composio `POST`s every trigger event there, signed so you can verify it.”
  • [community] https://hn.algolia.com/api/v1/items/45264867“I tried using your cloud solution to test this and I couldnt pass the connect to Instagram through Composio. I got a 400 error. I checked Reddit and it never worked. Got tired after trying for a while :(”
  • [probe] https://connect.composio.dev/mcp“PROBE mcp-endpoint (2026-09-05): POST initialize to https://connect.composio.dev/mcp returned HTTP 401 with an OAuth challenge — the hosted MCP endpoint is live and vaults access behind managed auth ({"error":"Authorization required","reason":"No Authorization: Bearer header on request"}). Composio Connect is the shared hosted endpoint documented for MCP clients.”

Openness = 7.2 ÷ 100 × 100 = 7.2

Built-in AI30.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/triggers“Composio delivers every event to one destination you control: your webhook URL. You register it once per project, and Composio `POST`s every trigger event there, signed so you can verify it.”
  • [community] https://hn.algolia.com/api/v1/items/45264867“I tried using your cloud solution to test this and I couldnt pass the connect to Instagram through Composio. I got a 400 error. I checked Reddit and it never worked. Got tired after trying for a while :(”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Composio exposes **7 meta-tools** that let the agent discover what's available, authorize apps on demand, and execute tools across apps in parallel.”

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/cli“The Composio CLI gives coding agents and terminals a local tool surface. Codex, Claude Code, or a person at the terminal can connect apps, execute tools, inspect schemas, call authenticated APIs, and debug Composio projects.”
  • [claimed-docs] https://docs.composio.dev/docs/cli“Install the native plugin for Codex or Claude Code: composio setup --target auto”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Composio exposes **7 meta-tools** that let the agent discover what's available, authorize apps on demand, and execute tools across apps in parallel.”

Built-in AI = 12.0 ÷ 40 × 100 = 30.0

Automation18.8/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“Composio exposes **7 meta-tools** that let the agent discover what's available, authorize apps on demand, and execute tools across apps in parallel.”
  • [claimed-docs] https://docs.composio.dev/docs/composio-connect“COMPOSIO_REMOTE_WORKBENCH** — Run Python in a remote sandbox for bulk operations or processing large tool responses.”
  • [community] https://hn.algolia.com/api/v1/items/45264867“I tried using your cloud solution to test this and I couldnt pass the connect to Instagram through Composio. I got a 400 error. I checked Reddit and it never worked. Got tired after trying for a while :(”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.composio.dev/docs/triggers“Composio delivers every event to one destination you control: your webhook URL. You register it once per project, and Composio `POST`s every trigger event there, signed so you can verify it.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.composio.dev/docs/triggers“Composio delivers every event to one destination you control: your webhook URL. You register it once per project, and Composio `POST`s every trigger event there, signed so you can verify it.”

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 15.0 ÷ 80 × 100 = 18.8