Skip to content
ProductArena

How Pipedream MCP’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score20/100

Agent-ready 47.0 × 0.30 = 14.10

API quality 7.7 × 0.20 = 1.54

Openness 7.5 × 0.20 = 1.50

Built-in AI 18.0 × 0.15 = 2.70

Automation 0.0 × 0.15 = 0.00

(14.10 + 1.54 + 1.50 + 2.70 + 0.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 19.84 ÷ 1.00 = 19.8

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready47.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://pipedream.com/docs/connect/mcp.md“PROBE docs-md: HTTP 200 at https://pipedream.com/docs/connect/mcp.md > ## Documentation Index > Fetch the complete documentation index at: https://pipedream.com/docs/llms.txt > Use this fil”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”
  • [probe] https://pipedream.com/docs/connect/mcp/developers“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/pipedream-mcp/): `npm install @pipedream/sdk` completed into a throwaway fixture and the package exports a PipedreamClient class.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“To use Pipedream MCP in your own app or agent to make tool calls on behalf of your users, you can get started for free in development mode”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“This is handled automatically by Pipedream’s MCP server and there’s no additional implementation required”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“The Pipedream MCP server supports both SSE and streamable HTTP transport types dynamically, with no configuration required by the developer or MCP client.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“As an end user: Connect your accounts through Pipedream MCP at mcp.pipedream.com”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”
  • [probe] https://pipedream.com/docs/connect/mcp/developers“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/pipedream-mcp/): `npm install @pipedream/sdk` completed into a throwaway fixture and the package exports a PipedreamClient class.”

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“To use Pipedream MCP in your own app or agent to make tool calls on behalf of your users, you can get started for free in development mode”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”
  • [probe] https://pipedream.com/docs/connect/mcp/developers“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/pipedream-mcp/): `npm install @pipedream/sdk` completed into a throwaway fixture and the package exports a PipedreamClient class.”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Pipedream Connect includes built-in user authentication for more than APIs via MCP, which means you don’t need to build any authorization flows or deal with token storage and refresh”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“As an end user: Connect your accounts through Pipedream MCP at mcp.pipedream.com”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“Revocable access: Users can revoke access to their connected accounts at any time”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“To use Pipedream MCP in your own app or agent to make tool calls on behalf of your users, you can get started for free in development mode”
  • [probe] https://pipedream.com/docs/connect/mcp/developers“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/pipedream-mcp/): `npm install @pipedream/sdk` completed into a throwaway fixture and the package exports a PipedreamClient class.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 98.6 ÷ 210 × 100 = 47.0

API quality7.7/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp“Try out Pipedream MCP in our chat app at chat.pipedream.com”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“The Pipedream MCP server supports both SSE and streamable HTTP transport types dynamically, with no configuration required by the developer or MCP client.”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 3 (quality) × 0.6 (partial) = 1.8 of 10 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp“To use Pipedream MCP in your own app or agent to make tool calls on behalf of your users, you can get started for free in development mode”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

API quality = 5.4 ÷ 70 × 100 = 7.7

Openness7.5/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“As an end user: Connect your accounts through Pipedream MCP at mcp.pipedream.com”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“Revocable access: Users can revoke access to their connected accounts at any time”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”
  • [probe] https://pipedream.com/docs/connect/mcp/developers“PROBE runtime (recorded 2026-09-04, see data/mcp-infrastructure/proofs/pipedream-mcp/): `npm install @pipedream/sdk` completed into a throwaway fixture and the package exports a PipedreamClient class.”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp“As an end user: Connect your accounts through Pipedream MCP at mcp.pipedream.com”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“To use Pipedream MCP in your own app or agent to make tool calls on behalf of your users, you can get started for free in development mode”

Openness = 6.0 ÷ 80 × 100 = 7.5

Built-in AI18.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“This is handled automatically by Pipedream’s MCP server and there’s no additional implementation required”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“Try out Pipedream MCP in our chat app at chat.pipedream.com”

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“Try out Pipedream MCP in our chat app at chat.pipedream.com”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”

Built-in AI = 7.2 ÷ 40 × 100 = 18.0

Automation0.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp“Slack: Send messages, manage channels, create reminders, and more”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://pipedream.com/docs/connect/mcp/developers“Add Pipedream MCP to your app or agent to make tool calls on behalf of your users to 3,000+ APIs and 10,000+ tools.”
  • [claimed-docs] https://pipedream.com/docs/connect/mcp/ai-frameworks“tools: await mcpClient.tools(), // Automatically loads all available tools”
  • [probe] https://remote.mcp.pipedream.net“PROBE mcp-endpoint (2026-09-05): POST initialize to https://remote.mcp.pipedream.net answered a JSON-RPC error over HTTP 400 ({"jsonrpc":"2.0","error":{"code":-32602,"message":"external user id is required. Please see docs for more info."},"id":null}) — the MCP server is live and requires a per-end-user binding before serving tools. remote.mcp.pipedream.net is the documented remote MCP server for Pipedream Connect.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 0.0 ÷ 80 × 100 = 0.0