Skip to content
ProductArena

MCP Infrastructure & Registries Arena

MCP Infrastructure & Registries — procurement report

ProductArena · rankings as of 2026-09-10 · evidence as of 2026-09-10 · 6 products · 52 judged requirements · 312 judged cells

Methodology: Every product is judged against a shared taxonomy of user stories using cited evidence — hands-on probes > repository code > independent community sources > vendor claims — never opinion. Full writeup: https://ultrametric.ai/productarena/methodology

Leaderboard

#ProductPA ScoreCoverage scoreApplicable cellsConfidence
1Composio33.033.750/52B
2Smithery32.437.950/52B
3Glama25.427.549/52B
4Manufact23.223.648/52B
5Gram (Speakeasy)21.127.352/52C
6Pipedream MCP19.824.649/52C

PA Score = agent-readiness blend (see methodology). Coverage score = weighted share of judged requirements met. Confidence = how much of the score rests on tested vs claimed evidence (A–D).

Uncertainty note

This arena is currently a close race: Composio (33.0) vs Smithery (32.4), a gap of 0.6 PA Score. The ordering was re-checked with extra judge samples: 34 decisive cells were triple-judged and 5 came back unstable. Treat the #1/#2 ordering as contested — shortlist both.

Buyer checklist (RFP)

The arena's 52 judged user stories as requirements, grouped by theme. Priorities mirror the story weights our scoring uses (3 = must-have, 2 = should-have, 1 = nice-to-have). Interactive version with per-requirement verdicts for the top products: /arena/mcp-infrastructure/checklist

Agenticness — how well agents can access and operate the productAgenticness

How well agents can access and operate the product

  • ai-native userPlug MCP servers into this product so it can use their toolsmust-have
  • ai-native userConnect an agent via an official MCP servermust-have
  • ai-native userDrive the product through a documented public APImust-have
  • ai-native userDelegate tasks to a built-in AI assistant inside the productmust-have
  • ai-native userPoint an agent at llms.txt or agent-oriented docsshould-have
  • ai-native userRun the product headlessly / in CI for automationshould-have
  • ai-native userUse an official CLIshould-have
  • ai-native userIssue scoped/least-privilege API credentials for an agentshould-have
  • ai-native userBuild against official SDKsshould-have
  • ai-native userSubscribe to events via webhooksshould-have
  • ai-native userGet AI-generated insights and suggestions from my data inside the productshould-have
  • ai-native userSet up automations that run autonomously in the backgroundshould-have
  • ai-native userOperate the product with natural-language commandsshould-have
  • ai-native userExplore an interactive API reference with runnable examplesshould-have
  • ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)should-have
  • ai-native userRely on versioned APIs with a documented deprecation policyshould-have
  • ai-native userTest against a sandbox environment without touching production datanice-to-have

Auth credentials — stories about auth credentials in this arenaAuth credentials

Stories about auth credentials in this arena

  • platform-engineerMaintain separate connected accounts and scoped tokens per end user of my product, so each user's agent acts only on that user's credentialsmust-have
  • developerLet the platform run OAuth flows for downstream tools and vault the resulting credentials encrypted, with automatic token refreshmust-have
  • platform-engineerWhite-label the authorization flow with my own branding and my own OAuth app credentialsnice-to-have

Automation depth — how much of the product can run unattendedAutomation depth

How much of the product can run unattended

  • ai-native userDefine rules that trigger actions automatically on eventsmust-have
  • ai-native userPerform bulk operations across many items at onceshould-have
  • ai-native userSchedule recurring jobs or workflowsshould-have
  • ai-native userVersion, review, and roll back my automationsnice-to-have

Deployment self host — stories about deployment self host in this arenaDeployment self host

Stories about deployment self host in this arena

  • developerBridge a locally running MCP server into the platform as a managed remote connection without deploying itnice-to-have

Gateway controls — stories about gateway controls in this arenaGateway controls

Stories about gateway controls in this arena

  • platform-engineerRestrict which servers and individual tools an agent may call through allowlists or per-tool access controlshould-have
  • platform-engineerSee a log of every tool call that passed through the platform, with enough detail to audit or replay what an agent didshould-have

Hosted servers — stories about hosted servers in this arenaHosted servers

Stories about hosted servers in this arena

  • developerReach a deep catalog of third-party apps and APIs (hundreds to thousands of integrations) through the platformmust-have
  • developerPoint my MCP-compatible client at a hosted remote server URL and reach downstream tools without deploying any infrastructuremust-have
  • developerTurn an existing API definition (OpenAPI) or custom code into a hosted MCP server without writing protocol plumbingshould-have
  • developerPublish my own MCP server on the platform for distribution, discovery, and installation by othersshould-have
  • developerSubscribe my agent to events from connected downstream apps (triggers/webhooks) instead of polling themshould-have

Observability analytics — stories about observability analytics in this arenaObservability analytics

Stories about observability analytics in this arena

  • platform-engineerSee usage analytics for the servers and tools my org consumes or publishes — call volumes, users, errors, and costshould-have

Openness — open source, data portability, and self-hosting storiesOpenness

Open source, data portability, and self-hosting stories

  • ai-native userExport all of my data in open formats and leavemust-have
  • ai-native userSelf-host the core productmust-have
  • ai-native userDo everything through the API that I can do in the UIshould-have
  • ai-native userRead the product's source under an open licenseshould-have

Pricing plans — plan structure and value — what each tier costs and what it unlocksPricing plans

Plan structure and value — what each tier costs and what it unlocks

  • developerSee transparent pricing per tool call or connection plus documented rate limits before committing to the platformshould-have
  • developerPrototype my agent's tool connections on a meaningful free tier before paying anythingnice-to-have

Privacy posture — data-handling and privacy storiesPrivacy posture

Data-handling and privacy stories

  • ai-native userPrevent my data from being used to train AI modelsmust-have
  • ai-native userChoose where my data is stored (region/residency)should-have
  • ai-native userControl data retention and deletionshould-have
  • ai-native userOpt out of telemetry and usage trackingshould-have

Registry discovery — stories about registry discovery in this arenaRegistry discovery

Stories about registry discovery in this arena

  • ai agentQuery the platform's registry or catalog through a documented API to discover servers and tools programmaticallymust-have
  • developerSearch and browse a large catalog of MCP servers and tools by capability before wiring anything into my agentmust-have
  • developerInspect a listed server's tools, input schemas, transport, and hosting attributes before connecting to itshould-have
  • developerExercise an MCP server's tools from a browser-based inspector or playground before integrating itshould-have

Sdk clients — stories about sdk clients in this arenaSdk clients

Stories about sdk clients in this arena

  • developerDrive the publish-and-deploy workflow from an official CLI — authenticate, stage or build a server, push it, and install it into agentsshould-have
  • developerPlug the platform's tools into major agent frameworks and SDKs (Vercel AI SDK, LangChain, CrewAI, OpenAI or Anthropic SDKs) with documented adaptersshould-have

Tool curation quality — stories about tool curation quality in this arenaTool curation quality

Stories about tool curation quality in this arena

  • platform-engineerRely on the platform scanning or inspecting listed servers for malicious or vulnerable behavior before my agents use themshould-have
  • developerCompare servers using published quality signals — usage counts, health or liveness checks, scores, or verification badgesshould-have
  • ai agentSearch and load tools at runtime through meta-tools instead of having thousands of tool definitions stuffed into my contextshould-have

Appendix: recorded probes

Hands-on probe recordings — transcripts/videos a human can replay, the strongest evidence tier. Watch them at https://ultrametric.ai/productarena/proofs

  • Composiocurl -si -X POST https://connect.composio.dev/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-05 · exit 0
  • Composiomktemp -d && npm install @composio/core && node -e "console.log('PA_PROBE_OK Composio export:', typeof require('@composio/core').Composio)"terminal · recorded 2026-09-05 · exit 0
  • Composiomktemp -d && uv venv && uv pip install composio && python -c "import composio; print('PA_PROBE_OK composio', composio.__version__)"terminal · recorded 2026-09-05 · exit 0
  • Glamacurl -s https://glama.ai/api/mcp/openapi.json | head -c 500terminal · recorded 2026-09-05 · exit 0
  • Glamacurl -s 'https://glama.ai/api/mcp/v1/servers?first=2' | head -c 700terminal · recorded 2026-09-05 · exit 0
  • Gram (Speakeasy)mktemp -d && curl -fsSL https://github.com/speakeasy-api/gram/releases/download/cli@<latest>/gram_darwin_arm64.zip -o gram.zip && unzip gram.zip && ./gram --versionterminal · recorded 2026-09-05 · exit 0
  • Manufactcurl -s https://docs.manufact.com/mcp.md | head -8terminal · recorded 2026-09-10 · exit 0
  • Manufactcurl -s https://manufact.com/llms.txt | head -6terminal · recorded 2026-09-10 · exit 0
  • Manufactcurl -si -X POST https://mcp.manufact.com/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-10 · exit 0
  • Pipedream MCPcurl -si -X POST https://remote.mcp.pipedream.net -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-05 · exit 0
  • Pipedream MCPmktemp -d && npm install @pipedream/sdk && node -e "console.log('PA_PROBE_OK PipedreamClient export:', typeof require('@pipedream/sdk').PipedreamClient)"terminal · recorded 2026-09-05 · exit 0
  • Smitherycurl -s -X POST https://smithery.ai/docs/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-05 · exit 0
  • Smitherycurl -si -X POST https://server.smithery.ai/exa/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-05 · exit 0
  • Smitherymktemp -d && npm install @smithery/cli && ./node_modules/.bin/smithery --versionterminal · recorded 2026-09-05 · exit 0
  • Smitherycurl -s 'https://registry.smithery.ai/servers?pageSize=3&q=browser' | head -c 900terminal · recorded 2026-09-05 · exit 0

Cite as: ProductArena by Ultrametric Inc, MCP Infrastructure & Registries arena, rankings as of 2026-09-10 — https://ultrametric.ai/productarena/arena/mcp-infrastructure

License: © 2026 Ultrametric Inc. Brief quotation of individual verdicts, scores, or evidence excerpts is permitted with attribution to "ProductArena by Ultrametric Inc (ultrametric.ai/productarena)", as is use of the data to evaluate, contest, or contribute corrections. Bulk copying, redistribution, or use to build competing datasets requires prior written permission (see DATA-LICENSE in the repository).

No liability: rankings, verdicts, and scores are research outputs derived from the cited evidence at a point in time, provided "as is", without warranties. Ultrametric Inc accepts no responsibility for procurement, purchasing, or other decisions made in reliance on them — verify against the cited evidence before acting (https://ultrametric.ai/productarena/terms).