Agentic Commerce — procurement report
ProductArena · rankings as of 2026-09-15 · evidence as of 2026-09-15 · 7 products · 56 judged requirements · 392 judged cells
Methodology: Every product is judged against a shared taxonomy of user stories using cited evidence — hands-on probes > repository code > independent community sources > vendor claims — never opinion. Full writeup: https://ultrametric.ai/productarena/methodology
Leaderboard
| # | Product | PA Score | Coverage score | Applicable cells | Confidence |
|---|---|---|---|---|---|
| 1 | Stripe Agentic Commerce | 37.1 | 47.7 | 48/56 | B |
| 2 | Shopify Agentic Commerce | 32.5 | 40.5 | 48/56 | B |
| 3 | Visa Intelligent Commerce | 32.0 | 33.5 | 45/56 | A |
| 4 | PayPal Agentic Commerce | 26.8 | 24.9 | 50/56 | B |
| 5 | Coinbase x402 | 26.6 | 33.1 | 43/56 | B |
| 6 | Crossmint | 23.9 | 25.4 | 43/56 | B |
| 7 | Skyfire | 21.0 | 29.0 | 45/56 | B |
PA Score = agent-readiness blend (see methodology). Coverage score = weighted share of judged requirements met. Confidence = how much of the score rests on tested vs claimed evidence (A–D).
Uncertainty note
The current #1/#2 gap in this arena is not close enough to qualify for the multi-judge uncertainty pass (or the pass has not covered it yet) — no extra caveat applies beyond the per-product confidence grades above.
Buyer checklist (RFP)
The arena's 56 judged user stories as requirements, grouped by theme. Priorities mirror the story weights our scoring uses (3 = must-have, 2 = should-have, 1 = nice-to-have). Interactive version with per-requirement verdicts for the top products: /arena/agentic-commerce/checklist
Agent checkout — stories about agent checkout in this arenaAgent checkout
Stories about agent checkout in this arena
- ai-native userMy agent can create and update a cart or order draft through a documented protocol callmust-have
- ai-native userMy agent can complete a purchase end-to-end — checkout session, delegated payment credential, confirmed ordermust-have
- merchantBuyers can complete purchases of my products inside chat and assistant surfaces (ChatGPT, Claude, Gemini, Copilot and peers)should-have
- developerBuild against a versioned commerce protocol with a published schema and conformance or validation toolingshould-have
Agent discovery — stories about agent discovery in this arenaAgent discovery
Stories about agent discovery in this arena
- ai-native userMy agent can programmatically search products or services across merchants — keylessly or with self-service credentials, no private partnership requiredmust-have
- merchantPublish my product or service catalog into agent surfaces through a documented feed or import API so AI agents can discover what I sellmust-have
- developerRead machine-readable offer data — price, availability, variants, checkout links — for any listed product or serviceshould-have
- ai-native userMy agent can discover payable services and APIs through a published directory or discovery indexshould-have
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
- ai-native userPlug MCP servers into this product so it can use their toolsmust-have
- ai-native userConnect an agent via an official MCP servermust-have
- ai-native userDrive the product through a documented public APImust-have
- ai-native userDelegate tasks to a built-in AI assistant inside the productmust-have
- ai-native userPoint an agent at llms.txt or agent-oriented docsshould-have
- ai-native userRun the product headlessly / in CI for automationshould-have
- ai-native userUse an official CLIshould-have
- ai-native userIssue scoped/least-privilege API credentials for an agentshould-have
- ai-native userBuild against official SDKsshould-have
- ai-native userSubscribe to events via webhooksshould-have
- ai-native userGet AI-generated insights and suggestions from my data inside the productshould-have
- ai-native userSet up automations that run autonomously in the backgroundshould-have
- ai-native userOperate the product with natural-language commandsshould-have
- ai-native userExplore an interactive API reference with runnable examplesshould-have
- ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)should-have
- ai-native userRely on versioned APIs with a documented deprecation policyshould-have
- ai-native userTest against a sandbox environment without touching production datanice-to-have
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
- ai-native userDefine rules that trigger actions automatically on eventsmust-have
- ai-native userPerform bulk operations across many items at onceshould-have
- ai-native userSchedule recurring jobs or workflowsshould-have
- ai-native userVersion, review, and roll back my automationsnice-to-have
Fees economics — stories about fees economics in this arenaFees economics
Stories about fees economics in this arena
- merchantThe fees for agent-originated transactions are published — I can price agentic channels without asking salesshould-have
- merchantAgent-originated payments settle through documented payout and reporting flows, reconcilable like any other channelnice-to-have
Merchant enablement — stories about merchant enablement in this arenaMerchant enablement
Stories about merchant enablement in this arena
- merchantI have a documented self-serve path to start accepting agent traffic — enable a setting, sign an agreement, or publish an endpointmust-have
- merchantOrders are attributed to the originating agent and I can report on or filter transactions by agentshould-have
- merchantRate-limit, allow, or deny specific agents and agent platforms accessing my catalog and checkoutshould-have
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
- ai-native userExport all of my data in open formats and leavemust-have
- ai-native userSelf-host the core productmust-have
- ai-native userDo everything through the API that I can do in the UIshould-have
- ai-native userRead the product's source under an open licenseshould-have
Order lifecycle — stories about order lifecycle in this arenaOrder lifecycle
Stories about order lifecycle in this arena
- developerMy agent or backend can subscribe to order lifecycle events — created, updated, fulfilled, canceled — pushed programmaticallymust-have
- ai-native userMy agent can query the status and tracking of an order it placed, after the purchaseshould-have
Payment credentials — stories about payment credentials in this arenaPayment credentials
Stories about payment credentials in this arena
- ai-native userHand my agent a scoped, limited-use payment credential — amount limits, expiry, merchant restrictions — instead of a raw card numbermust-have
- developerMonetize an API or service with HTTP 402 machine payments that agents pay per call without a checkout UImust-have
- ai-native userProvision a wallet my agent holds and spends from — funded and controlled by me, with balance visibilitymust-have
- developerSettle agent-initiated payments in stablecoins over documented railsshould-have
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
- ai-native userPrevent my data from being used to train AI modelsmust-have
- ai-native userChoose where my data is stored (region/residency)should-have
- ai-native userControl data retention and deletionshould-have
- ai-native userOpt out of telemetry and usage trackingshould-have
Protocol openness — stories about protocol openness in this arenaProtocol openness
Stories about protocol openness in this arena
- developerThe commerce protocol this product speaks is published as an open, versioned specification I can read and implement without signing anythingmust-have
- developerAt least two independent parties beyond the vendor implement the protocol or platform — it is an ecosystem, not a private integrationshould-have
Refunds disputes — stories about refunds disputes in this arenaRefunds disputes
Stories about refunds disputes in this arena
- developerDisputes and chargebacks on agent transactions can be handled via API — evidence submission, status, outcomesshould-have
- developerRefunds on agent-placed orders can be initiated and tracked programmaticallyshould-have
Trust safety — stories about trust safety in this arenaTrust safety
Stories about trust safety in this arena
- merchantAgents identify themselves verifiably — registered profiles, signatures, or trust tiers — so I can tell trusted agent traffic from anonymous botsmust-have
- ai-native userSensitive agent spending requires my documented approval — a confirmation step, signed mandate, or per-purchase consent — before money movesmust-have
- merchantThe fraud, liability, and chargeback rules for agent-initiated transactions are documented so I know who bears the riskshould-have
- ai-native userSet per-agent spend caps and usage limits and revoke an agent's payment authority instantlyshould-have
Appendix: recorded probes
Hands-on probe recordings — transcripts/videos a human can replay, the strongest evidence tier. Watch them at https://ultrametric.ai/productarena/proofs
- Coinbase x402
curl -s https://api.cdp.coinbase.com/platform/v2/x402/discovery/resources # the x402 Bazaar, keyless by designterminal · recorded 2026-09-14 · exit 0 - Coinbase x402
curl -si https://api.cdp.coinbase.com/platform/v2/x402/supported # the hosted facilitator, auth-gatedterminal · recorded 2026-09-14 · exit 0 - Coinbase x402
npm view x402 version # the protocol SDK, on the public registryterminal · recorded 2026-09-14 · exit 0 - Crossmint
curl -s -X POST https://www.crossmint.com/api/unstable/agent-checkouts -d '{}' # live endpoint, names its agent credential in the challengeterminal · recorded 2026-09-14 · exit 0 - Crossmint
curl -s https://docs.crossmint.com/llms.txt | head -3terminal · recorded 2026-09-14 · exit 0 - PayPal Agentic Commerce
curl -si -X POST https://mcp.paypal.com/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>' # the remote MCP server PayPal documents for agentsterminal · recorded 2026-09-14 · exit 0 - PayPal Agentic Commerce
curl -s https://mcp.paypal.com/.well-known/oauth-protected-resource/mcp # public OAuth resource metadataterminal · recorded 2026-09-14 · exit 0 - PayPal Agentic Commerce
npm view @paypal/agent-toolkit versionterminal · recorded 2026-09-14 · exit 0 - Shopify Agentic Commerce
curl -si -X POST https://catalog.shopify.com/api/ucp/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>' # full keyless handshaketerminal · recorded 2026-09-14 · exit 0 - Shopify Agentic Commerce
curl -s -X POST https://hardware.shopify.com/api/ucp/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>' # merchant-storefront UCP endpointterminal · recorded 2026-09-14 · exit 0 - Shopify Agentic Commerce
ucp catalog search --business https://hardware.shopify.com --set /query='card reader' && ucp cart create --business https://hardware.shopify.com --set "/line_items/0/item/id=<variant>" # real keyless cart via UCP on Shopify's own storeterminal · recorded 2026-09-14 · exit 0 - Shopify Agentic Commerce
curl -s -X POST https://catalog.shopify.com/api/ucp/mcp -d '<tools/call search_catalog without agent profile>' # the documented agent-identity gate answers with a structured errorterminal · recorded 2026-09-14 · exit 0 - Shopify Agentic Commerce
curl -s https://ucp.dev/llms.txt | head -3 # the open UCP spec indexterminal · recorded 2026-09-14 · exit 0 - Skyfire
curl -s -X POST https://api.skyfire.xyz/api/v1/tokens/introspect -d '{}' # documented token API, keyless → structured challengeterminal · recorded 2026-09-14 · exit 0 - Skyfire
curl -s https://docs.skyfire.xyz/llms.txt | head -3terminal · recorded 2026-09-14 · exit 0 - Stripe Agentic Commerce
curl -si -X POST https://mcp.stripe.com -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-14 · exit 0 - Stripe Agentic Commerce
curl -s https://mpp.dev/ | head -4 # the MPP spec site answers agents in markdownterminal · recorded 2026-09-14 · exit 0 - Stripe Agentic Commerce
npm view @stripe/link-cli version # the Link agent-wallet CLI, on the public registryterminal · recorded 2026-09-14 · exit 0 - Stripe Agentic Commerce
npm view mppx version # the machine-payments SDK, on the public registryterminal · recorded 2026-09-14 · exit 0 - Stripe Agentic Commerce
curl -s https://docs.stripe.com/.well-known/skills/index.json # Stripe-maintained agent skills, keylessterminal · recorded 2026-09-14 · exit 0 - Visa Intelligent Commerce
curl -s https://api.visa.com/vdp/helloworld # keyless → structured credential challengeterminal · recorded 2026-09-14 · exit 0 - Visa Intelligent Commerce
npm view @visaacceptance/mcp version # the Visa Acceptance MCP server, on the public registryterminal · recorded 2026-09-14 · exit 0 - Visa Intelligent Commerce
curl -s https://raw.githubusercontent.com/visa/trusted-agent-protocol/main/README.md | head -3 # the published TAP spec + reference implementationterminal · recorded 2026-09-14 · exit 0
Cite as: ProductArena by Ultrametric Inc, Agentic Commerce arena, rankings as of 2026-09-15 — https://ultrametric.ai/productarena/arena/agentic-commerce
License: © 2026 Ultrametric Inc. Brief quotation of individual verdicts, scores, or evidence excerpts is permitted with attribution to "ProductArena by Ultrametric Inc (ultrametric.ai/productarena)", as is use of the data to evaluate, contest, or contribute corrections. Bulk copying, redistribution, or use to build competing datasets requires prior written permission (see DATA-LICENSE in the repository).
No liability: rankings, verdicts, and scores are research outputs derived from the cited evidence at a point in time, provided "as is", without warranties. Ultrametric Inc accepts no responsibility for procurement, purchasing, or other decisions made in reliance on them — verify against the cited evidence before acting (https://ultrametric.ai/productarena/terms).