Skip to content

How AgentMail’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score46/100

Agent-ready 81.7 × 0.30 = 24.51

API quality 34.3 × 0.20 = 6.86

Openness 25.0 × 0.20 = 5.00

Built-in AI 33.0 × 0.15 = 4.95

Automation 27.6 × 0.15 = 4.14

(24.51 + 6.86 + 5.00 + 4.95 + 4.14) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 45.46 ÷ 1.00 = 45.5

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready81.7/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.agentmail.to/llms.txtPROBE llms.txt: HTTP 200 at https://docs.agentmail.to/llms.txt # AgentMail | Documentation > AgentMail is an email API built for AI agents. Create inboxes, send and receive messages,
  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.agentmail.to/quickstart.mdThe agent registers itself using the human email you provide and gets back an API key, inbox ID, and organization ID.
  • [probe] https://docs.agentmail.to/integrations/mcpofficial MCP server documented at https://docs.agentmail.to/integrations/mcp

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.
  • [claimed-docs] https://docs.agentmail.to/integrations/cli.mdCreate inboxes, send messages, manage threads, and more — all without writing code.
  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdInstead of constantly asking the AgentMail API if there's a new email (a process called polling), you can register a URL, and we will send you a POST request
  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdyou can register a URL, and we will send you a `POST` request with the details as soon as an event happens.
  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [probe] https://docs.agentmail.to/integrations/cliofficial CLI documented at https://docs.agentmail.to/integrations/cli

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at https://mcp.agentmail.to/mcp that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at `https://mcp.agentmail.to/mcp` that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [probe] https://docs.agentmail.to/integrations/mcpofficial MCP server documented at https://docs.agentmail.to/integrations/mcp

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at https://mcp.agentmail.to/mcp that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at `https://mcp.agentmail.to/mcp` that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [probe] https://docs.agentmail.to/integrations/mcpofficial MCP server documented at https://docs.agentmail.to/integrations/mcp

Use an official CLIweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.agentmail.to/integrations/cli.mdCreate inboxes, send messages, manage threads, and more — all without writing code.
  • [probe] https://docs.agentmail.to/integrations/cliofficial CLI documented at https://docs.agentmail.to/integrations/cli

Drive the product through a documented public APIweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://docs.agentmail.to/quickstart.mdThe agent registers itself using the human email you provide and gets back an API key, inbox ID, and organization ID.
  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.
  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [probe] https://docs.agentmail.to/llms.txtPROBE llms.txt: HTTP 200 at https://docs.agentmail.to/llms.txt # AgentMail | Documentation > AgentMail is an email API built for AI agents. Create inboxes, send and receive messages,
  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdInstead of constantly asking the AgentMail API if there's a new email (a process called polling), you can register a URL, and we will send you a POST request

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.agentmail.to/multi-tenancy.mdcreate a Pod per customer, give them a scoped API key, and route webhook events to the right place.
  • [claimed-docs] https://docs.agentmail.to/multi-tenancy.mdScoped API keys restrict access to a single pod or a single inbox.
  • [claimed-docs] https://docs.agentmail.to/permissions.md`Permissions` let you restrict what an API key can do.
  • [claimed-docs] https://docs.agentmail.to/documentation/core-concepts/pods.mdCreate one pod per customer/tenant in your system

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.agentmail.to/quickstart.mdThe agent registers itself using the human email you provide and gets back an API key, inbox ID, and organization ID.
  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.
  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [community] https://news.ycombinator.com/item?id=44745820What I am most impressed by is the popovers in your dashboard, which show SDK examples. This is a brilliant UI idea (executed with great polish) and is the first time I'm seeing it.

Subscribe to events via webhooksweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdInstead of constantly asking the AgentMail API if there's a new email (a process called polling), you can register a URL, and we will send you a POST request
  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdyou can register a URL, and we will send you a `POST` request with the details as soon as an event happens.

Agent-ready = 147.0 ÷ 180 × 100 = 81.7

API quality34.3/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [community] https://news.ycombinator.com/item?id=46812608The website is really bad. Moving from Python to curl tab on the site shows noticeable lag - I have seen 2-3 whole websites load faster in that time. Absolutely crazy to witness.
  • [community] https://news.ycombinator.com/item?id=44745820What I am most impressed by is the popovers in your dashboard, which show SDK examples. This is a brilliant UI idea (executed with great polish) and is the first time I'm seeing it.
  • [community] https://news.ycombinator.com/item?id=46812608"Application error: a client-side exception has occurred while loading www.agentmail.to"... Failed to create WebGL context... Cookie rejected for invalid domain. Dafuq does an email website need WebGL for? Let me guess...vibe-coded?
  • [community] https://news.ycombinator.com/item?id=46812608I have written about how slow the website is... the amount of lag is something I have genuinely never witnessed in any website... I can't view your website in 16 gigs of a computer.

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

API quality = 24.0 ÷ 70 × 100 = 34.3

Openness25.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.
  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.agentmail.to/integrations/cli.mdCreate inboxes, send messages, manage threads, and more — all without writing code.
  • [probe] https://docs.agentmail.to/integrations/cliofficial CLI documented at https://docs.agentmail.to/integrations/cli
  • [claimed-docs] https://docs.agentmail.to/multi-tenancy.mdcreate a Pod per customer, give them a scoped API key, and route webhook events to the right place.
  • [claimed-docs] https://docs.agentmail.to/multi-tenancy.mdScoped API keys restrict access to a single pod or a single inbox.
  • [claimed-docs] https://docs.agentmail.to/permissions.md`Permissions` let you restrict what an API key can do.

Export all of my data in open formats and leaveweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.agentmail.to/imap-smtp.mdConnect Outlook, Thunderbird, Apple Mail, or any IMAP/SMTP-compatible client to your AgentMail inbox
  • [probe] https://docs.agentmail.to/openapi.jsonPROBE openapi: HTTP 200 at https://docs.agentmail.to/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.agentmail.to/integrations/cli.mdCreate inboxes, send messages, manage threads, and more — all without writing code.

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.
  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at https://mcp.agentmail.to/mcp that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [community] https://news.ycombinator.com/item?id=47785862agentmail charges $20/mo for 10 inboxes. autopilot gives you unlimited inboxes for the cost of a postgres row, positioning itself as a self-hosted drop-in replacement with the same SDK.

Openness = 25.0 ÷ 100 × 100 = 25.0

Built-in AI33.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdInstead of constantly asking the AgentMail API if there's a new email (a process called polling), you can register a URL, and we will send you a POST request
  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdyou can register a URL, and we will send you a `POST` request with the details as soon as an event happens.
  • [claimed-docs] https://docs.agentmail.to/websockets.mdWebSockets provide a persistent, bidirectional connection to AgentMail for receiving email events in real-time.
  • [claimed-docs] https://docs.agentmail.to/websockets.mdWebSockets don't require a public URL or external tools like ngrok.

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at https://mcp.agentmail.to/mcp that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [claimed-docs] https://docs.agentmail.to/integrations/mcp.mdAgentMail runs a hosted MCP server at `https://mcp.agentmail.to/mcp` that exposes inbox, message, thread, draft, and attachment tools to any compatible client.
  • [claimed-docs] https://docs.agentmail.to/integrations/cli.mdCreate inboxes, send messages, manage threads, and more — all without writing code.
  • [probe] https://docs.agentmail.to/integrations/mcpofficial MCP server documented at https://docs.agentmail.to/integrations/mcp
  • [probe] https://docs.agentmail.to/integrations/cliofficial CLI documented at https://docs.agentmail.to/integrations/cli

Built-in AI = 13.2 ÷ 40 × 100 = 33.0

Automation27.6/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.agentmail.to/inboxes.mdYou can create tens, hundreds, or even thousands of Inboxes for your agents on demand.
  • [claimed-docs] https://agentmail.toCreate, manage, and operate email inboxes entirely via API.
  • [claimed-docs] https://docs.agentmail.to/integrations/cli.mdCreate inboxes, send messages, manage threads, and more — all without writing code.

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdInstead of constantly asking the AgentMail API if there's a new email (a process called polling), you can register a URL, and we will send you a POST request
  • [claimed-docs] https://docs.agentmail.to/webhooks-overview.mdyou can register a URL, and we will send you a `POST` request with the details as soon as an event happens.
  • [claimed-docs] https://docs.agentmail.to/websockets.mdWebSockets provide a persistent, bidirectional connection to AgentMail for receiving email events in real-time.
  • [claimed-docs] https://docs.agentmail.to/lists.md`Lists` allow you to filter emails by allowing or blocking specific email addresses or domains.
  • [claimed-docs] https://docs.agentmail.to/labels.mdUse `Labels` to track the state of a conversation.

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 13.8 ÷ 50 × 100 = 27.6