How Autumn’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score27/100
Agent-ready 59.6 × 0.30 = 17.88
API quality 0.0 × 0.20 = 0.00
Openness 10.8 × 0.20 = 2.16
Built-in AI 30.0 × 0.15 = 4.50
Automation 14.4 × 0.15 = 2.16
(17.88 + 0.00 + 2.16 + 4.50 + 2.16) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 26.70 ÷ 1.00 = 26.7
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready59.6/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [probe] https://docs.useautumn.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.useautumn.com/llms.txt # Autumn - [Welcome to Autumn](https://docs.useautumn.com/welcome.md): Drop-in, open-source control layer for AI and Sa”
- [claimed-docs] https://docs.useautumn.com/documentation/mcp.md“Autumn MCP connects AI assistants to Autumn's billing, customer, plan, balance, and log tools.”
- [probe] https://docs.useautumn.com/documentation/mcp“official MCP server documented at https://docs.useautumn.com/documentation/mcp”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“The `atmn` CLI lets you define your pricing plans in code via an `autumn.config.ts` file, and sync them to Autumn with a single command.”
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“You can preview your plans without pushing anything: bunx atmn preview”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/setup.md“If you already have products created in the dashboard, run `atmn pull` to pull them into your local config.”
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [probe] https://docs.useautumn.com/cli/getting-started“official CLI documented at https://docs.useautumn.com/cli/getting-started”
Plug MCP servers into this product so it can use their toolsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
- [claimed-docs] https://docs.useautumn.com/documentation/mcp.md“Autumn MCP connects AI assistants to Autumn's billing, customer, plan, balance, and log tools.”
- [probe] https://docs.useautumn.com/documentation/mcp“official MCP server documented at https://docs.useautumn.com/documentation/mcp”
Connect an agent via an official MCP serverweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.useautumn.com/documentation/mcp.md“Autumn MCP connects AI assistants to Autumn's billing, customer, plan, balance, and log tools.”
- [probe] https://docs.useautumn.com/documentation/mcp“official MCP server documented at https://docs.useautumn.com/documentation/mcp”
Use an official CLIweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“The `atmn` CLI lets you define your pricing plans in code via an `autumn.config.ts` file, and sync them to Autumn with a single command.”
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“You can preview your plans without pushing anything: bunx atmn preview”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/setup.md“If you already have products created in the dashboard, run `atmn pull` to pull them into your local config.”
- [probe] https://docs.useautumn.com/cli/getting-started“official CLI documented at https://docs.useautumn.com/cli/getting-started”
Drive the product through a documented public APIweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“You can also [check and reserve] balance in a single, atomic API call for concurrent events.”
- [claimed-docs] https://docs.useautumn.com/api-reference/billing/attach.md“Attaches a plan to a customer. Handles new subscriptions, upgrades and downgrades.”
- [claimed-docs] https://docs.useautumn.com/documentation/webhooks.md“Fired whenever a customer's plans change — new subscriptions, upgrades, downgrades, etc.”
- [probe] https://docs.useautumn.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.useautumn.com/openapi.json, https://docs.useautumn.com/swagger.json, https://docs.useautumn.com/api/openapi.json, https://docs.useautumn.com/.well-known/openapi.json)”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [claimed-docs] https://docs.useautumn.com/documentation/mcp.md“Autumn MCP connects AI assistants to Autumn's billing, customer, plan, balance, and log tools.”
- [community] https://hn.algolia.com/api/v1/items/43995122“Commenters criticized Autumn's 'backendless billing' approach as reinventing JWTs poorly: "Your encrypted customer ID has the exact same semantics as the original customer ID for an attacker, and is insecure."”
- [community] https://hn.algolia.com/api/v1/items/43995122“Security concern raised: Autumn's server actions were public, unauthenticated routes, meaning "a simple curl request with a different customer_id would let you upgrade/downgrade other accounts" - a textbook IDOR vulnerability.”
Build against official SDKsweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“The `atmn` CLI lets you define your pricing plans in code via an `autumn.config.ts` file, and sync them to Autumn with a single command.”
- [claimed-docs] https://docs.useautumn.com/api-reference/billing/attach.md“Attaches a plan to a customer. Handles new subscriptions, upgrades and downgrades.”
- [probe] https://docs.useautumn.com/cli/getting-started“official CLI documented at https://docs.useautumn.com/cli/getting-started”
Subscribe to events via webhooksweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/webhooks.md“Fired whenever a customer's plans change — new subscriptions, upgrades, downgrades, etc.”
Agent-ready = 107.2 ÷ 180 × 100 = 59.6
API quality0.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/api-reference/billing/attach.md“Attaches a plan to a customer. Handles new subscriptions, upgrades and downgrades.”
- [probe] https://docs.useautumn.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.useautumn.com/openapi.json, https://docs.useautumn.com/swagger.json, https://docs.useautumn.com/api/openapi.json, https://docs.useautumn.com/.well-known/openapi.json)”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.useautumn.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.useautumn.com/openapi.json, https://docs.useautumn.com/swagger.json, https://docs.useautumn.com/api/openapi.json, https://docs.useautumn.com/.well-known/openapi.json)”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“You can preview your plans without pushing anything: bunx atmn preview”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.useautumn.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.useautumn.com/openapi.json, https://docs.useautumn.com/swagger.json, https://docs.useautumn.com/api/openapi.json, https://docs.useautumn.com/.well-known/openapi.json)”
- [claimed-docs] https://docs.useautumn.com/changelog/changelog“Usage alerts gain a `basis` field that defines what 100% means: the full `balance` (the default, unchanged), the plan’s `included` grants, `recurring` grants, or a `usage_limit` window”
- [claimed-docs] https://docs.useautumn.com/changelog/changelog“Catalog plans now accept a `processors` object so Autumn can reuse your existing Stripe catalog instead of minting new objects.”
API quality = 0.0 ÷ 70 × 100 = 0.0
Openness10.8/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [claimed-docs] https://docs.useautumn.com/documentation/modelling-pricing/credit-systems.md“Credit systems let you track actions with different credit costs from a single balance pool.”
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“The `atmn` CLI lets you define your pricing plans in code via an `autumn.config.ts` file, and sync them to Autumn with a single command.”
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“You can preview your plans without pushing anything: bunx atmn preview”
- [claimed-docs] https://docs.useautumn.com/documentation/mcp.md“Autumn MCP connects AI assistants to Autumn's billing, customer, plan, balance, and log tools.”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/setup.md“If you already have products created in the dashboard, run `atmn pull` to pull them into your local config.”
- [probe] https://docs.useautumn.com/documentation/mcp“official MCP server documented at https://docs.useautumn.com/documentation/mcp”
- [probe] https://docs.useautumn.com/cli/getting-started“official CLI documented at https://docs.useautumn.com/cli/getting-started”
Export all of my data in open formats and leaveweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“The `atmn` CLI lets you define your pricing plans in code via an `autumn.config.ts` file, and sync them to Autumn with a single command.”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/setup.md“If you already have products created in the dashboard, run `atmn pull` to pull them into your local config.”
- [claimed-docs] https://docs.useautumn.com/documentation/webhooks.md“Fired whenever a customer's plans change — new subscriptions, upgrades, downgrades, etc.”
Read the product's source under an open licenseweight 2
2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max
- [probe] https://docs.useautumn.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.useautumn.com/llms.txt # Autumn - [Welcome to Autumn](https://docs.useautumn.com/welcome.md): Drop-in, open-source control layer for AI and Sa”
Self-host the core productweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [probe] https://docs.useautumn.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.useautumn.com/llms.txt # Autumn - [Welcome to Autumn](https://docs.useautumn.com/welcome.md): Drop-in, open-source control layer for AI and Sa”
Openness = 10.8 ÷ 100 × 100 = 10.8
Built-in AI30.0/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Set up automations that run autonomously in the backgroundweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Delegate tasks to a built-in AI assistant inside the productweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Operate the product with natural-language commandsweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/mcp.md“Autumn MCP connects AI assistants to Autumn's billing, customer, plan, balance, and log tools.”
- [probe] https://docs.useautumn.com/documentation/mcp“official MCP server documented at https://docs.useautumn.com/documentation/mcp”
Built-in AI = 6.0 ÷ 20 × 100 = 30.0
Automation14.4/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.useautumn.com/documentation/customers/check.md“const response = await autumn.check({ customerId: "user_123", featureId: "messages" });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [claimed-docs] https://docs.useautumn.com/api-reference/billing/attach.md“Attaches a plan to a customer. Handles new subscriptions, upgrades and downgrades.”
- [claimed-docs] https://docs.useautumn.com/cli/getting-started.md“The `atmn` CLI lets you define your pricing plans in code via an `autumn.config.ts` file, and sync them to Autumn with a single command.”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max
- [claimed-docs] https://docs.useautumn.com/documentation/webhooks.md“Fired whenever a customer's plans change — new subscriptions, upgrades, downgrades, etc.”
- [claimed-docs] https://docs.useautumn.com/changelog/changelog“Usage alerts gain a `basis` field that defines what 100% means: the full `balance` (the default, unchanged), the plan’s `included` grants, `recurring` grants, or a `usage_limit` window”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“await autumn.track({ customerId: "user_or_org_id_from_auth", featureId: "messages", value: 1, });”
- [claimed-docs] https://docs.useautumn.com/documentation/getting-started/gating.md“You can also [check and reserve] balance in a single, atomic API call for concurrent events.”
Schedule recurring jobs or workflowsweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Version, review, and roll back my automationsweight 1
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Automation = 7.2 ÷ 50 × 100 = 14.4