Skip to content
ProductArena

How Honeybadger’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score29/100

Agent-ready 58.6 × 0.30 = 17.58

API quality 0.0 × 0.20 = 0.00

Openness 11.4 × 0.20 = 2.28

Built-in AI 28.7 × 0.15 = 4.30

Automation 31.2 × 0.15 = 4.68

(17.58 + 0.00 + 2.28 + 4.30 + 4.68) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 28.84 ÷ 1.00 = 28.8

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready58.6/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://docs.honeybadger.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.honeybadger.io/llms.txt # Honeybadger.io > Honeybadger provides error tracking, uptime monitoring, logging, and application performance insight”
  • [claimed-docs] https://docs.honeybadger.io/_llms-txt/product-reference.txt“You can create additional accounts and switch between accounts using the dropdown in the navigation bar.”
  • [claimed-docs] https://docs.honeybadger.io/_llms-txt/insights-reference.txt“With it you can specify which fields you want to see, filter the kinds of events that should be returned, perform aggregations and calculations, and more.”
  • [claimed-docs] https://docs.honeybadger.io/_llms-txt/other-reference.txt“Report errors using our [exceptions API](/api/reporting-exceptions/)”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 1.0 (full) = 12.0 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“The Honeybadger CLI provides a Command Line Interface for various Honeybadger-related programs and utilities.”
  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“`honeybadger deploy` Notify Honeybadger of deployment”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-deployments/“Use this endpoint to notify Honeybadger when a deploy occurs.”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”
  • [claimed-docs] https://docs.honeybadger.io/guides/errors/“Once our client library is installed and configured, errors thrown by your application are automatically sent to our API.”
  • [probe] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“official CLI documented at https://docs.honeybadger.io/lib/ruby/gem-reference/cli/”

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://www.honeybadger.io/changelog/“Our hosted MCP server supports OAuth, so you can connect an agent by approving access in your browser instead of copying and pasting a credential into a config file.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”

Connect an agent via an official MCP serverweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://www.honeybadger.io/changelog/“Our hosted MCP server supports OAuth, so you can connect an agent by approving access in your browser instead of copying and pasting a credential into a config file.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”

Use an official CLIweight 2

2 (weight) × 6 (quality) × 1.0 (full) = 12.0 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“The Honeybadger CLI provides a Command Line Interface for various Honeybadger-related programs and utilities.”
  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“`honeybadger deploy` Notify Honeybadger of deployment”
  • [probe] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“official CLI documented at https://docs.honeybadger.io/lib/ruby/gem-reference/cli/”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-source-maps/“Honeybadger can automatically un-minify your JavaScript code if you provide a source map along with your minified files. Use the Source Map Upload API to upload your source maps to Honeybadger.”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-deployments/“Use this endpoint to notify Honeybadger when a deploy occurs.”
  • [claimed-docs] https://docs.honeybadger.io/api/faults/“Returns a list of faults or a single fault for the given project”
  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“The Honeybadger CLI provides a Command Line Interface for various Honeybadger-related programs and utilities.”
  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“`honeybadger deploy` Notify Honeybadger of deployment”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”
  • [probe] https://docs.honeybadger.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeybadger.io/openapi.json, https://docs.honeybadger.io/swagger.json, https://docs.honeybadger.io/api/openapi.json, https://docs.honeybadger.io/.well-known/openapi.json)”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”
  • [probe] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“official CLI documented at https://docs.honeybadger.io/lib/ruby/gem-reference/cli/”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://www.honeybadger.io/changelog/“Our hosted MCP server supports OAuth, so you can connect an agent by approving access in your browser instead of copying and pasting a credential into a config file.”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”

Build against official SDKsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/guides/errors/“Once our client library is installed and configured, errors thrown by your application are automatically sent to our API.”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-source-maps/“Honeybadger can automatically un-minify your JavaScript code if you provide a source map along with your minified files. Use the Source Map Upload API to upload your source maps to Honeybadger.”
  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“The Honeybadger CLI provides a Command Line Interface for various Honeybadger-related programs and utilities.”
  • [claimed-docs] https://www.honeybadger.io/changelog/“Honeybadger now integrates with Oban (the Python port of the Elixir background job library). With this release you can report unhandled worker exceptions and emit per-job telemetry to Honeybadger Insights.”
  • [claimed-docs] https://www.honeybadger.io/changelog/“Capture HTTP requests with automatic instrumentation and take advantage of new configuration options for event correlation, event context, handlers, and more with the updates for our JS packages.”
  • [claimed-docs] https://docs.honeybadger.io/_llms-txt/other-reference.txt“Report errors using our [exceptions API](/api/reporting-exceptions/)”
  • [probe] https://docs.honeybadger.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeybadger.io/openapi.json, https://docs.honeybadger.io/swagger.json, https://docs.honeybadger.io/api/openapi.json, https://docs.honeybadger.io/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/guides/security/“Requests sent from Honeybadger servers for source maps, web hooks, and uptime checks include the header Honeybadger-Token which is a secret token derived from your api key.”

Agent-ready = 105.4 ÷ 180 × 100 = 58.6

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.honeybadger.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeybadger.io/openapi.json, https://docs.honeybadger.io/swagger.json, https://docs.honeybadger.io/api/openapi.json, https://docs.honeybadger.io/.well-known/openapi.json)”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”
  • [claimed-docs] https://docs.honeybadger.io/api/faults/“Returns a list of faults or a single fault for the given project”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.honeybadger.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeybadger.io/openapi.json, https://docs.honeybadger.io/swagger.json, https://docs.honeybadger.io/api/openapi.json, https://docs.honeybadger.io/.well-known/openapi.json)”
  • [claimed-docs] https://docs.honeybadger.io/api/faults/“Returns a list of faults or a single fault for the given project”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”

Test against a sandbox environment without touching production dataweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”
  • [claimed-docs] https://docs.honeybadger.io/api/faults/“Returns a list of faults or a single fault for the given project”
  • [probe] https://docs.honeybadger.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeybadger.io/openapi.json, https://docs.honeybadger.io/swagger.json, https://docs.honeybadger.io/api/openapi.json, https://docs.honeybadger.io/.well-known/openapi.json)”

API quality = 0.0 ÷ 60 × 100 = 0.0

Openness11.4/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-deployments/“Use this endpoint to notify Honeybadger when a deploy occurs.”
  • [claimed-docs] https://docs.honeybadger.io/api/faults/“Returns a list of faults or a single fault for the given project”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-source-maps/“Honeybadger can automatically un-minify your JavaScript code if you provide a source map along with your minified files.”
  • [claimed-docs] https://docs.honeybadger.io/lib/ruby/gem-reference/cli/“The Honeybadger CLI provides a Command Line Interface for various Honeybadger-related programs and utilities.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [probe] https://docs.honeybadger.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeybadger.io/openapi.json, https://docs.honeybadger.io/swagger.json, https://docs.honeybadger.io/api/openapi.json, https://docs.honeybadger.io/.well-known/openapi.json)”
  • [claimed-docs] https://docs.honeybadger.io/_llms-txt/product-reference.txt“You can create additional accounts and switch between accounts using the dropdown in the navigation bar.”

Export all of my data in open formats and leaveweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

  • [claimed-docs] https://docs.honeybadger.io/api/faults/“Returns a list of faults or a single fault for the given project”
  • [claimed-docs] https://docs.honeybadger.io/api/reporting-exceptions/“Your JSON payload should be submitted as the body of a POST request to https://api.honeybadger.io/v1/notices”
  • [claimed-docs] https://www.honeybadger.io/changelog/“We now support detailed issue exports to third-party managers. When enabled, your issue exports to GitHub or GitLab will contain the full markdown, or the full Jira wiki for JIRA Cloud and JIRA Server”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Openness = 11.4 ÷ 100 × 100 = 11.4

Built-in AI28.7/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/guides/errors/search/“You can search for errors without writing the query yourself. Click the lightbulb icon next to the search box to open the “Describe your search” panel, then describe what you want to find.”
  • [claimed-docs] https://docs.honeybadger.io/guides/integrations/“Anomaly detection alerts you when a project’s total error volume deviates from its learned baseline... notifies you when the current rate is statistically unusual (for example, “errors are 4.7× your normal rate”).”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/guides/insights/alarms/“Alarms combine a BadgerQL query (“count all slow requests in the past five minutes”) with a threshold (“when count is > 2”) and trigger alerts when the query result exceeds the threshold.”
  • [claimed-docs] https://docs.honeybadger.io/guides/integrations/“Anomaly detection alerts you when a project’s total error volume deviates from its learned baseline... notifies you when the current rate is statistically unusual (for example, “errors are 4.7× your normal rate”).”
  • [claimed-docs] https://docs.honeybadger.io“Check-ins Tracking pings from scheduled tasks and cron jobs”
  • [claimed-docs] https://docs.honeybadger.io“Uptime monitoring Get notified when your API and website are unresponsive”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

  • [claimed-docs] https://docs.honeybadger.io/guides/errors/search/“You can search for errors without writing the query yourself. Click the lightbulb icon next to the search box to open the “Describe your search” panel, then describe what you want to find.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/guides/errors/search/“You can search for errors without writing the query yourself. Click the lightbulb icon next to the search box to open the “Describe your search” panel, then describe what you want to find.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“Once connected, your AI assistant gains the following capabilities: Project management... Error investigation... Insights: Run BadgerQL queries against your event data.”
  • [claimed-docs] https://docs.honeybadger.io/resources/mcp/“your AI assistant can fetch Honeybadger data, analyze patterns, and help investigate production issues within your existing workflow.”
  • [probe] https://docs.honeybadger.io/resources/mcp/“official MCP server documented at https://docs.honeybadger.io/resources/mcp/”

Built-in AI = 25.8 ÷ 90 × 100 = 28.7

Automation31.2/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.honeybadger.io/guides/deployments/“By default, all unresolved errors are automatically marked as resolved when a deployment is recorded, which helps keep your error list clean.”
  • [claimed-docs] https://docs.honeybadger.io/guides/deployments/“Deployment tracking lets you record when your app is deployed, see a history of deployments, and correlate code changes with errors. When you deploy, Honeybadger can automatically resolve open errors and notify your team.”
  • [claimed-docs] https://docs.honeybadger.io/_llms-txt/insights-reference.txt“With it you can specify which fields you want to see, filter the kinds of events that should be returned, perform aggregations and calculations, and more.”
  • [claimed-docs] https://docs.honeybadger.io/guides/insights/alarms/“Alarms combine a BadgerQL query (“count all slow requests in the past five minutes”) with a threshold (“when count is > 2”) and trigger alerts when the query result exceeds the threshold.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://docs.honeybadger.io/guides/insights/alarms/“Alarms combine a BadgerQL query (“count all slow requests in the past five minutes”) with a threshold (“when count is > 2”) and trigger alerts when the query result exceeds the threshold.”
  • [claimed-docs] https://docs.honeybadger.io/guides/integrations/“Anomaly detection alerts you when a project’s total error volume deviates from its learned baseline... notifies you when the current rate is statistically unusual (for example, “errors are 4.7× your normal rate”).”
  • [claimed-docs] https://docs.honeybadger.io/guides/deployments/“By default, all unresolved errors are automatically marked as resolved when a deployment is recorded, which helps keep your error list clean.”
  • [claimed-docs] https://docs.honeybadger.io/guides/deployments/“Deployment tracking lets you record when your app is deployed, see a history of deployments, and correlate code changes with errors. When you deploy, Honeybadger can automatically resolve open errors and notify your team.”

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://docs.honeybadger.io“Check-ins Tracking pings from scheduled tasks and cron jobs”

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 15.6 ÷ 50 × 100 = 31.2