How Honeycomb’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score30/100
Agent-ready 46.7 × 0.30 = 14.01
API quality 22.9 × 0.20 = 4.58
Openness 7.2 × 0.20 = 1.44
Built-in AI 39.1 × 0.15 = 5.87
Automation 26.3 × 0.15 = 3.94
(14.01 + 4.58 + 1.44 + 5.87 + 3.94) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 29.84 ÷ 1.00 = 29.8
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready46.7/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [probe] https://docs.honeycomb.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.honeycomb.io/llms.txt # Honeycomb Docs ## Get Started - [Get Started: Overview](https://docs.honeycomb.io/get-started.md): Instrument your a”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [probe] https://docs.honeycomb.io/integrations/mcp/concepts“official MCP server documented at https://docs.honeycomb.io/integrations/mcp/concepts”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
- [claimed-docs] https://docs.honeycomb.io/send-data/opentelemetry/“If your application is already instrumented with OpenTelemetry, you can send OpenTelemetry Protocol (OTLP) data directly to Honeycomb.”
Plug MCP servers into this product so it can use their toolsweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“They can: * Investigate and diagnose latency or error spikes * Identify performance outliers and suggest optimization opportunities”
- [probe] https://docs.honeycomb.io/integrations/mcp/concepts“official MCP server documented at https://docs.honeycomb.io/integrations/mcp/concepts”
Connect an agent via an official MCP serverweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“They can: * Investigate and diagnose latency or error spikes * Identify performance outliers and suggest optimization opportunities”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“Investigate and diagnose latency or error spikes; Identify performance outliers and suggest optimization opportunities”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“Translate existing dashboards and alerts into Honeycomb's query language”
- [probe] https://docs.honeycomb.io/integrations/mcp/concepts“official MCP server documented at https://docs.honeycomb.io/integrations/mcp/concepts”
Use an official CLIweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Drive the product through a documented public APIweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
Build against official SDKsweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.honeycomb.io/send-data/opentelemetry/“Instrument your applications with OpenTelemetry, the open-source standard for collecting telemetry, and send traces, logs, and metrics to Honeycomb.”
- [claimed-docs] https://docs.honeycomb.io/send-data/opentelemetry/“Honeycomb supports receiving telemetry data via OpenTelemetry’s native protocol, OTLP, over gRPC, HTTP/protobuf, and HTTP/JSON.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/get-started/honeycomb/traces-metrics-logs“This example creates a span, adds context as attributes, and closes it when the work is done”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
Subscribe to events via webhooksweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/notify“Set up Triggers and SLOs to alert your team when conditions are met, and route notifications to Slack, PagerDuty, Microsoft Teams, or a custom webhook.”
- [claimed-docs] https://docs.honeycomb.io/notify“This allows you to build custom integrations that receive JSON payloads from Honeycomb upon alerts firing.”
- [claimed-docs] https://docs.honeycomb.io/notify“Use triggers to send alerts when thresholds that you define and configure are passed.”
- [claimed-docs] https://docs.honeycomb.io/notify“Use Service Level Objectives (SLOs) to define an agreement regarding delivery of a given service and be alerted when your SLO budget is threatened.”
Agent-ready = 98.0 ÷ 210 × 100 = 46.7
API quality22.9/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
API quality = 16.0 ÷ 70 × 100 = 22.9
Openness7.2/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [claimed-docs] https://docs.honeycomb.io/investigate/query/build/query-assistant“Query Assistant is a feature that generates Honeycomb queries based on your natural language query (NLQ) input.”
- [claimed-docs] https://docs.honeycomb.io/investigate/observe/boards“A Board is a workspace where you can save, organize, and share analysis components focused on a common objective.”
- [claimed-docs] https://docs.honeycomb.io/investigate/observe/boards“we offer pre-configured Board Templates for common use cases... saving you time that would otherwise be spent building Boards manually.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
Export all of my data in open formats and leaveweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“You can download the Honeycomb OpenAPI spec to use with your own tooling.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [probe] https://docs.honeycomb.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.honeycomb.io/openapi.json, https://docs.honeycomb.io/swagger.json, https://docs.honeycomb.io/api/openapi.json, https://docs.honeycomb.io/.well-known/openapi.json)”
Read the product's source under an open licenseweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Self-host the core productweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://www.honeycomb.io/pricing“Our introductory plan, free forever.”
- [claimed-docs] https://www.honeycomb.io/pricing“Event Volume: Up to 20M per month Metrics Data Points: Up to 100M per month”
Openness = 7.2 ÷ 100 × 100 = 7.2
Built-in AI39.1/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.honeycomb.io/investigate/query/build/query-assistant“Query Assistant is a feature that generates Honeycomb queries based on your natural language query (NLQ) input.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“They can: * Investigate and diagnose latency or error spikes * Identify performance outliers and suggest optimization opportunities”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“Investigate and diagnose latency or error spikes; Identify performance outliers and suggest optimization opportunities”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“Investigate and diagnose latency or error spikes * Identify performance outliers and suggest optimization opportunities”
- [claimed-docs] https://www.honeycomb.io/pricing“BubbleUp ![Checkmark]”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max
- [claimed-docs] https://docs.honeycomb.io/notify“Use triggers to send alerts when thresholds that you define and configure are passed.”
- [claimed-docs] https://docs.honeycomb.io/notify“Use Service Level Objectives (SLOs) to define an agreement regarding delivery of a given service and be alerted when your SLO budget is threatened.”
- [claimed-docs] https://docs.honeycomb.io/notify“Set up Triggers and SLOs to alert your team when conditions are met, and route notifications to Slack, PagerDuty, Microsoft Teams, or a custom webhook.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max
- [claimed-docs] https://docs.honeycomb.io/investigate/query/build/query-assistant“Query Assistant is a feature that generates Honeycomb queries based on your natural language query (NLQ) input.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“They can: * Investigate and diagnose latency or error spikes * Identify performance outliers and suggest optimization opportunities”
Operate the product with natural-language commandsweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/investigate/query/build/query-assistant“Query Assistant is a feature that generates Honeycomb queries based on your natural language query (NLQ) input.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/configuration-guide“Connect Honeycomb to any AI agent that supports the Model Context Protocol (MCP) so it can query your telemetry, investigate issues, and answer questions using your live Honeycomb data.”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“They can: * Investigate and diagnose latency or error spikes * Identify performance outliers and suggest optimization opportunities”
- [claimed-docs] https://docs.honeycomb.io/integrations/mcp/concepts“Translate existing dashboards and alerts into Honeycomb's query language”
- [probe] https://docs.honeycomb.io/integrations/mcp/concepts“official MCP server documented at https://docs.honeycomb.io/integrations/mcp/concepts”
Built-in AI = 35.2 ÷ 90 × 100 = 39.1
Automation26.3/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max
- [claimed-docs] https://docs.honeycomb.io/notify“Use triggers to send alerts when thresholds that you define and configure are passed.”
- [claimed-docs] https://docs.honeycomb.io/notify“Use Service Level Objectives (SLOs) to define an agreement regarding delivery of a given service and be alerted when your SLO budget is threatened.”
- [claimed-docs] https://docs.honeycomb.io/notify“Set up Triggers and SLOs to alert your team when conditions are met, and route notifications to Slack, PagerDuty, Microsoft Teams, or a custom webhook.”
- [claimed-docs] https://docs.honeycomb.io/notify“This allows you to build custom integrations that receive JSON payloads from Honeycomb upon alerts firing.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
Schedule recurring jobs or workflowsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.honeycomb.io/notify“Use triggers to send alerts when thresholds that you define and configure are passed.”
- [claimed-docs] https://docs.honeycomb.io/notify“Use Service Level Objectives (SLOs) to define an agreement regarding delivery of a given service and be alerted when your SLO budget is threatened.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
Version, review, and roll back my automationsweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
- [claimed-docs] https://docs.honeycomb.io/notify“Use triggers to send alerts when thresholds that you define and configure are passed.”
- [claimed-docs] https://docs.honeycomb.io/notify“Use Service Level Objectives (SLOs) to define an agreement regarding delivery of a given service and be alerted when your SLO budget is threatened.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Build integrations and automate workflows with the Honeycomb API. Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
- [claimed-docs] https://docs.honeycomb.io/api/introduction“Programmatically manage datasets, queries, triggers, SLOs, environments, API keys, and more.”
Automation = 21.0 ÷ 80 × 100 = 26.3