Skip to content

How FireHydrant’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score26/100

Agent-ready 35.0 × 0.30 = 10.50

API quality 0.0 × 0.20 = 0.00

Openness 20.0 × 0.20 = 4.00

Built-in AI 43.8 × 0.15 = 6.57

Automation 30.0 × 0.15 = 4.50

(10.50 + 0.00 + 4.00 + 6.57 + 4.50) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 25.57 ÷ 1.00 = 25.6

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready35.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://docs.firehydrant.com/llms.txtPROBE llms.txt: HTTP 200 at https://docs.firehydrant.com/llms.txt # FireHydrant Documentation Documentation > FireHydrant is a complete alerting and incident management platform to help
  • [probe] https://github.com/firehydrant/firehydrant-mcpofficial MCP server documented at https://github.com/firehydrant/firehydrant-mcp
  • [probe] https://github.com/firehydrant/firehydrant-mcpPROBE runtime (recorded 2026-09-06): FireHydrant's official MCP server (npm firehydrant-mcp 0.0.4, maintained by fh-eng) completed a FULL keyless stdio initialize handshake — `npx -y firehydrant-mcp start --transport stdio` answered with serverInfo {name: FireHydrant, version: 0.0.4} and advertised tools and prompts capabilities.

Run the product headlessly / in CI for automationweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysFireHydrant allows you to access the API with an API key using token-based authentication.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysAn API key can perform actions like any other user, and by default, it will have Owner permissions.
  • [claimed-docs] https://github.com/firehydrant/firehydrant-mcpOfficial FireHydrant MCP server
  • [probe] https://github.com/firehydrant/firehydrant-mcpPROBE runtime (recorded 2026-09-06): FireHydrant's official MCP server (npm firehydrant-mcp 0.0.4, maintained by fh-eng) completed a FULL keyless stdio initialize handshake — `npx -y firehydrant-mcp start --transport stdio` answered with serverInfo {name: FireHydrant, version: 0.0.4} and advertised tools and prompts capabilities.

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://github.com/firehydrant/firehydrant-mcpOfficial FireHydrant MCP server
  • [probe] https://github.com/firehydrant/firehydrant-mcpofficial MCP server documented at https://github.com/firehydrant/firehydrant-mcp
  • [probe] https://github.com/firehydrant/firehydrant-mcpPROBE runtime (recorded 2026-09-06): FireHydrant's official MCP server (npm firehydrant-mcp 0.0.4, maintained by fh-eng) completed a FULL keyless stdio initialize handshake — `npx -y firehydrant-mcp start --transport stdio` answered with serverInfo {name: FireHydrant, version: 0.0.4} and advertised tools and prompts capabilities.

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://github.com/firehydrant/firehydrant-mcpOfficial FireHydrant MCP server
  • [probe] https://github.com/firehydrant/firehydrant-mcpofficial MCP server documented at https://github.com/firehydrant/firehydrant-mcp
  • [probe] https://github.com/firehydrant/firehydrant-mcpPROBE runtime (recorded 2026-09-06): FireHydrant's official MCP server (npm firehydrant-mcp 0.0.4, maintained by fh-eng) completed a FULL keyless stdio initialize handshake — `npx -y firehydrant-mcp start --transport stdio` answered with serverInfo {name: FireHydrant, version: 0.0.4} and advertised tools and prompts capabilities.

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysCopy the API key and record it somewhere safe, as it grants access to the FireHydrant API on behalf of your organization.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysAn API key can perform actions like any other user, and by default, it will have Owner permissions.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysFireHydrant allows you to access the API with an API key using token-based authentication.
  • [probe] https://docs.firehydrant.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.firehydrant.com/openapi.json, https://docs.firehydrant.com/swagger.json, https://docs.firehydrant.com/api/openapi.json, https://docs.firehydrant.com/.well-known/openapi.json)
  • [probe] https://github.com/firehydrant/firehydrant-mcpofficial MCP server documented at https://github.com/firehydrant/firehydrant-mcp
  • [probe] https://github.com/firehydrant/firehydrant-mcpPROBE runtime (recorded 2026-09-06): FireHydrant's official MCP server (npm firehydrant-mcp 0.0.4, maintained by fh-eng) completed a FULL keyless stdio initialize handshake — `npx -y firehydrant-mcp start --transport stdio` answered with serverInfo {name: FireHydrant, version: 0.0.4} and advertised tools and prompts capabilities.

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysAn API key can perform actions like any other user, and by default, it will have Owner permissions.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysCopy the API key and record it somewhere safe, as it grants access to the FireHydrant API on behalf of your organization.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysFireHydrant allows you to access the API with an API key using token-based authentication.

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysFireHydrant allows you to access the API with an API key using token-based authentication.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysAn API key can perform actions like any other user, and by default, it will have Owner permissions.
  • [probe] https://docs.firehydrant.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.firehydrant.com/openapi.json, https://docs.firehydrant.com/swagger.json, https://docs.firehydrant.com/api/openapi.json, https://docs.firehydrant.com/.well-known/openapi.json)

Subscribe to events via webhooksweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.

Agent-ready = 73.6 ÷ 210 × 100 = 35.0

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysCopy the API key and record it somewhere safe, as it grants access to the FireHydrant API on behalf of your organization.
  • [probe] https://docs.firehydrant.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.firehydrant.com/openapi.json, https://docs.firehydrant.com/swagger.json, https://docs.firehydrant.com/api/openapi.json, https://docs.firehydrant.com/.well-known/openapi.json)

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.firehydrant.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.firehydrant.com/openapi.json, https://docs.firehydrant.com/swagger.json, https://docs.firehydrant.com/api/openapi.json, https://docs.firehydrant.com/.well-known/openapi.json)
  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysCopy the API key and record it somewhere safe, as it grants access to the FireHydrant API on behalf of your organization.
  • [probe] https://docs.firehydrant.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.firehydrant.com/openapi.json, https://docs.firehydrant.com/swagger.json, https://docs.firehydrant.com/api/openapi.json, https://docs.firehydrant.com/.well-known/openapi.json)

API quality = 0.0 ÷ 70 × 100 = 0.0

Openness20.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysAn API key can perform actions like any other user, and by default, it will have Owner permissions.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysFireHydrant allows you to access the API with an API key using token-based authentication.
  • [probe] https://docs.firehydrant.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.firehydrant.com/openapi.json, https://docs.firehydrant.com/swagger.json, https://docs.firehydrant.com/api/openapi.json, https://docs.firehydrant.com/.well-known/openapi.json)

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Openness = 14.0 ÷ 70 × 100 = 20.0

Built-in AI43.8/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-managementDive into incidents with AI-generated summaries that provide a clear, concise overview of the situation. Perfect for bringing new responders up to speed in no time.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-drafted-retrospectivesWhen you click "Draft with AI" next to any question in your retrospective template, FireHydrant will: Analyze the incident's t
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-managementFireHydrant's Copilot proactively compares ongoing incidents to your existing and previous incidents and makes suggestions in the Command Center and Slack.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-drafted-retrospectivesAI-Drafted Retrospectives generate a comprehensive draft that includes a structured overview of the incident, timelines, impacts, and preliminary Lessons Learned.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-drafted-retrospectivesUpon incident resolution, AI-Drafted Retrospectives generate a comprehensive draft that includes a structured overview of the incident, timelines, impacts, and preliminary Lessons Learned.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-summariesSummaries are created as soon as an incident is declared, providing key information right from the start.

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/docs/intro-to-runbooksRunbooks are FireHydrant's automation engine. They define and automate a workflow of steps and actions according to specified conditions.
  • [claimed-docs] https://docs.firehydrant.com/docs/intro-to-runbooksWhen you first sign up for an account, FireHydrant builds a Default Runbook for you that always attaches to every incident.
  • [claimed-docs] https://docs.firehydrant.com/docs/intro-to-runbooksThe default Runbook will always have two default steps: * **Assign a Role**: Assigns whoever opened the incident to the Commander role.
  • [claimed-docs] https://docs.firehydrant.com/docs/intro-to-runbooksThe default Runbook will always have two default steps: Assign a Role... Add Task List
  • [claimed-docs] https://docs.firehydrant.com/docs/signals-alert-ruleswhen a Rule matches, the Event is turned into an Alert and routed to the relevant party via Escalation Policies and On-Call Schedules
  • [claimed-docs] https://docs.firehydrant.com/docs/signals-alert-rulesTeams configure Alert Triggers (see next section) to describe which events should alert and whom, and when a Rule matches, the Event is turned into an Alert
  • [claimed-docs] https://docs.firehydrant.com/docs/what-is-firehydrantAutomate manual tasks such as creating incident Slack channels, Jira tickets, meeting bridges, and more
  • [claimed-docs] https://docs.firehydrant.com/docs/what-is-firehydrantIntegrate with alerting and monitoring integrations to automatically create incidents from alerts

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-managementDive into incidents with AI-generated summaries that provide a clear, concise overview of the situation. Perfect for bringing new responders up to speed in no time.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-drafted-retrospectivesWhen you click "Draft with AI" next to any question in your retrospective template, FireHydrant will: Analyze the incident's t
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-managementFireHydrant's Copilot proactively compares ongoing incidents to your existing and previous incidents and makes suggestions in the Command Center and Slack.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-drafted-retrospectivesAI-Drafted Retrospectives generate a comprehensive draft that includes a structured overview of the incident, timelines, impacts, and preliminary Lessons Learned.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-summariesSummaries are created as soon as an incident is declared, providing key information right from the start.

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://github.com/firehydrant/firehydrant-mcpOfficial FireHydrant MCP server
  • [probe] https://github.com/firehydrant/firehydrant-mcpPROBE runtime (recorded 2026-09-06): FireHydrant's official MCP server (npm firehydrant-mcp 0.0.4, maintained by fh-eng) completed a FULL keyless stdio initialize handshake — `npx -y firehydrant-mcp start --transport stdio` answered with serverInfo {name: FireHydrant, version: 0.0.4} and advertised tools and prompts capabilities.
  • [claimed-docs] https://docs.firehydrant.com/docs/triggering-runbooksFrom Slack, inside an incident channel, you can browse the list of triggered Runbooks for this by executing `/fh`.
  • [claimed-docs] https://docs.firehydrant.com/docs/ai-powered-incident-managementFireHydrant's Copilot proactively compares ongoing incidents to your existing and previous incidents and makes suggestions in the Command Center and Slack.

Built-in AI = 39.4 ÷ 90 × 100 = 43.8

Automation30.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.firehydrant.com/reference/firehydrant-apiYou can use the FireHydrant API to configure integrations, define incidents, and set up webhooks--anything you can do on the FireHydrant UI.
  • [claimed-docs] https://docs.firehydrant.com/docs/api-keysFireHydrant allows you to access the API with an API key using token-based authentication.
  • [claimed-docs] https://github.com/firehydrant/firehydrant-mcpOfficial FireHydrant MCP server

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.firehydrant.com/docs/signals-alert-ruleswhen a Rule matches, the Event is turned into an Alert and routed to the relevant party via Escalation Policies and On-Call Schedules
  • [claimed-docs] https://docs.firehydrant.com/docs/signals-alert-rulesTeams configure Alert Triggers (see next section) to describe which events should alert and whom, and when a Rule matches, the Event is turned into an Alert
  • [claimed-docs] https://docs.firehydrant.com/docs/signals-creating-incidents-from-alertsyou can quickly run a backtest of events by running a CEL query in the page's filter builder
  • [claimed-docs] https://docs.firehydrant.com/docs/signals-creating-incidents-from-alertsOn the Alert Rules page, you can quickly run a backtest of events by running a CEL query in the page's filter builder.
  • [claimed-docs] https://docs.firehydrant.com/docs/intro-to-runbooksRunbooks are FireHydrant's automation engine. They define and automate a workflow of steps and actions according to specified conditions.
  • [claimed-docs] https://docs.firehydrant.com/docs/what-is-firehydrantIntegrate with alerting and monitoring integrations to automatically create incidents from alerts
  • [claimed-docs] https://docs.firehydrant.com/docs/signals-introductionSignals offers a complete alerting solution with on-call schedules, escalation policies, and multi-platform notifications to help your team better respond to incidents.

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

  • [claimed-docs] https://docs.firehydrant.com/docs/audit-logsFrom Runbook modifications to incident declarations, logins, and more, you can find a full history and detailed trail of events for security and audit purposes.
  • [claimed-docs] https://docs.firehydrant.com/docs/intro-to-runbooksRunbooks are FireHydrant's automation engine. They define and automate a workflow of steps and actions according to specified conditions.
  • [claimed-docs] https://docs.firehydrant.com/docs/audit-logsAudit logs give organizations transparency and visibility into the events happening on the FireHydrant platform.

Automation = 24.0 ÷ 80 × 100 = 30.0