Skip to content
ProductArena

How New Relic’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score29/100

Agent-ready 36.4 × 0.30 = 10.92

API quality 8.6 × 0.20 = 1.72

Openness 11.4 × 0.20 = 2.28

Built-in AI 62.0 × 0.15 = 9.30

Automation 33.8 × 0.15 = 5.07

(10.92 + 1.72 + 2.28 + 9.30 + 5.07) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 29.29 ÷ 1.00 = 29.3

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready36.4/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.newrelic.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.newrelic.com/llms.txt”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [github] https://github.com/newrelic/newrelic-cli“Deployment Markers: Easily record an APM Application deployment within New Relic.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [probe] https://github.com/newrelic/newrelic-cli“official CLI documented at https://github.com/newrelic/newrelic-cli”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“Ask questions in plain English, and the MCP server converts them to NRQL to get results—even if you're not a NRQL expert.”
  • [probe] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“official MCP server documented at https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/”
  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“It allows you to ask questions, troubleshoot issues, and explore telemetry data using plain language.”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“Ask questions in plain English, and the MCP server converts them to NRQL to get results—even if you're not a NRQL expert.”
  • [probe] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“official MCP server documented at https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/”

Use an official CLIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [github] https://github.com/newrelic/newrelic-cli“Deployment Markers: Easily record an APM Application deployment within New Relic.”
  • [probe] https://github.com/newrelic/newrelic-cli“official CLI documented at https://github.com/newrelic/newrelic-cli”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [github] https://github.com/newrelic/newrelic-cli“Deployment Markers: Easily record an APM Application deployment within New Relic.”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”
  • [probe] https://github.com/newrelic/newrelic-cli“official CLI documented at https://github.com/newrelic/newrelic-cli”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“Ask questions in plain English, and the MCP server converts them to NRQL to get results—even if you're not a NRQL expert.”

Build against official SDKsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com“Monitor application performance across your stack. We've got agents for Go, Java, .NET, Node.js, PHP, Python, and Ruby.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com“Instrument your service with OpenTelemetry and gain platform-agnostic observability.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [probe] https://github.com/newrelic/newrelic-cli“official CLI documented at https://github.com/newrelic/newrelic-cli”
  • [probe] https://docs.newrelic.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.newrelic.com/llms.txt”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/alerts/overview/“You define the data to watch, the thresholds that if exceeded mean an issue, who is notified, and how.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”

Agent-ready = 76.4 ÷ 210 × 100 = 36.4

API quality8.6/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”

API quality = 6.0 ÷ 70 × 100 = 8.6

Openness11.4/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [github] https://github.com/newrelic/newrelic-cli“Deployment Markers: Easily record an APM Application deployment within New Relic.”
  • [probe] https://docs.newrelic.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.newrelic.com/openapi.json, https://docs.newrelic.com/swagger.json, https://docs.newrelic.com/api/openapi.json, https://docs.newrelic.com/.well-known/openapi.json)”
  • [probe] https://github.com/newrelic/newrelic-cli“official CLI documented at https://github.com/newrelic/newrelic-cli”

Export all of my data in open formats and leaveweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com“Instrument your service with OpenTelemetry and gain platform-agnostic observability.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [community] https://news.ycombinator.com/item?id=24040325“They don’t care that much about open source agent, but they do care about where the server is... there is still a huge underserved market for on-premise APMs, and those you can buy aren’t nearly as good as New Relic.”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [github] https://github.com/newrelic/newrelic-cli“Deployment Markers: Easily record an APM Application deployment within New Relic.”
  • [community] https://news.ycombinator.com/item?id=24040325“They don’t care that much about open source agent, but they do care about where the server is... there is still a huge underserved market for on-premise APMs, and those you can buy aren’t nearly as good as New Relic.”

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [community] https://news.ycombinator.com/item?id=24040325“They don’t care that much about open source agent, but they do care about where the server is... there is still a huge underserved market for on-premise APMs, and those you can buy aren’t nearly as good as New Relic.”
  • [claimed-docs] https://newrelic.com/pricing“100 GB of free data ingest/month”
  • [claimed-docs] https://newrelic.com/pricing“Sign up for free access with our perpetual free tier and 100 GB/month of data ingest included.”

Openness = 11.4 ÷ 100 × 100 = 11.4

Built-in AI62.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“It allows you to ask questions, troubleshoot issues, and explore telemetry data using plain language.”
  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“If you're struggling to get a query to work, ask our AI assistant to help you.”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“Ask questions in plain English, and the MCP server converts them to NRQL to get results—even if you're not a NRQL expert.”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/alerts/overview/“You define the data to watch, the thresholds that if exceeded mean an issue, who is notified, and how.”
  • [claimed-docs] https://docs.newrelic.com/docs/nrql/get-started/introduction-nrql-new-relics-query-language/“NRQL can help you: Create a new chart ... Set up NRQL-based alerts (our primary and most powerful type of alert)”
  • [claimed-docs] https://docs.newrelic.com/docs/nrql/get-started/introduction-nrql-new-relics-query-language/“Set up NRQL-based alerts (our primary and most powerful type of alert)”
  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“It allows you to ask questions, troubleshoot issues, and explore telemetry data using plain language.”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“Ask questions in plain English, and the MCP server converts them to NRQL to get results—even if you're not a NRQL expert.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“It allows you to ask questions, troubleshoot issues, and explore telemetry data using plain language.”
  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“If you're struggling to get a query to work, ask our AI assistant to help you.”

Operate the product with natural-language commandsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“It allows you to ask questions, troubleshoot issues, and explore telemetry data using plain language.”
  • [claimed-docs] https://docs.newrelic.com/docs/agentic-ai/new-relic-ai/“If you're struggling to get a query to work, ask our AI assistant to help you.”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“Ask questions in plain English, and the MCP server converts them to NRQL to get results—even if you're not a NRQL expert.”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [probe] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“official MCP server documented at https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/”

Built-in AI = 55.8 ÷ 90 × 100 = 62.0

Automation33.8/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“An easy way to experiment with the NerdGraph API is to use the NerdGraph API explorer.”
  • [github] https://github.com/newrelic/newrelic-cli“Entity Search: Search for entities across all your New Relic accounts”
  • [claimed-docs] https://docs.newrelic.com/docs/nrql/get-started/introduction-nrql-new-relics-query-language/“NRQL can help you: Create a new chart, Answer a specific question for the purpose of troubleshooting or business analysis, Set up NRQL-based alerts”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://docs.newrelic.com/docs/alerts/overview/“You define the data to watch, the thresholds that if exceeded mean an issue, who is notified, and how.”
  • [claimed-docs] https://docs.newrelic.com/docs/nrql/get-started/introduction-nrql-new-relics-query-language/“NRQL can help you: Create a new chart, Answer a specific question for the purpose of troubleshooting or business analysis, Set up NRQL-based alerts”
  • [claimed-docs] https://docs.newrelic.com/docs/nrql/get-started/introduction-nrql-new-relics-query-language/“NRQL can help you: Create a new chart ... Set up NRQL-based alerts (our primary and most powerful type of alert)”
  • [claimed-docs] https://docs.newrelic.com/docs/nrql/get-started/introduction-nrql-new-relics-query-language/“Set up NRQL-based alerts (our primary and most powerful type of alert)”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.newrelic.com“Simulate end-user activity and API calls from locations around the world, so you can find problems before your users do.”
  • [claimed-docs] https://docs.newrelic.com/whats-new/2025/11/whats-new-11-05-mcp-server/“This update provides a standardized, scalable way to connect your favorite AI development tools directly to the rich context of the New Relic platform”
  • [claimed-docs] https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/“NerdGraph is our GraphQL-format API that lets you query New Relic data and configure some New Relic features.”

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 27.0 ÷ 80 × 100 = 33.8