Skip to content
ProductArena

How GlitchTip’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score21/100

Agent-ready 35.9 × 0.30 = 10.77

API quality 0.0 × 0.20 = 0.00

Openness 34.2 × 0.20 = 6.84

Built-in AI 14.7 × 0.15 = 2.20

Automation 10.3 × 0.15 = 1.55

(10.77 + 0.00 + 6.84 + 2.20 + 1.55) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 21.36 ÷ 1.00 = 21.4

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready35.9/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://glitchtip.com/llms.txt“PROBE llms.txt: HTTP 404 at https://glitchtip.com/llms.txt”
  • [probe] https://glitchtip.com/documentation.md“PROBE docs-md: HTTP 404 at https://glitchtip.com/documentation.md”
  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://glitchtip.com/documentation/cli“glitchtip-cli releases new 1.0.0 --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Record deployments for a release: glitchtip-cli deploys new 1.0.0 --env production --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Upload debug symbols for native applications (dSYM, PDB, ELF): glitchtip-cli debug-files upload ./build --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Log in to your GlitchTip instance: glitchtip-cli --url https://your-glitchtip.example.com login”
  • [probe] https://glitchtip.com/documentation/cli“official CLI documented at https://glitchtip.com/documentation/cli”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://glitchtip.com/blog/“GlitchTip has a built-in MCP server so you can pull your own error data into your preferred AI tools with no data sharing required.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [probe] https://glitchtip.com/documentation/mcp“official MCP server documented at https://glitchtip.com/documentation/mcp”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://glitchtip.com/blog/“GlitchTip has a built-in MCP server so you can pull your own error data into your preferred AI tools with no data sharing required.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“Investigate errors — Browse issues, inspect stack traces and event data, and resolve issues”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“detect_n_plus_one — Detect N+1 query patterns across transactions (requires DuckDB)”
  • [probe] https://glitchtip.com/documentation/mcp“official MCP server documented at https://glitchtip.com/documentation/mcp”

Use an official CLIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://glitchtip.com/documentation/cli“glitchtip-cli releases new 1.0.0 --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Record deployments for a release: glitchtip-cli deploys new 1.0.0 --env production --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Upload debug symbols for native applications (dSYM, PDB, ELF): glitchtip-cli debug-files upload ./build --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Log in to your GlitchTip instance: glitchtip-cli --url https://your-glitchtip.example.com login”
  • [probe] https://glitchtip.com/documentation/cli“official CLI documented at https://glitchtip.com/documentation/cli”
  • [claimed-docs] https://glitchtip.com/documentation/error-tracking“For JavaScript projects, upload source maps to get readable stack traces. Use the GlitchTip CLI (Beta) to inject debug IDs and upload source maps”

Drive the product through a documented public APIweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://glitchtip.com/documentation/integrations“GlitchTip aims to be Sentry API compatible. Anything that works with Sentry should also work with GlitchTip.”
  • [claimed-docs] https://glitchtip.com/documentation/cli“glitchtip-cli releases new 1.0.0 --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/blog/“GlitchTip has a built-in MCP server so you can pull your own error data into your preferred AI tools with no data sharing required.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“detect_n_plus_one — Detect N+1 query patterns across transactions (requires DuckDB)”
  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”
  • [probe] https://glitchtip.com/documentation/mcp“official MCP server documented at https://glitchtip.com/documentation/mcp”
  • [probe] https://glitchtip.com/documentation/cli“official CLI documented at https://glitchtip.com/documentation/cli”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/cli“Log in to your GlitchTip instance: glitchtip-cli --url https://your-glitchtip.example.com login”
  • [probe] https://glitchtip.com/documentation/mcp“official MCP server documented at https://glitchtip.com/documentation/mcp”
  • [probe] https://glitchtip.com/documentation/cli“official CLI documented at https://glitchtip.com/documentation/cli”

Build against official SDKsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://glitchtip.com“GlitchTip can use Sentry's open source SDKs to receive error data from your application.”
  • [claimed-docs] https://glitchtip.com/documentation/integrations“GlitchTip aims to be Sentry API compatible. Anything that works with Sentry should also work with GlitchTip.”
  • [community] https://news.ycombinator.com/item?id=36008564“I use GlitchTip — it works well! A bit hard to deploy (many moving parts) but that's more a problem with F/OSS Sentry. It's been nice being able to use the sentry reporting ecosystem with it (including newer reporters for stuff like Svelte)”
  • [community] https://news.ycombinator.com/item?id=36008564“Hey Glitchtip! Been a happy user for going on a year or so. Super easy to self-host, and because it uses the existing sentry libs it's really reliable. One of the most set and forget services I've had the pleasure of using. I would take Sentry+Glitchtip over Rollbar for Sentry libs alone.”

Subscribe to events via webhooksweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://glitchtip.com/documentation/error-tracking“By default, new project alerts send emails to a project's team members, but you can also add a webhook URL by clicking “Add An Alert Recipient.””
  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. ... If GlitchTip doesn't receive your ping, it will send you an alert via email or webhook.”
  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. Or reverse it and send GlitchTip a request on schedule.”

Agent-ready = 75.4 ÷ 210 × 100 = 35.9

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”
  • [probe] https://glitchtip.com/llms.txt“PROBE llms.txt: HTTP 404 at https://glitchtip.com/llms.txt”
  • [probe] https://glitchtip.com/documentation.md“PROBE docs-md: HTTP 404 at https://glitchtip.com/documentation.md”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”
  • [claimed-docs] https://glitchtip.com/documentation/integrations“GlitchTip aims to be Sentry API compatible. Anything that works with Sentry should also work with GlitchTip.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”
  • [probe] https://glitchtip.com/llms.txt“PROBE llms.txt: HTTP 404 at https://glitchtip.com/llms.txt”
  • [probe] https://glitchtip.com/documentation.md“PROBE docs-md: HTTP 404 at https://glitchtip.com/documentation.md”

API quality = 0.0 ÷ 70 × 100 = 0.0

Openness34.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://glitchtip.com/documentation/integrations“GlitchTip aims to be Sentry API compatible. Anything that works with Sentry should also work with GlitchTip.”
  • [claimed-docs] https://glitchtip.com/documentation/cli“glitchtip-cli releases new 1.0.0 --org my-org --project my-project”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

  • [claimed-docs] https://glitchtip.com/documentation/integrations“GlitchTip aims to be Sentry API compatible. Anything that works with Sentry should also work with GlitchTip.”
  • [community] https://hn.algolia.com/api/v1/items/36008564“GlitchTip only requires 4 components (backend, workers, Redis, and postgresql). Self Hosted Sentry requires many more (at least a dozen, including clickhouse, zookeeper, Kafka, Redis, multiple backends). Self Hosted Sentry seems stable once deployed but it is a lot to deal with.”
  • [probe] https://glitchtip.com/openapi.json“PROBE openapi: all candidate paths 404 (https://glitchtip.com/openapi.json, https://glitchtip.com/swagger.json, https://glitchtip.com/api/openapi.json, https://glitchtip.com/.well-known/openapi.json)”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://glitchtip.com“GlitchTip can use Sentry's open source SDKs to receive error data from your application.”
  • [claimed-docs] https://glitchtip.com/documentation/install“GlitchTip can be run with Docker. We recommend Docker Compose, PikaPods, Elestio, Nodion, Railway, or RepoCloud.”

Self-host the core productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://glitchtip.com/documentation/install“GlitchTip can be run with Docker. We recommend Docker Compose, PikaPods, Elestio, Nodion, Railway, or RepoCloud.”
  • [community] https://news.ycombinator.com/item?id=36008564“I use GlitchTip — it works well! A bit hard to deploy (many moving parts) but that's more a problem with F/OSS Sentry. It's been nice being able to use the sentry reporting ecosystem with it (including newer reporters for stuff like Svelte)”
  • [community] https://hn.algolia.com/api/v1/items/36008564“GlitchTip only requires 4 components (backend, workers, Redis, and postgresql). Self Hosted Sentry requires many more (at least a dozen, including clickhouse, zookeeper, Kafka, Redis, multiple backends). Self Hosted Sentry seems stable once deployed but it is a lot to deal with.”
  • [community] https://hn.algolia.com/api/v1/items/36008564“Stability on GlitchTip has been great for me -- haven't had to worry about it or babysit it too much. Very small scale but still quite promising.”

Openness = 34.2 ÷ 100 × 100 = 34.2

Built-in AI14.7/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://glitchtip.com/blog/“GlitchTip has a built-in MCP server so you can pull your own error data into your preferred AI tools with no data sharing required.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“detect_n_plus_one — Detect N+1 query patterns across transactions (requires DuckDB)”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“Investigate errors — Browse issues, inspect stack traces and event data, and resolve issues”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. ... If GlitchTip doesn't receive your ping, it will send you an alert via email or webhook.”
  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. Or reverse it and send GlitchTip a request on schedule.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“Investigate errors — Browse issues, inspect stack traces and event data, and resolve issues”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://glitchtip.com/blog/“GlitchTip has a built-in MCP server so you can pull your own error data into your preferred AI tools with no data sharing required.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“Investigate errors — Browse issues, inspect stack traces and event data, and resolve issues”

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://glitchtip.com/blog/“GlitchTip has a built-in MCP server so you can pull your own error data into your preferred AI tools with no data sharing required.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“Investigate errors — Browse issues, inspect stack traces and event data, and resolve issues”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“GlitchTip includes a built-in MCP server that allows AI assistants to interact with your error tracking, performance, and log data.”
  • [claimed-docs] https://glitchtip.com/documentation/mcp“detect_n_plus_one — Detect N+1 query patterns across transactions (requires DuckDB)”
  • [probe] https://glitchtip.com/documentation/mcp“official MCP server documented at https://glitchtip.com/documentation/mcp”

Built-in AI = 13.2 ÷ 90 × 100 = 14.7

Automation10.3/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

  • [claimed-docs] https://glitchtip.com/documentation/error-tracking“By default, new project alerts send emails to a project's team members, but you can also add a webhook URL by clicking “Add An Alert Recipient.””
  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. ... If GlitchTip doesn't receive your ping, it will send you an alert via email or webhook.”
  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. Or reverse it and send GlitchTip a request on schedule.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. ... If GlitchTip doesn't receive your ping, it will send you an alert via email or webhook.”
  • [claimed-docs] https://glitchtip.com“GlitchTip can ping your site and warn you when it's not responding. Or reverse it and send GlitchTip a request on schedule.”

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 7.2 ÷ 70 × 100 = 10.3