Skip to content
ProductArena

How Cursor Bugbot’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score24/100

Agent-ready 25.8 × 0.30 = 7.74

API quality n/a — excluded, its ×0.20 weight renormalized away

Openness 0.0 × 0.20 = 0.00

Built-in AI 51.3 × 0.15 = 7.69

Automation 22.3 × 0.15 = 3.35

(7.74 + 0.00 + 7.69 + 3.35) ÷ (0.30 + 0.20 + 0.15 + 0.15) = 18.78 ÷ 0.80 = 23.5 — weights renormalized over the scored components

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready25.8/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://cursor.com/llms.txt“PROBE llms.txt: HTTP 200 at https://cursor.com/llms.txt # Cursor Documentation ## Get Started - https://cursor.com/docs.md - https://cursor.com/docs/get-started/quickstart.md”
  • [probe] https://cursor.com/docs/bugbot.md“PROBE docs-md: HTTP 200 at https://cursor.com/docs/bugbot.md # Bugbot Bugbot reviews pull requests and identifies bugs, security issues, and code quality problems. Configure Bugbo”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Runs automatic reviews on every PR update”
  • [claimed-docs] https://cursor.com/docs/bugbot“Manual trigger by commenting `cursor review` or `bugbot run` on any PR”
  • [claimed-docs] https://cursor.com/docs/bugbot“GitHub (including GitHub Enterprise Server): See the GitHub integration page”
  • [claimed-docs] https://cursor.com/docs/bugbot“GitLab (including GitLab Self-Hosted): See the GitLab integration page”
  • [claimed-docs] https://cursor.com/docs/integrations/azure-devops“Cloud Agents clone your code, work on branches, and open pull requests. Bugbot reviews pull requests and posts its findings as comments.”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“It analyzes every pull request for bugs, security vulnerabilities, and code quality issues, leaving inline comments with explanations and suggested fixes.”

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Drive the product through a documented public APIweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Manual trigger by commenting `cursor review` or `bugbot run` on any PR”
  • [claimed-docs] https://cursor.com/docs/bugbot“GitHub (including GitHub Enterprise Server): See the GitHub integration page”
  • [claimed-docs] https://cursor.com/docs/bugbot“GitLab (including GitLab Self-Hosted): See the GitLab integration page”
  • [claimed-docs] https://cursor.com/docs/integrations/bitbucket“Connect Bitbucket Cloud repositories to Cloud Agents and Bugbot. Connect Bitbucket Data Center repositories to Bugbot.”
  • [claimed-docs] https://cursor.com/docs/integrations/azure-devops“Cloud Agents clone your code, work on branches, and open pull requests. Bugbot reviews pull requests and posts its findings as comments.”

Issue scoped/least-privilege API credentials for an agentweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 23.2 ÷ 90 × 100 = 25.8

API qualityn/a×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Test against a sandbox environment without touching production dataweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

every cell n/a — unscored (not zero), excluded from the blend

Openness0.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://cursor.com/security“Security page, certifications: "Cursor holds AIUC-1, ISO/IEC 27001:2022, and ISO/IEC 42001:2023 certifications, along with a SOC 2 Type II attestation. Certificates and reports are available on request at trust.cursor.com." Accounts can be deleted at any time from the Settings dashboard.”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Openness = 0.0 ÷ 70 × 100 = 0.0

Built-in AI51.3/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“It analyzes every pull request for bugs, security vulnerabilities, and code quality issues, leaving inline comments with explanations and suggested fixes.”
  • [claimed-docs] https://cursor.com/docs/bugbot“Bugbot analyzes PR diffs and leaves comments with explanations and fix suggestions.”
  • [claimed-docs] https://cursor.com/docs/bugbot“Runs automatic reviews on every PR update”
  • [community] https://hn.algolia.com/api/v1/items/46643737“Do you have actual experience with bugbot? Its live in our org and is actually pretty good, almost none of its comments are frivolous or wrong, and it finds genuine bugs most reviewers miss... Bugbot is now a valuable part of our SD process.”
  • [community] https://hn.algolia.com/api/v1/items/46643737“I've found Bugbot to be shockingly effective at finding bugs in my PRs. Even when it's wrong, it's usually worth adding a comment, since it's the kind of mistake a human reviewer would make.”
  • [community] https://hn.algolia.com/api/v1/items/46643737“I assume that this is the same as when Cursor spontaneously decides to show code review comments in the IDE as part of some upsell? In that case yes I'm familiar and they were all subtly wrong.”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Runs automatic reviews on every PR update”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“It analyzes every pull request for bugs, security vulnerabilities, and code quality issues, leaving inline comments with explanations and suggested fixes.”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Create `.cursor/BUGBOT.md` files in your repository to give Bugbot project-specific review guidelines.”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Team admins can also create organization-wide rules in [Bugbot Automations](https://cursor.com/automations/from-cursor/bugbot).”
  • [claimed-docs] https://cursor.com/blog/may-2026-bugbot-changes“With usage billing, you can now choose the effort level Bugbot uses when reviewing PRs. Users can configure Bugbot to think for longer and run deeper reviews”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Manual trigger by commenting `cursor review` or `bugbot run` on any PR”
  • [claimed-docs] https://cursor.com/docs/bugbot“Fix in Cursor links open issues directly in Cursor”
  • [claimed-docs] https://cursor.com/docs/bugbot“Fix in Web links open issues directly in cursor.com/agents”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“It analyzes every pull request for bugs, security vulnerabilities, and code quality issues, leaving inline comments with explanations and suggested fixes.”
  • [claimed-docs] https://cursor.com/docs/integrations/azure-devops“Cloud Agents clone your code, work on branches, and open pull requests. Bugbot reviews pull requests and posts its findings as comments.”

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Manual trigger by commenting `cursor review` or `bugbot run` on any PR”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Comment `bugbot run verbose=true` or `cursor review verbose=true` on the pull request. Bugbot replies with a table of the rules included in that review”
  • [claimed-docs] https://cursor.com/help/account-and-billing/bugbot-usage-based-billing“Describe in natural language when Bugbot should use low, default, or high effort. Cursor will dynamically set effort levels based on your instructions.”
  • [claimed-docs] https://cursor.com/help/account-and-billing/bugbot-usage-based-billing“Smart: Describe in natural language when Bugbot should use low, default, or high effort. Cursor will dynamically set effort levels based on your instructions.”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Comment `cursor review verbose=true` or `bugbot run verbose=true` on the PR for detailed logs, which Bugbot rules loaded, and a request ID”

Built-in AI = 46.2 ÷ 90 × 100 = 51.3

Automation22.3/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Runs automatic reviews on every PR update”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Team admins can also create organization-wide rules in [Bugbot Automations](https://cursor.com/automations/from-cursor/bugbot).”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Bugbot Teams includes code reviews on all PRs, analytics and reporting, effort level controls, and advanced rules and settings.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Runs automatic reviews on every PR update”
  • [claimed-docs] https://cursor.com/docs/bugbot“Manual trigger by commenting `cursor review` or `bugbot run` on any PR”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Create `.cursor/BUGBOT.md` files in your repository to give Bugbot project-specific review guidelines.”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Team admins can also create organization-wide rules in [Bugbot Automations](https://cursor.com/automations/from-cursor/bugbot).”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Bugbot Teams includes code reviews on all PRs, analytics and reporting, effort level controls, and advanced rules and settings.”
  • [claimed-docs] https://cursor.com/help/account-and-billing/bugbot-usage-based-billing“Describe in natural language when Bugbot should use low, default, or high effort. Cursor will dynamically set effort levels based on your instructions.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://cursor.com/docs/bugbot“Runs automatic reviews on every PR update”
  • [claimed-docs] https://cursor.com/docs/bugbot“Manual trigger by commenting `cursor review` or `bugbot run` on any PR”
  • [claimed-docs] https://cursor.com/help/ai-features/bugbot“Team admins can also create organization-wide rules in [Bugbot Automations](https://cursor.com/automations/from-cursor/bugbot).”

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 15.6 ÷ 70 × 100 = 22.3