Gemini CLI vs cubic

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to cubic
   Gemini CLI—none0/10

   No evidence Gemini CLI has any documented feature for consuming llms.txt or agent-oriented doc manifests; the only related probe shows llms.txt returning 404 on Google's own docs site, and none of the GitHub feature list or docs mention llms.txt support. GEMINI.md context files are a different, project-local mechanism, not agent-oriented web docs discovery.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”

   proof ↗⚑ flag

   cubic✓fullprobed9/10

   cubic hosts a dedicated llms.txt file at docs.cubic.dev/llms.txt (confirmed via live probe returning HTTP 200 with a documentation summary), directly enabling agents to be pointed at agent-oriented docs; this is reinforced by MCP server and CLI docs designed for agent consumption. Missing for 10: no independent/community confirmation of an agent successfully using llms.txt in practice.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.cubic.dev/llms.txt # cubic documentation > cubic reviews code on GitHub and in local coding workfl…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to Gemini CLI
   Gemini CLI✓fullclaimed9/10

   Gemini CLI explicitly documents non-interactive scripting mode, structured/streaming JSON output flags for programmatic parsing, and GitHub Actions-based automation (PR reviews, issue triage, on-demand assistance), which together cover headless/CI use cases well. Missing for 10: independent hands-on confirmation specifically of CI pipeline reliability (community evidence focuses more on interactive agentic quality than CI usage).

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

   cubic~partialprobed6/10

   cubic automatically reviews PRs once installed (headless, event-triggered automation on GitHub) and ships a standalone CLI (`cubic review`) that can run local/pre-push checks, which could be scripted into CI. However, there's no explicit documentation of a CI/CD pipeline integration (e.g., GitHub Actions workflow, exit codes, non-interactive flags) confirming true headless CI usage beyond the GitHub-app webhook flow. missing for 10: explicit CI pipeline integration docs/examples, confirmation of non-interactive/exit-code behavior for CLI in automated pipelines.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

3. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round to Gemini CLI
   Gemini CLI✓fullclaimed8/10

   Gemini CLI documents first-party MCP server support: configuring servers in ~/.gemini/settings.json to add custom tools, a dedicated /mcp command, and explicit mention of connecting media-generation tools like Imagen/Veo/Lyria via MCP. This is corroborated by official docs listing /mcp among CLI commands. Missing for 10: independent hands-on verification of MCP tool usage specifically (community evidence covers general agentic reliability but not MCP integration itself), and more detail on server management/discovery UX.

   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”

   proof ↗⚑ flag

   cubic—none0/10

   All MCP-related evidence describes cubic acting as an MCP *server* that other coding agents/clients connect to (cubic-docs-15, cubic-docs-3, cubic-probe-3) — the reverse of this story, which asks whether a user can plug external MCP servers into cubic so it can consume their tools. No evidence shows cubic itself connecting to or invoking external MCP servers/tools.

   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “You can now ask your coding agent to check your cubic subscription, manage team seats and roles, and purchase more seats without leaving you…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”

   proof ↗⚑ flag

4. ai-native userUse an official CLI

   weight 2 · round to Gemini CLI
   Gemini CLI✓fullprobed9/10

   Gemini CLI is itself an official, first-party CLI product by Google with extensive documentation of its features (scripting, JSON output, MCP support, context files, non-interactive mode) and independent corroboration of active use, confirming it exists and functions as an official CLI tool for AI-native workflows. missing for 10: no fully independent third-party audit of CLI completeness beyond community anecdotes.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “gemini --include-directories ../lib,../docs”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [probe] “official CLI documented at https://developers.google.com/gemini-code-assist/docs/gemini-cli”

   proof ↗⚑ flag

   cubic✓fullprobed8/10

   cubic ships an official CLI (`cubic review`) that reviews local/uncommitted changes and generates fix prompts for coding agents, documented explicitly and confirmed by a docs probe; it also integrates with agent workflows via MCP. Missing for 10: independent hands-on verification of the CLI itself (community evidence covers other product aspects, not CLI usage) and broader CLI command documentation beyond the single review command.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

5. ai-native userDrive the product through a documented public API

   weight 3 · round to cubic
   Gemini CLI~partialprobed5/10

   Gemini CLI documents CLI-level automation hooks — non-interactive scripting mode, `--output-format json`/`stream-json` for structured output, and MCP server configuration — which let an AI-native user drive it programmatically (gemini-cli-gh-6, gh-17, gh-18, gh-19). However, explicit probes for a formal public API/SDK (llms.txt, openapi.json) all returned 404, showing no dedicated documented API surface beyond the CLI itself. Missing for 10: a first-party REST/SDK API spec, official API reference docs, and independent confirmation of programmatic (non-CLI) usage.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

   cubic~partialprobed6/10

   cubic documents an MCP server (cubic-docs-15, cubic-probe-3) that lets an AI agent request PR reviews, read findings, and triage issues, plus an Analytics API (cubic-docs-20) for PR-level data and a CLI (cubic-probe-4) for local reviews — all documented, agent-drivable surfaces. However, probes for a formal public API spec (openapi/swagger) all returned 404 (cubic-probe-2), so there's no evidence of a comprehensive documented public REST/GraphQL API beyond these narrower interfaces. Missing for 10: a full public API reference/spec, broader programmatic control beyond analytics/MCP/CLI, and independent confirmation of API usage.

   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

6. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round drawn
   Gemini CLI—none0/10

   Evidence shows Gemini CLI abstracts away API key management entirely (sign in with Google account) rather than offering scoped or least-privilege credential issuance for agents; no docs mention credential scoping, permission boundaries, or token minting for agent use.

   • [github] “No API key management - just sign in with your Google account”

   proof ↗⚑ flag

   cubic—none0/10

   Cubic documents role-based access control for team subscription/settings (cubic-docs-47) and exposes an MCP server, Analytics API, and CLI that agents can connect to, but there is no evidence of issuing scoped or least-privilege API credentials/tokens specifically for an agent's use — no API key scoping, OAuth scope, or agent-specific credential mechanism is documented.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”

   proof ↗⚑ flag

7. ai-native userBuild against official SDKs

   weight 2 · round drawn
   Gemini CLI—none0/10

   The evidence pack documents CLI flags, MCP server extensibility, scripting output formats, and GitHub Actions integration, but contains no mention of an official SDK (e.g., a Node/Python/Go library) for programmatically building on Gemini CLI itself. Probes for API/OpenAPI specs also returned 404s, reinforcing the absence of such artifacts.

   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

   cubic—none0/10

   cubic documents an MCP server, CLI, and an Analytics API, but there is no evidence of official language SDKs (e.g., Python/JS client libraries) for building against cubic programmatically; the OpenAPI probe also returned 404s across candidate paths, suggesting no formal SDK/API spec is published.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

8. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   Gemini CLI—none0/10

   No evidence of webhook subscription or event-push capability; Gemini CLI supports non-interactive scripting, MCP tool servers, and structured JSON output, but nothing about outbound webhooks or event subscriptions. Missing for 10: any webhook registration mechanism, event subscription API, or documentation of push notifications.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”

   proof ↗⚑ flag

   cubic—none0/10

   No evidence of any webhook subscription mechanism; cubic exposes an MCP server, CLI, and Analytics API but nothing describing event-driven webhooks for subscribing to updates. missing for 10: any documentation of webhook endpoints, event types, or subscription setup.

   ⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Gemini CLI ships features that clearly aim at generating insights from a user's own data/codebase — querying and editing large codebases, natural-language debugging, automated PR review with contextual feedback, and issue triage (gemini-cli-gh-1, gh-3, gh-10, gh-11), and one community report praises its code review as catching bugs missed by humans (gemini-cli-comm-20). However, multiple hands-on reports directly contradict this, describing it as 'terrible at agentic stuff', getting stuck in loops, failing to edit/read files, and being 'useless as a coding assistant' that produces spaghetti code (gemini-cli-comm-10, comm-14, comm-15). missing for 10: independent benchmark confirming consistent quality of generated insights, resolution of the loop/failure reports, and evidence the insight-generation works reliably across data types beyond code.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”

   proof ↗⚑ flag

   cubic~partialcommunity6/10

   Cubic generates AI-driven insights from a user's own code/PR data via automated reviews, Ultrareview, AI-powered codebase scans, an AI wiki that indexes the codebase, and an analytics dashboard summarizing AI coding/review impact (cubic-docs-4,13,18,20,21,22). However, community hands-on feedback is mixed, with several users noting a large share of AI-generated comments are irrelevant or low-value (cubic-comm-3,9), tempering claims of consistently useful insights. Missing for 10: independent benchmarking of insight accuracy, and confirmation that analytics/wiki insights are broadly praised rather than just described in docs.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “The analytics dashboard shows how your team ships code across three lenses: AI coding usage, AI review impact, and delivery speed.”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [community] “I've tried something similar in the past. The concept is cool, but so far the solutions I've seen are not so useful in terms of comments qua…”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to cubic
   Gemini CLI~partialcommunity6/10

   Gemini CLI documents non-interactive scripting mode and a GitHub Action integration that runs autonomously in the background (automated PR reviews, issue triage, on-demand @gemini-cli responses), which directly supports background automations. However, independent community reports describe agentic reliability problems (getting stuck in loops, failing simple file operations, ignoring GEMINI.md context) that undercut confidence in unattended/background runs actually completing correctly. Missing for 10: independent hands-on validation that scheduled/background automations run reliably end-to-end, and more detail on failure/retry handling in autonomous mode.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “@github List my open pull requests”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic✓fullclaimed8/10

   cubic ships several autonomous background automations: it auto-starts PR reviews on install (cubic-docs-4, cubic-docs-41), can auto-approve clean PRs under policy (cubic-docs-12, cubic-docs-35), runs codebase scans deploying many AI agents (cubic-docs-21), keeps an AI wiki current via rolling PRs (cubic-docs-23), does cross-repo checks (cubic-docs-37), and auto-purchases flex capacity to keep reviews running (cubic-docs-24) — all without manual triggering. Missing for 10: evidence of user-defined scheduled/cron-style custom automations beyond PR-triggered events, and independent hands-on confirmation that these autonomous flows run reliably unattended.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [claimed-docs] “cubic can approve clean pull requests automatically when your repository policy allows it. Start in shadow mode to see which PRs cubic would…”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Gemini CLI is itself billed as an agentic assistant with extensive task-delegation features (codebase queries, debugging, PR review/issue triage, operational automation via @gemini-cli mentions) per gemini-cli-gh-3/4/10/11/12/22. However, hands-on community reports concretely contradict reliable delegation: users report it is 'really really terrible at agentic stuff,' gets stuck in permanent loops, ignores GEMINI.md context, and in one case catastrophically deleted user files while apologizing for the failure.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic✓fullclaimed7/10

   Cubic ships a built-in AI chat/assistant experience where users can delegate tasks — asking chat to 'tour this PR', adding code to AI chat for contextual Q&A, requesting one-click fixes ('Fix with cubic') that get generated and pushed automatically, and interacting via PR comments to trigger reviews or fixes. This is a genuine in-product assistant, not just an external agent integration. Missing for 10: independent/hands-on validation specifically of the chat-delegation UX (community evidence only covers review-comment quality, not the assistant/chat delegation flow), and no detail on task-completion reliability or scope limits of delegated tasks.

   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “The chat sidebar helps you quickly understand and navigate your pull requests (PRs) with intelligent, context-aware assistance directly with…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Gemini CLI's entire premise is natural-language driven coding/agentic actions (querying codebases, debugging, automating PR/rebase tasks, custom GEMINI.md context) per gemini-cli-gh-1/3/4/9. However, multiple hands-on reports describe the NL-agent behavior failing badly in practice — getting stuck in error loops, botching file edits, ignoring GEMINI.md instructions, and in one case catastrophically deleting user data via misinterpreted commands.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic✓fullclaimed7/10

   cubic supports natural-language interaction via PR comments and chat: users can type commands like '@cubic-dev-ai review this PR', ask chat to 'tour this PR', reply to comments for clarification, request fixes, and connect an MCP server so a coding agent can trigger reviews and manage settings conversationally. Missing for 10: independent/hands-on evidence validating the quality and reliability of these NL interactions, and no evidence of broader free-form command coverage beyond the documented set of trigger phrases.

   • [claimed-docs] “To review a PR that was opened _before_ you installed the app, comment: `@cubic-dev-ai review this PR`.”
   • [claimed-docs] “Reply to a review comment to ask for clarification”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “Post this comment on GitHub to start a review: text theme={null} @cubic-dev-ai review this PR ”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “The chat sidebar helps you quickly understand and navigate your pull requests (PRs) with intelligent, context-aware assistance directly with…”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “You can now ask your coding agent to check your cubic subscription, manage team seats and roles, and purchase more seats without leaving you…”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   Gemini CLI—none0/10

   No evidence of an interactive API reference with runnable examples; probes explicitly show no llms.txt or OpenAPI spec found, and no docs describe an interactive reference tool.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

   cubic—none0/10

   cubic documents an Analytics API but the evidence pack shows explicit probe failures for OpenAPI/swagger specs (404s) and no mention of an interactive API reference or runnable examples anywhere in the docs.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Gemini CLI—none0/10

   Probes explicitly show no OpenAPI/llms.txt spec is published (404s at all candidate paths), and no other evidence mentions a machine-readable API spec for Gemini CLI.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

   cubic—none0/10

   The probe explicitly checked common OpenAPI spec locations and all returned 404, and there is no other evidence of a downloadable machine-readable API spec for cubic's Analytics API or other endpoints; only an llms.txt is present, which is not an OpenAPI/API spec equivalent.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.cubic.dev/llms.txt # cubic documentation > cubic reviews code on GitHub and in local coding workfl…”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”

   proof ↗⚑ flag

3. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Gemini CLI—none0/10

   No evidence of versioned APIs or a documented deprecation policy for Gemini CLI; probes for llms.txt/openapi specs 404, and there is community evidence the tool itself was abruptly deprecated with no policy discussion (gemini-cli-comm-6/7/8), but no documentation of API versioning or deprecation commitments exists.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”
   • [community] “Welcome to the Google graveyard, Gemini CLI. Not that it will be missed much. Using it was the worst experience out of any harness.”
   • [community] “Google really can't help themselves but to have some internal re-org kill off a public thing people are actively using. It's honestly impres…”

   proof ↗⚑ flag

   cubic—none0/10

   There is an Analytics API mentioned (cubic-docs-20) but no evidence of API versioning scheme or a documented deprecation policy anywhere in the docs; the OpenAPI probe even returned 404s for spec endpoints. missing for 10: versioning scheme documentation, deprecation policy, changelog/migration guides for API changes, any mention of API stability guarantees.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round drawn
   Gemini CLI~partialcommunity6/10

   Gemini CLI supports scripting/non-interactive automation, multi-directory context inclusion, structured JSON output for pipelines, and GitHub Action integrations like automated issue triage (bulk labeling/prioritization) and PR review across a repo — all pointing to bulk/batch style operations. However there's no explicit documented 'batch process N files/items' feature or example, and community reports note the agent can get stuck in loops or fail simple multi-step tasks, raising doubts about reliability at scale. Missing for 10: explicit bulk-operation examples/documentation (e.g., batch renaming, mass refactor across many files) and independent evidence confirming reliable execution at scale.

   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “gemini --include-directories ../lib,../docs”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic supports some bulk-like operations — codebase scans that 'deploy thousands of AI agents to find bugs across your repository' (cubic-docs-21), cross-repo reviews that check for related changes across multiple repos (cubic-docs-37/46), and analytics/CSV exports of PR-level data across a team (cubic-docs-19, cubic-docs-20) — but these are review/scan/export operations, not a general-purpose bulk-action capability (e.g., batch-fixing or batch-approving many PRs/items at once) with independent confirmation of scale. Missing for 10: explicit documentation of a bulk-action command/API for acting on many PRs, issues, or files simultaneously, and independent/hands-on evidence corroborating the 'thousands of agents' claim at scale.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository. Link related repositories so reviews can chec…”
   • [claimed-docs] “You can export team member data as CSV from both [AI coding](/analytics/ai-coding#csv-export) and [De”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to cubic
   Gemini CLI~partialclaimed5/10

   Gemini CLI ships GitHub Action integrations that fire automatically on repo events (PR opened → automated review, issue created → automated triage, @mention → on-demand help), which is a form of event-triggered automation, plus non-interactive/scripted execution for pipelines. However there's no evidence of a general-purpose, user-defined rule/trigger engine (e.g., custom webhooks, cron-like conditions, arbitrary event types) within the CLI itself—only fixed GitHub-event integrations. Missing for 10: a generic rule-definition mechanism for arbitrary events, documentation of custom trigger conditions, and independent confirmation these automations work reliably (community notes reliability issues with agentic behavior).

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Run non-interactively in scripts for workflow automation”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic supports several rule-based automated actions triggered by events within its code-review domain: auto-review on new PR (cubic-docs-4/41), auto-approval of clean PRs per repository policy (cubic-docs-12/35), auto thread resolution when an issue is fixed (cubic-docs-27), custom agents enforcing org rules across PRs (cubic-docs-34), and a spend-limit trigger that auto-purchases extra capacity (cubic-docs-24/48), all configurable via cubic.yaml (cubic-docs-16/36). These are genuine user-defined rule→action automations, but they are scoped to the code-review/PR lifecycle rather than a general-purpose event/rule engine for arbitrary triggers and actions. Missing for 10: a generic rules/automation builder spanning non-review events, explicit UI for defining custom trigger conditions beyond built-in policies, and independent confirmation these automations behave reliably at scale.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic can approve clean pull requests automatically when your repository policy allows it. Start in shadow mode to see which PRs cubic would…”
   • [claimed-docs] “Enable automatic thread resolution to close findings when the issue is fixed”
   • [claimed-docs] “Custom agents are review rules that enforce your organization's specific best practices across pull requests.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”
   • [claimed-docs] “Flex capacity keeps GitHub PR AI reviews running after your workspace uses its included reviewed-line capacity. You set a monthly spend limi…”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “cubic.yaml lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, an…”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round to Gemini CLI
   Gemini CLI~partialclaimed4/10

   Gemini CLI supports non-interactive scripted runs and structured JSON output, which lets users wire it into external schedulers (cron, CI) for recurring automation, and its GitHub Action integrations (issue triage, PR review) imply repeatable, trigger-based workflows. However there is no first-party 'scheduled job' or cron feature documented within the CLI itself. Missing for 10: a native recurring-job/scheduler feature, explicit docs on scheduling cadence, and independent confirmation that scripted/CI-triggered runs work reliably for recurring automation.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”

   proof ↗⚑ flag

   cubic—none0/10

   cubic is a code review/PR automation tool triggered by PR events, webhooks, or manual commands (e.g., @cubic-dev-ai review, cubic review CLI), but no evidence describes scheduling recurring jobs or workflows on a time-based cadence (cron-like automation). Codebase scans and wiki updates appear event/PR-triggered, not user-schedulable recurring jobs.

   ⚑ flag

4. ai-native userVersion, review, and roll back my automations

   weight 1 · round drawn
   Gemini CLI~partialclaimed4/10

   Gemini CLI offers conversation checkpointing to save and resume sessions (gemini-cli-gh-8), which provides a rudimentary rollback/resume mechanism, but there is no evidence of versioning, diffing, or reviewing automation scripts/workflows themselves, nor a dedicated rollback command for automations. missing for 10: explicit version history for automations, review/diff tooling, and a documented rollback mechanism beyond session checkpoints.

   • [github] “Conversation checkpointing to save and resume complex sessions”

   proof ↗⚑ flag

   cubic~partialclaimed4/10

   cubic.yaml (the config defining review behavior and custom agents) lives in the repo root, so it inherits git's native versioning and can be reviewed like any code change (cubic-docs-16, cubic-docs-11), but there is no dedicated changelog, rollback UI, or history feature specifically for cubic's automations/config themselves. Missing for 10: explicit rollback/version-history feature for automation configs, evidence of reviewing changes to cubic.yaml itself, dedicated UI for managing automation versions.

   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”
   • [claimed-docs] “Create a repository named `cubic-config` in your organization and add a `cubic.yaml` file to the root directory. cubic automatically applies…”

   proof ↗⚑ flag

Background execution

1. ai-native userHave a cloud agent build, test, and demo a feature end-to-end for my review

   weight 2 · round to Gemini CLI
   Gemini CLI~partialcommunity4/10

   Gemini CLI documents cloud-adjacent automation via its GitHub Actions integration (PR reviews, issue triage, @gemini-cli on-demand assistance, non-interactive scripting) which could kick off agentic work, but there is no vendor evidence of an autonomous cloud agent that builds, runs tests, and produces a demo end-to-end for review. Community reports also describe agentic mode getting stuck in error loops, failing at basic file edits, and even causing data loss, undercutting confidence in reliable autonomous execution. missing for 10: explicit end-to-end build+test+demo workflow, evidence of a hosted/cloud agent (vs local CLI or CI hooks) producing a reviewable demo, and independent confirmation that autonomous runs complete without failure loops.

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Run non-interactively in scripts for workflow automation”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic—none0/10

   cubic is an AI code-review platform: it reviews PRs, fixes flagged issues, generates PR descriptions, and can auto-approve clean PRs, but there is no evidence it autonomously builds a feature from scratch, runs tests, and produces a demo for review — it only acts on existing diffs/PRs authored by humans or other coding agents.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “cubic helps your team spend less time writing PR descriptions automatically by generating clear, concise summaries.”

   proof ↗⚑ flag

Parallel agents

1. ai-native userLaunch fleets of autonomous agents that work in parallel on different tasks for hours or days

   weight 2 · round drawn
   Gemini CLI—none0/10

   Evidence shows single-session non-interactive scripting, GitHub Actions integration for issue triage/PR review, and MCP extensibility, but nothing about launching multiple autonomous agents working in parallel for hours or days. No fleet/orchestration/multi-agent parallelism capability is documented anywhere in the pack.

   ⚑ flag

   cubic—none0/10

   cubic is positioned as an AI code-review, codebase-scan, and wiki-generation tool, not a platform for users to launch autonomous agent fleets to work on arbitrary tasks for hours/days. 'Codebase scans deploy thousands of AI agents' (cubic-docs-21) is an internal review mechanism, not a user-directed fleet of autonomous agents working independently over long time horizons, and no evidence describes user-initiated multi-agent parallel task execution.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”

   proof ↗⚑ flag

Scheduled automation

1. ai-native userSet up always-on agents that run on schedules or triggers to maintain and fix my software autonomously

   weight 2 · round to cubic
   Gemini CLI~partialcommunity4/10

   Gemini CLI supports non-interactive scripted runs and GitHub Actions-based triggers (PR reviews, issue triage, @mention on-demand assistance) which can approximate scheduled/triggered automation, but there is no evidence of a persistent, self-scheduling 'always-on agent' that autonomously maintains and fixes software over time. missing for 10: native scheduler/cron support, persistent agent daemon or watch-mode, evidence of autonomous multi-cycle maintenance without human triggering, and reliability data (community reports actually describe agent mode getting stuck in loops or failing tasks).

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic ships trigger-based automation — it auto-reviews every new PR, reacts to force-pushes, can auto-fix flagged issues, auto-approve clean PRs, and runs codebase-wide scans with 'thousands of AI agents' plus a self-updating wiki via rolling PRs — which covers autonomous, trigger-driven maintenance of software. However, there is no evidence of user-defined schedules (cron-like) or general-purpose 'always-on agent' configuration beyond PR/code-review events. Missing for 10: explicit schedule/cron-based agent triggers, evidence of autonomous fixes/maintenance outside the PR-review workflow, and independent confirmation these agents run continuously without human PR-based triggers.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic can approve clean pull requests automatically when your repository policy allows it. Start in shadow mode to see which PRs cubic would…”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “cubic now reviews the new changes after a force-push when it can safely compare them with a previously reviewed version.”

   proof ↗⚑ flag

Debugging

1. developerDebug issues and troubleshoot using natural-language queries

   weight 2 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Gemini CLI explicitly advertises natural-language debugging/troubleshooting (gemini-cli-gh-3, gh-12/21/23) and community reports confirm strong codebase navigation and code-review value (gemini-cli-comm-1, comm-20). However, multiple hands-on reports directly contradict reliable debugging: users describe it getting stuck in error loops, failing simple file edits, and in one case catastrophically deleting user data during a troubleshooting session (gemini-cli-comm-10, comm-11, comm-14, comm-16).

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic~partialcommunity6/10

   cubic supports natural-language interaction for understanding and troubleshooting issues it finds in code review — e.g., replying to review comments for clarification, asking chat to 'tour this PR', adding code to AI chat with diff/codebase context, and its MCP server lets agents 'read review findings... and triage PR or codebase scan issues.' However, this is scoped to PR-review/bug-flagging conversations rather than general-purpose debugging of runtime errors or arbitrary issues outside the review flow. Missing for 10: evidence of open-ended debugging (e.g., stack trace analysis, runtime error investigation) beyond PR/code-review context, and independent hands-on confirmation that these NL Q&A features actually resolve real bugs (community comments dispute overall comment quality/bug-catching rate).

   • [claimed-docs] “Reply to a review comment to ask for clarification”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”

   proof ↗⚑ flag

Feature implementation

1. developerDescribe a feature or bug in plain language and have the agent implement or fix it across multiple files

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Vendor docs/GitHub claim strong support for describing features/bugs in plain language and having the agent edit/debug across large codebases (gemini-cli-gh-1, gemini-cli-gh-3), but multiple hands-on community reports directly contradict this: users report the agent getting stuck in error loops, failing basic file edit/read operations, ignoring GEMINI.md context files, jumping straight into 'spaghetti code' without a plan mode, and in one case catastrophically deleting user data via botched commands. missing for 10: consistent hands-on success stories on multi-file feature implementation, resolution of the reported reliability/looping failures, and independent benchmarks confirming multi-file bug-fix accuracy.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic~partialclaimed3/10

   Cubic is primarily a code-review platform that finds issues and can push targeted one-click fixes to specific flagged problems (docs-7, docs-44), and its CLI generates a fix prompt for external coding agents (docs-31) rather than implementing features itself. It does not document taking a plain-language feature/bug description and independently implementing changes across multiple files; that work is explicitly handed off to a separate 'coding agent' (docs-15, docs-30). Missing for 10: evidence of accepting an open-ended natural-language feature/bug description (not just a flagged review comment) and autonomously implementing multi-file changes, plus any hands-on validation of such end-to-end generation.

   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”

   proof ↗⚑ flag

Maintenance automation

1. developerHave the agent write tests, fix lint errors, resolve merge conflicts, and update dependencies for me

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   GitHub docs claim broad code-editing, debugging, and complex-rebase (merge conflict) automation capabilities (gemini-cli-gh-1, gemini-cli-gh-3, gemini-cli-gh-4), which would cover fixing lint issues and dependency/test work as part of general codebase editing, and PR review/issue triage features suggest lint-like feedback (gemini-cli-gh-10, gemini-cli-gh-11). However, multiple hands-on community reports concretely contradict reliable agentic code work: users report it getting stuck in error loops, failing simple file edit/read operations, ignoring GEMINI.md context files, producing 'spaghetti code' with no plan mode, and in one case catastrophically deleting user data during a file operation (gemini-cli-comm-10, gemini-cli-comm-11, gemini-cli-comm-13, gemini-cli-comm-14, gemini-cli-comm-16). No explicit evidence names test-writing, lint-fixing, or dependency-updating tasks specifically. Missing for 10: explicit documentation/examples of writing tests, fixing lint errors, or updating dependencies, and independent corroboration that these specific tasks work reliably.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic~partialclaimed3/10

   cubic can automatically fix issues it flags in review (e.g., 'Fix with cubic' pushes a fix commit, docs-7/44) which could cover some lint-style issues, but there is no evidence it writes tests, resolves merge conflicts, or updates dependencies — cubic is positioned as a review/fix-on-comment tool, not a general-purpose coding agent for these tasks. missing for 10: test generation, merge-conflict resolution, dependency updates, and any evidence beyond review-triggered lint/bug fixes.

   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”

   proof ↗⚑ flag

Codebase mapping

1. developerUnderstand how a codebase fits together to find where to start making changes

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Gemini CLI advertises large-codebase querying/editing (gemini-cli-gh-1) with a 1M-token context window, custom GEMINI.md context files, and --include-directories flags for scoping (gemini-cli-gh-9, gemini-cli-gh-16), and one HN user praises its ability to 'navigate and learn' large codebases effortlessly (gemini-cli-comm-1). However, other hands-on users report the opposite: it is 'stupid at navigation in the codebase' taking 10x longer (gemini-cli-comm-15) and 'consistently ignores' the GEMINI.md context file despite claiming to use it (gemini-cli-comm-13), directly undercutting the codebase-understanding claim. Missing for 10: consistent independent corroboration of reliable codebase navigation, and no contradicting failure reports.

   • [github] “Query and edit large codebases”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [github] “gemini --include-directories ../lib,../docs”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic's AI wiki auto-indexes the codebase into a searchable wiki with architecture diagrams and source-code links, and its MCP server/chat features let developers query the codebase and diffs for context (cubic-docs-22, cubic-docs-23, cubic-docs-15, cubic-docs-10), which directly supports understanding how a codebase fits together before making changes. Codebase scans (cubic-docs-21) add bug/vuln discovery but aren't about architectural navigation. Missing for 10: independent/hands-on validation that the wiki or chat actually helps developers locate where to start changes, and community evidence is silent on this specific capability (only comments on PR review quality exist).

   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”

   proof ↗⚑ flag

2. developerHave the agent map and explain an entire unfamiliar codebase without manually selecting context files

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Google claims large-codebase querying/editing (gemini-cli-gh-1) and Gemini CLI's 1M-token context lets it 'navigate and learn' huge codebases 'effortlessly' per one user (gemini-cli-comm-1), but other hands-on reports directly contradict this, calling it 'so stupid at navigation in the codebase it takes 10x as long' (gemini-cli-comm-15) and prone to getting 'stuck in spaghetti code' with no plan mode (gemini-cli-comm-14), plus it reportedly ignores its own GEMINI.md context file (gemini-cli-comm-13). Missing for 10: consistent independent benchmarks confirming autonomous whole-codebase mapping without file selection, and resolution of the navigation-quality contradiction.

   • [github] “Query and edit large codebases”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic's AI wiki automatically indexes the entire codebase and produces searchable wikis with architecture diagrams and source links, and codebase scans deploy AI agents across the whole repo — both let a developer get a full-codebase map/explanation without hand-picking context files. However, this is documented only in first-party docs with no independent hands-on validation of how well it 'explains' an unfamiliar codebase, and community commentary focuses on PR-review quality rather than the wiki/codebase-scan features. Missing for 10: independent/hands-on verification of the AI wiki's accuracy and usefulness, and community evidence specifically evaluating whole-codebase explanation quality.

   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”

   proof ↗⚑ flag

Context management

1. developerHave the agent build and recall memory automatically across sessions

   weight 2 · round to cubic
   Gemini CLI!disputedcontradicted3/10

   Gemini CLI offers static project context via GEMINI.md files and a `/memory` command, plus manual conversation checkpointing to save/resume sessions—but these are manually configured/invoked, not automatic memory building/recall across sessions. Hands-on community evidence directly contradicts even the GEMINI.md context mechanism working reliably: a user reports it 'consistently ignores my GEMINI.md file... even though it always says 1 GEMINI.md file is being used' (gemini-cli-comm-13), undermining the claimed persistent-context capability. missing for 10: evidence of automatic memory formation/recall without user action, evidence /memory command builds persistent cross-session knowledge, independent corroboration that GEMINI.md context reliably persists.

   • [github] “Conversation checkpointing to save and resume complex sessions”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic~partialclaimed3/10

   Cubic maintains some persistent state — it compares force-pushed changes against previously reviewed versions and its AI wiki auto-indexes and keeps codebase docs current — but there's no documented feature describing agent 'memory' that is built and recalled across chat/review sessions in the way the story implies. missing for 10: explicit session-memory mechanism, evidence of recall in later interactions, independent confirmation of persistent context use.

   • [claimed-docs] “cubic now reviews the new changes after a force-push when it can safely compare them with a previously reviewed version.”
   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”

   proof ↗⚑ flag

2. developerInclude multiple project directories in a single session for broader context

   weight 2 · round to Gemini CLI
   Gemini CLI✓fullclaimed8/10

   The official CLI flag `--include-directories ../lib,../docs` explicitly allows adding multiple project directories into a single session for broader context, directly matching the story. Missing for 10: independent hands-on confirmation of multi-directory usage quality/behavior beyond the flag documentation.

   • [github] “gemini --include-directories ../lib,../docs”

   proof ↗⚑ flag

   cubic~partialclaimed4/10

   Cubic's 'cross-repo reviews' feature lets teams link related repositories so a review can check shared APIs, schemas, or docs across them, which is the closest analogue to including multiple project directories for broader context — but this is scoped narrowly to PR review consistency checks, not a general chat/agent session that loads multiple directories for open-ended Q&A. Missing for 10: evidence of a chat/agent session (e.g., MCP or CLI) that lets a developer add multiple arbitrary project directories as context, and any hands-on confirmation of cross-repo context quality.

   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository. Link related repositories so reviews can chec…”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”

   proof ↗⚑ flag

3. developerAdd a project instructions file to set coding standards and conventions the agent follows

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted5/10

   Gemini CLI documents GEMINI.md custom context files for tailoring behavior/project conventions (gemini-cli-gh-9) and docs mention /memory command for managing this context (gemini-cli-docs-3). However, hands-on community feedback reports the file being ignored despite being loaded ('it consistently ignores my GEMINI.md file, both global and local, even though it always says 1 GEMINI.md file is being used' - gemini-cli-comm-13), directly contradicting reliable adherence to project instructions. Missing for 10: independent corroboration that GEMINI.md is consistently honored, more detail on precedence/hierarchy of instruction files, and resolution of the reported ignoring behavior.

   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic supports a `cubic.yaml` config file at the repo root (or a shared `cubic-config` repo) that acts as 'the source of truth for AI review behavior, ignore patterns, PR descriptions, and custom agents,' and 'Custom agents' are documented as a way to 'enforce your team's coding standards.' This is a project-level instructions/config mechanism the agent follows, though it's framed around PR review behavior rather than a general-purpose coding-standards instructions file for all agent interactions. Missing for 10: explicit documentation of a plain-text/markdown instructions file (like AGENTS.md-style) covering broader coding conventions beyond review/ignore rules, and independent confirmation that custom agents reliably enforce standards in practice.

   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “Create a repository named `cubic-config` in your organization and add a `cubic.yaml` file to the root directory. cubic automatically applies…”

   proof ↗⚑ flag

Issue diagnosis

1. developerReproduce issues, narrow down root causes, and verify fixes

   weight 3 · round to cubic
   Gemini CLI!disputedcontradicted4/10

   Google markets debugging/troubleshooting via natural language and a /bug reporting flow (gh-3, gh-20), and one HN user praises its ability to navigate huge codebases (comm-1). However multiple hands-on reports directly contradict root-cause/verify-fix workflows: users describe it getting stuck in error loops, rewriting files empty, ignoring GEMINI.md context, being 'terrible at agentic stuff', and in one case catastrophically deleting user data during a file operation (comm-10, comm-11, comm-13, comm-14, comm-15, comm-16). missing for 10: reliable reproduction of bugs, consistent root-cause narrowing without loops, and independent verification of fix correctness.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Use `/bug` command to report issues directly from the CLI.”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

   cubic~partialclaimed4/10

   cubic is fundamentally an AI code-review/PR platform: it can flag bugs during review (codebase scans, PR review), generate and push fixes ('Fix with cubic'), and auto-resolve threads when issues are fixed, which covers some root-cause flagging and fix verification. However there is no evidence of actual issue reproduction (running the app/tests to trigger a bug) or root-cause debugging via execution—cubic's analysis is static/AI-review based, not a runtime debugger. Missing for 10: reproduction of bugs via execution/testing, dynamic root-cause tracing, and independent verification of fixes beyond thread auto-resolution.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Enable automatic thread resolution to close findings when the issue is fixed”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”

   proof ↗⚑ flag

Marketplace

1. developerEquip the agent with custom skills to perform specialized tasks

   weight 1 · round to Gemini CLI
   Gemini CLI~partialcommunity6/10

   Gemini CLI supports extensibility through MCP servers (custom tools, media generation) and GEMINI.md context files to tailor agent behavior for specific projects, and a community mention references a built-in 'skills runtime' as part of its architecture. However, there is no dedicated first-party 'skills' marketplace or packaging system, and community reports note GEMINI.md is sometimes ignored in practice. Missing for 10: a documented first-class 'skills' framework/marketplace, independent corroboration that custom skills work reliably, and confirmation that the skills runtime mentioned in community feedback is a stable, documented feature.

   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [community] “All in all, a 140 MB Go binary with its own browser control stack, sandbox, Git, language detector, skills runtime, and subagent system. I'm…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic~partialclaimed4/10

   cubic supports 'custom agents' configured via cubic.yaml to enforce coding standards, which is a limited form of custom skill/persona equipping for the review agent, but this is scoped narrowly to code-review behavior rather than general-purpose specialized task skills. Missing for 10: documentation on creating arbitrary custom skills/tools beyond coding-standard enforcement, examples of diverse specialized tasks, and independent validation of the custom agents feature.

   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”

   proof ↗⚑ flag

2. engineering-leadIntegrate third-party partner-built agent apps into my workflows

   weight 1 · round to cubic
   Gemini CLI~partialclaimed5/10

   Gemini CLI supports connecting external capabilities via MCP servers (e.g., Imagen, Veo, Lyria) and integrates with GitHub via @gemini-cli mentions and Actions, showing some ecosystem extensibility for third-party tools. However, there's no evidence of a curated marketplace or directory of partner-built 'agent apps' specifically designed for cross-workflow integration, only generic MCP server configuration support. Missing for 10: a documented partner/agent-app ecosystem or marketplace, case studies of third-party agent apps being integrated, and independent confirmation of smooth interoperability.

   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [github] “@github List my open pull requests”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

   cubic~partialprobed6/10

   cubic documents concrete integrations with third-party agent apps - connecting ChatGPT Plus or Claude Code subscriptions for local reviews, exposing an MCP server so coding agents can pull review findings and request PRs, pushing fixes via coding agents, and Linear or Jira issue-analysis integration - showing real ecosystem hooks for partner-built agent tools. Missing for 10: a documented marketplace or catalog of certified partner agent apps, examples beyond the major AI vendors, and independent evidence confirming these integrations work smoothly in practice.

   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “cubic can automatically analyze your pull requests to see if they meet the requirements from your linked Linear or Jira issues.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”

   proof ↗⚑ flag

Team knowledge

1. engineering-leadCreate a shared workspace from my docs and repos as a common source of truth for the team

   weight 1 · round to cubic
   Gemini CLI—none0/10

   Gemini CLI offers per-project GEMINI.md context files and --include-directories for local context, but there is no evidence of a shared, centrally managed team workspace combining docs and repos as a common source of truth across a team.

   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [github] “gemini --include-directories ../lib,../docs”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

   cubic~partialclaimed5/10

   cubic's AI wiki automatically indexes a repo's codebase into a searchable, shared wiki (with architecture diagrams) that's exported into the repo and kept current via PRs, giving teams a common source of truth derived from code — but this is scoped to repos, not to ingesting a team's existing docs into one workspace. Missing for 10: explicit support for importing/aggregating external docs, cross-repo/team-wide workspace view (only per-repo wiki + cross-repo review linking), and any independent evidence the wiki is actually used as a 'workspace' by teams.

   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository. Link related repositories so reviews can chec…”

   proof ↗⚑ flag

Tool integration

1. developerConnect the agent to workflow tools like Jira, Slack, and Google Drive to extend its context

   weight 3 · round to Gemini CLI
   Gemini CLI~partialclaimed5/10

   Gemini CLI supports connecting MCP servers to add custom tools/capabilities (gh-5, gh-19), which is the generic mechanism that could extend context to third-party services, but the evidence never mentions Jira, Slack, or Google Drive specifically or any pre-built connectors for them. Missing for 10: named/official Jira, Slack, or Google Drive integrations or MCP servers, and any documented example of using these workflow tools with Gemini CLI.

   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”

   proof ↗⚑ flag

   cubic—none0/10

   cubic's documented integrations are limited to GitHub, an MCP server for coding agents, and ChatGPT/Claude Code subscriptions for local reviews; there is no evidence of connectors to Jira, Slack, or Google Drive for extending context.

   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [community] “As far as I can see, this doesn't directly integrate with github (we currently use coderabbit on github)? Is it on your timeline?”
   • [community] “Would be great to have support for GitLab also (have a project there that I would love to try this on and I can't switch it to GitHub)”

   proof ↗⚑ flag

2. developerKick off agent tasks directly from GitHub, GitLab, Linear, or Slack

   weight 2 · round drawn
   Gemini CLI~partialclaimed4/10

   Gemini CLI has a documented GitHub integration (GitHub Action/App) that lets developers trigger tasks via @gemini-cli mentions in issues/PRs, automated PR reviews, and issue triage, but there is no evidence of native GitLab, Linear, or Slack integrations for kicking off agent tasks. missing for 10: GitLab integration, Linear integration, Slack integration, independent corroboration of GitHub workflow reliability

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “@github List my open pull requests”
   • [github] “Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

   cubic~partialcommunity4/10

   cubic clearly supports triggering reviews and fixes from GitHub (PR comments like `@cubic-dev-ai review this PR`, 'Fix with cubic', auto-review on install) and links to Linear/Jira for issue-requirement checks, but there's no evidence of Slack integration and community comments explicitly note GitLab support is missing/requested, not confirmed. Missing for 10: documented Slack task-triggering, confirmed GitLab support, and independent corroboration that Linear integration goes beyond issue-analysis to actually kicking off agent tasks.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “To review a PR that was opened _before_ you installed the app, comment: `@cubic-dev-ai review this PR`.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [claimed-docs] “Post this comment on GitHub to start a review: text theme={null} @cubic-dev-ai review this PR ”
   • [claimed-docs] “cubic can automatically analyze your pull requests to see if they meet the requirements from your linked Linear or Jira issues.”
   • [community] “Would be great to have support for GitLab also (have a project there that I would love to try this on and I can't switch it to GitHub)”
   • [community] “It looks like graphite.dev has pivoted into this space too, which is annoying since they still don't have gitlab support after several years…”

   proof ↗⚑ flag

Cross device continuity

1. developerStart a task on one device and continue it later from another device or browser

   weight 2 · round to cubic
   Gemini CLI—none0/10

   Gemini CLI offers local conversation checkpointing to save/resume sessions (gh-8) and can run in Cloud Shell (docs-1), but there is no evidence of cloud-synced session state that lets a developer start a task on one device/terminal and pick it up seamlessly on another device or browser. missing for 10: cross-device session sync, browser-based continuation of an existing CLI session, any documented mechanism to transfer checkpoint state between machines.

   • [github] “Conversation checkpointing to save and resume complex sessions”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”

   proof ↗⚑ flag

   cubic~partialclaimed3/10

   cubic's reviews, chat, and fix actions happen inside GitHub PR comments and threads (docs-29, docs-45, docs-7), which are cloud-hosted and thus technically accessible from any device/browser, but cubic never documents an explicit cross-device 'resume task' or session-continuity feature for a developer's own work-in-progress task. Missing for 10: explicit session/task persistence across CLI, IDE, and browser, documented device-handoff workflow, and any first-party or community confirmation of resuming an in-progress task on a new device.

   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”

   proof ↗⚑ flag

Ide integration

1. developerView interactive diffs and share selected code as context from within my JetBrains IDE

   weight 1 · round drawn
   Gemini CLI—none0/10

   No evidence mentions JetBrains IDE integration, interactive diffs, or sharing code context from within an IDE for Gemini CLI; evidence pack only covers terminal/CLI usage, GitHub Actions, and MCP servers.

   ⚑ flag

   cubic—none0/10

   cubic's docs describe CLI review, MCP server for coding agents, and an 'Add to AI chat' feature for selecting code with diff context, but none of this is documented as a JetBrains IDE plugin or in-IDE interactive diff viewer — the 'ide/' docs paths refer to CLI and agent/MCP setup, not JetBrains integration specifically.

   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

2. developerChat with the coding assistant directly inside my IDE for contextual help

   weight 3 · round to cubic
   Gemini CLI—none0/10

   The evidence pack describes Gemini CLI as a terminal-based agent (context files, MCP servers, Cloud Shell access) but contains no mention of an IDE extension, sidebar chat, or in-editor contextual panel that would let a developer chat with it directly inside an IDE. Community threads discuss its terminal/agentic performance, not IDE integration.

   ⚑ flag

   cubic~partialclaimed5/10

   cubic offers chat-based interaction (an 'Add to AI chat' feature with diff/codebase context, a chat sidebar for PR navigation, and an MCP server that lets coding agents in the IDE read review findings), but these are mostly scoped to reviewing PRs/code review rather than a general-purpose in-IDE chat assistant for arbitrary contextual coding help. Missing for 10: evidence of a native IDE chat panel for general coding questions (not tied to PR/diff review), and independent hands-on confirmation of in-IDE chat quality.

   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The chat sidebar helps you quickly understand and navigate your pull requests (PRs) with intelligent, context-aware assistance directly with…”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”

   proof ↗⚑ flag

Terminal workflow

1. developerRun a coding agent locally from my terminal

   weight 3 · round to Gemini CLI
   Gemini CLI✓fullcommunity8/10

   Gemini CLI is a terminal-native coding agent with first-party docs (gemini-cli-gh-1 through -20, gemini-cli-docs-1/2/3) describing running locally, querying/editing codebases, non-interactive scripting, and Cloud Shell availability with no extra setup, and abundant community evidence (gemini-cli-comm-1, -9, -12) confirms real-world local terminal usage. Missing for 10: independent benchmark of reliability (several community reports of agentic failures/loops, e.g. gemini-cli-comm-10, -11, -14) and no first-party install/runtime docs beyond GitHub README excerpts.

   • [github] “Query and edit large codebases”
   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “gemini --include-directories ../lib,../docs”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “The correct way of using Gemini CLI is: ABUSE IT! With 1M Context Window (soon 2M) and generous daily free quota are huge advantages.”

   proof ↗⚑ flag

   cubic~partialprobed5/10

   cubic ships an official local CLI (`cubic review`) that runs from the terminal to review uncommitted changes before push, and can connect to Claude Code/ChatGPT subscriptions for local reviews, but this is a review agent rather than a general-purpose coding agent that writes/edits code interactively in the terminal. Missing for 10: evidence of an interactive terminal coding-agent loop (code generation/editing, multi-turn task execution) beyond review-only CLI use.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

2. developerRun the agent non-interactively in scripts for workflow automation

   weight 2 · round to Gemini CLI
   Gemini CLI✓fullclaimed9/10

   Gemini CLI explicitly documents non-interactive scripting support with structured output flags (--output-format json / stream-json) and lists 'Run non-interactively in scripts for workflow automation' as a core feature; GitHub Actions integration for PR review/issue triage further evidences automation use cases. Missing for 10: independent hands-on validation specifically of scripting/automation workflows (community feedback focuses on interactive agent quality, not scripted use).

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”

   proof ↗⚑ flag

   cubic~partialprobed5/10

   cubic ships a CLI (`cubic review`) that reviews local/uncommitted changes and automatically reviews PRs on GitHub without manual intervention, both of which suggest it can be woven into automated workflows (docs-4, docs-8, docs-31, docs-41). However, there is no explicit documentation of a non-interactive/headless mode, CI pipeline integration, exit codes, or scripting flags for the CLI. missing for 10: explicit CI/script integration docs, non-interactive mode flags, exit-code/output-format guarantees for automation, independent evidence of scripted use.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Gemini CLI
   Gemini CLI~partialprobed5/10

   Gemini CLI supports non-interactive scripting and structured JSON/stream-JSON output (gh-6, gh-17, gh-18), suggesting most interactive capabilities can be invoked programmatically for automation. However, there's no explicit documentation confirming full feature parity between interactive sessions and scripted/API use, and probes found no formal API/OpenAPI spec (probe-1, probe-2), so completeness of parity is unverified. Missing for 10: explicit parity documentation, a formal API surface beyond CLI flags, and independent confirmation that all UI/interactive features (e.g., checkpointing, MCP tool use) are scriptable identically.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

   cubic~partialprobed4/10

   cubic exposes some functionality outside the UI — an Analytics API for PR-level data (cubic-docs-20), an MCP server for reading review findings, requesting reviews, and even managing subscriptions/seats (cubic-docs-3, cubic-docs-15), and a CLI for local reviews (cubic-docs-8, cubic-probe-4) — but there is no general-purpose public API (openapi probes 404, cubic-probe-2) covering the full UI surface (codebase scans, AI wiki, cubic.yaml config, analytics dashboard CSV exports, custom agents, auto-approve settings). Missing for 10: a comprehensive REST/GraphQL API or OpenAPI spec covering all UI features, evidence of API parity for wiki/codebase-scan/config management, and independent confirmation that MCP+CLI+Analytics API together replicate full UI functionality.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “You can now ask your coding agent to check your cubic subscription, manage team seats and roles, and purchase more seats without leaving you…”
   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to cubic
   Gemini CLI—none0/10

   No evidence of any data export feature or open-format data portability in Gemini CLI; the tool is a local coding agent that reads/writes local files but nothing indicates exporting conversation history, settings, or usage data in an open format for user-controlled exit. Probes for llms.txt/openapi also failed, showing no structured data-access surface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

   cubic~partialclaimed4/10

   cubic offers some data portability: CSV export of team analytics (cubic-docs-19), an Analytics API for PR-level data (cubic-docs-20), and AI wiki content exported as markdown files into the repo (cubic-docs-23). However, there's no evidence of comprehensive export covering all review history, comments, configs, or account data in open formats, nor any documented account deletion/migration path for 'leaving' the platform. Missing for 10: full account/data export (reviews, comments, configs), explicit data-portability policy, independent confirmation of export completeness.

   • [claimed-docs] “You can export team member data as CSV from both [AI coding](/analytics/ai-coding#csv-export) and [De”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”

   proof ↗⚑ flag

3. ai-native userRead the product's source under an open license

   weight 2 · round to Gemini CLI
   Gemini CLI~partialprobed5/10

   The product's source is hosted publicly at github.com/google-gemini/gemini-cli (referenced repeatedly across the evidence pack), implying open availability for reading, but no citation in the evidence pack explicitly names or confirms an open-source license (e.g., Apache/MIT) or points to a LICENSE file. Missing for 10: explicit license text/citation, confirmation of license type, and any independent corroboration of open-license terms.

   • [github] “Query and edit large codebases”
   • [github] “Use `/bug` command to report issues directly from the CLI.”
   • [probe] “official CLI documented at https://developers.google.com/gemini-code-assist/docs/gemini-cli”

   proof ↗⚑ flag

   cubic—none0/10

   No evidence in the pack indicates cubic's source code is open or available under any open license; it appears to be a closed, commercial SaaS/CLI product with only documentation exposed publicly. Missing for 10: any open-source repository, license file, or public source code reference.

   ⚑ flag

4. ai-native userSelf-host the core product

   weight 3 · round drawn
   Gemini CLI—none0/10

   Gemini CLI is an open-source client, but the core product (the Gemini models/backend) is a Google-hosted cloud service accessed via Google account sign-in; no evidence anywhere in the pack describes a self-hosted or on-prem deployment option for the core model/service.

   • [github] “No API key management - just sign in with your Google account”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”

   proof ↗⚑ flag

   cubic—none0/10

   cubic is presented as a hosted SaaS code review platform (GitHub app, cloud dashboard, analytics, flex capacity billing) with no documentation of a self-hostable core, on-prem deployment, or open-source release. Absence of any self-hosting evidence for an applicable axis (a code review tool could plausibly be self-hosted) means this is 'none'.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”
   • [claimed-docs] “Flex capacity keeps GitHub PR AI reviews running after your workspace uses its included reviewed-line capacity. You set a monthly spend limi…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

Authentication

1. developerAuthenticate with an API key instead of an account login

   weight 2 · round to Gemini CLI
   Gemini CLI~partialclaimed4/10

   The docs emphasize signing in with a Google account (gh-13) as the primary flow, but they also note that developers needing 'specific model control or paid tier access' (gh-24) have an alternative path, implying API-key-based auth exists without detailing it. There's no explicit example or setup instructions for API-key authentication itself. Missing for 10: explicit API key env-var/config documentation, first-party steps for key-based auth, and independent confirmation it works without Google login.

   • [github] “No API key management - just sign in with your Google account”
   • [github] “Developers who need specific model control or paid tier access”

   proof ↗⚑ flag

   cubic—none0/10

   No evidence in the pack mentions API key authentication as an alternative to account login; cubic's docs describe GitHub app installation, roles/permissions, and subscription management but nothing about API-key-based auth for developers. The OpenAPI probe also returned 404s, suggesting no documented API surface with key auth.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

2. engineering-leadAuthenticate through an enterprise identity or cloud platform for compliance and scalability

   weight 2 · round to Gemini CLI
   Gemini CLI!disputedcontradicted4/10

   Google claims 'Enterprise features: Advanced security and compliance' and frictionless Google-account sign-in without API key management, plus Cloud Shell availability, suggesting cloud/enterprise identity support. However, a hands-on community report shows authentication explicitly failing for Workspace (enterprise) accounts ('Failed to login. Ensure your Google account is not a Workspace account'), directly contradicting the enterprise-identity claim for a core scenario. Missing for 10: documented enterprise SSO/IAM integration details, confirmation Workspace login issue is resolved, and independent verification of compliance certifications.

   • [github] “No API key management - just sign in with your Google account”
   • [github] “Enterprise features: Advanced security and compliance”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' I have had a Workspace account since GSuite and now as a Workspace…”

   proof ↗⚑ flag

   cubic—none0/10

   The evidence pack shows role-based access control for team/subscription management (cubic-docs-47) but no mention of SSO, SAML, OAuth enterprise identity provider integration, or cloud IAM authentication anywhere in the docs or community items. missing for 10: SSO/SAML support, enterprise IdP integration (Okta/Azure AD/Google Workspace), cloud IAM authentication, any compliance certification tied to auth.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”

   proof ↗⚑ flag

3. developerSign in with my existing product subscription plan to use the coding agent

   weight 2 · round to cubic
   Gemini CLI!disputedcontradicted4/10

   Gemini CLI advertises frictionless Google-account sign-in with no API key management (gh-13), suggesting subscribers could just log in and go, but hands-on community reports concretely contradict this: a Gemini Pro subscriber found that paying for 'Gemini' doesn't unlock Gemini CLI usage, requiring a separate 'Gemini Code Assist Standard/Enterprise' plan, and another user explicitly asks for one unified subscription across CLI, Code Assist, Jules, etc. like Claude's Max plan. Missing for 10: evidence that an existing Google One/Gemini Advanced subscription actually raises CLI usage limits, and resolution of the reported subscription fragmentation.

   • [github] “No API key management - just sign in with your Google account”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber but I learn I should be a 'Gemini Code Assist Standard or Enterpri…”
   • [community] “Again, with the complicated subscription. Please just give us a monthly subscription for developers that I can pay whatever, and then use Ge…”
   • [github] “Developers who need specific model control or paid tier access”

   proof ↗⚑ flag

   cubic~partialclaimed6/10

   cubic explicitly lets developers connect an existing ChatGPT Plus/Pro or Claude Code subscription to power local CLI reviews, which matches 'sign in with existing subscription to use the coding agent.' However, this only applies to local review via CLI, not the full agent/reviewer product, and there's no independent verification of this flow working in practice. Missing for 10: broader applicability beyond CLI reviews, and community/hands-on confirmation of the subscription linking process.

   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”

   proof ↗⚑ flag

4. developerSign in with a personal account to get free-tier access without managing API keys

   weight 1 · round to Gemini CLI
   Gemini CLI✓fullcommunity7/10

   GitHub docs explicitly state 'No API key management - just sign in with your Google account' (gemini-cli-gh-13), directly matching the story, and Cloud Shell docs describe zero-setup access. Community reports don't dispute personal-account sign-in itself (the failure noted is specific to Workspace accounts, an edge case outside 'personal account'), though some users voice confusion over how free vs paid tiers interact. Missing for 10: independent/hands-on confirmation of the free-tier quota limits and clearer documentation distinguishing personal free-tier access from paid Code Assist tiers.

   • [github] “No API key management - just sign in with your Google account”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber but I learn I should be a 'Gemini Code Assist Standard or Enterpri…”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' I have had a Workspace account since GSuite and now as a Workspace…”

   proof ↗⚑ flag

   cubic—none0/10

   cubic is a code-review/PR platform with team subscriptions, seats, and flex-capacity billing; no evidence describes a personal-account sign-in path granting free-tier access without API key management—this pricing/auth model story is unaddressed in the pack.

   ⚑ flag

Model choice

1. developerLet the tool automatically pick the best model for each task

   weight 1 · round drawn
   Gemini CLI—none0/10

   Evidence shows manual model selection ('Choose specific Gemini models' for 'developers who need specific model control') rather than automatic task-based model selection; no evidence of the CLI auto-choosing the optimal model per task.

   • [github] “Model selection: Choose specific Gemini models”
   • [github] “Developers who need specific model control or paid tier access”

   proof ↗⚑ flag

   cubic—none0/10

   Cubic's docs describe distinct manually-invoked review modes (standard review vs. Ultrareview) and let users connect their own ChatGPT/Claude subscriptions for local reviews, but there is no evidence the tool automatically selects the best model per task based on cost or complexity — mode selection is user-driven, not automatic.

   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models, and typically takes a…”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”

   proof ↗⚑ flag

2. developerChoose which underlying AI model powers my session from multiple providers

   weight 2 · round to cubic
   Gemini CLI—none0/10

   Evidence shows Gemini CLI only supports choosing among Google's own Gemini models (gh-14, gh-24), not switching between different AI providers (e.g., OpenAI, Anthropic); community complaints (comm-2, comm-3, comm-19) reinforce that it's locked to Google's ecosystem/billing. There is no evidence of multi-provider model selection, so the story as written (choosing from multiple providers) is not delivered.

   • [github] “Model selection: Choose specific Gemini models”
   • [github] “Developers who need specific model control or paid tier access”
   • [community] “The killer feature of Claude Code is that you can just pay for Max and not worry about API billing. Until Gemini does that, I'm sticking wit…”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber but I learn I should be a 'Gemini Code Assist Standard or Enterpri…”
   • [community] “Again, with the complicated subscription. Please just give us a monthly subscription for developers that I can pay whatever, and then use Ge…”

   proof ↗⚑ flag

   cubic~partialclaimed5/10

   Cubic docs state you can "connect your existing ChatGPT Plus/Pro or Claude Code subscription to use its models for local reviews" via the CLI, showing some model-provider choice, but PR reviews and Ultrareview use cubic's own proprietary 'most capable review models' with no indication of choosing among alternative providers there. missing for 10: model choice for the core PR/Ultrareview review sessions (not just local CLI), a documented list of selectable providers, and independent confirmation of the feature working in practice.

   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models, and typically takes a…”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Gemini CLI—none0/10

   No evidence in the pack mentions data residency, regional storage options, or configurable data location controls for Gemini CLI; only enterprise 'security and compliance' features are mentioned generically without specifics.

   ⚑ flag

   cubic—none0/10

   No evidence in the pack mentions data residency, region selection, or storage location controls for cubic; the docs focus entirely on code review, PR workflows, and analytics with no privacy/data-residency configuration options mentioned.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   Gemini CLI—none0/10

   No evidence in the pack addresses data usage/training opt-out policies, privacy controls, or terms governing whether user data trains Google's models; only unrelated feature/community commentary is present. Missing for 10: explicit data-usage/training policy documentation, opt-out mechanism, enterprise/no-training guarantee.

   ⚑ flag

   cubic—none0/10

   No evidence in the pack addresses data usage for AI model training, opt-out policies, or data privacy commitments — cubic's docs focus entirely on code review features with no mention of training data controls.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   Gemini CLI—none0/10

   No evidence pack items address data retention controls, deletion mechanisms, or privacy settings for Gemini CLI; only enterprise 'security and compliance' is vaguely mentioned without specifics. Missing for 10: documentation on data retention policy, user-controlled deletion mechanism, opt-out of data collection, and any privacy settings UI/CLI flags.

   ⚑ flag

   cubic—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy settings for AI-native users; docs cover review features, analytics, wiki, and pricing but nothing on retention/deletion of data. Missing for 10: any documentation on data retention periods, deletion requests, or privacy controls.

   ⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round drawn
   Gemini CLI—none0/10

   No evidence in the pack mentions telemetry settings, opt-out flags, or usage-data collection policy for Gemini CLI. Missing for 10: any documentation of a telemetry/usage-tracking toggle, privacy settings, or opt-out mechanism.

   ⚑ flag

   cubic—none0/10

   No evidence pack item addresses telemetry opt-out or usage-tracking controls; cubic's docs cover review features, analytics dashboards, and RBAC but never mention a privacy/telemetry toggle. missing for 10: any mention of telemetry collection, opt-out settings, or privacy controls.

   ⚑ flag

Data governance

1. engineering-leadOpt out of having my code and prompts used for AI model training

   weight 1 · round drawn
   Gemini CLI—none0/10

   No evidence in the pack addresses data usage, training opt-out policies, or privacy controls for Gemini CLI; only feature lists and general community sentiment are present. missing for 10: any documentation of data usage/training policy, opt-out settings or enterprise privacy controls, and independent confirmation of such settings working.

   ⚑ flag

   cubic—none0/10

   No evidence in the pack addresses data-privacy or AI training opt-out policies for code/prompts; nothing in the docs, changelog, or community discussion mentions this capability. missing for 10: any documentation of data usage policy, training opt-out settings, or privacy controls.

   ⚑ flag

Pr review

1. developerHave the agent stage changes, write commit messages, create branches, and open pull requests

   weight 3 · round drawn
   Gemini CLI~partialclaimed4/10

   Evidence shows Gemini CLI can automate git-related operational tasks like querying pull requests and handling complex rebases, and its GitHub Action can do automated PR reviews and issue triage, but there's no explicit documentation of the agent staging changes, writing commit messages, creating branches, or opening new pull requests itself. Missing for 10: explicit commit-message generation, branch creation, and PR-opening workflow evidence, plus independent confirmation these work reliably.

   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “@github List my open pull requests”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

   cubic~partialclaimed4/10

   cubic can push fix commits directly to an existing PR branch and auto-generate PR descriptions/summaries (cubic-docs-30, cubic-docs-44, cubic-docs-26, cubic-docs-49), but its own docs show the developer still runs the initial git workflow (checkout -b, commit, push) to create the branch and open the PR (cubic-docs-51) — cubic is a review/fix layer, not an agent that autonomously stages changes, writes original commit messages, creates branches, or opens PRs from scratch. missing for 10: evidence of cubic independently creating a new branch, staging changes, and opening a brand-new pull request without a human first running git/opening the PR.

   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Generates PR descriptions based on code changes”
   • [claimed-docs] “cubic helps your team spend less time writing PR descriptions automatically by generating clear, concise summaries.”
   • [claimed-docs] “you can keep using normal Git commands exactly as before (e.g., `git checkout -b my-feature`, `git commit -m "message"`, `git push`). Using …”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”

   proof ↗⚑ flag

2. developerGet automatic code review with contextual feedback on every pull request

   weight 3 · round to Gemini CLI
   Gemini CLI✓fullcommunity8/10

   Gemini CLI's GitHub Actions integration explicitly provides automated PR code review with contextual feedback and suggestions, plus on-demand @gemini-cli assistance in PRs, and community reports corroborate favorable code review quality compared to competitors. Missing for 10: independent hands-on verification of the PR-review workflow specifically (most community feedback covers general CLI agentic use rather than the PR-review action itself), and no detail on configurability/false-positive rates.

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “@github List my open pull requests”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”

   proof ↗⚑ flag

   cubic~partialcommunity6/10

   cubic's docs strongly document automatic PR reviews with contextual comments, fixes, follow-up chat, and PR descriptions (cubic-docs-4, cubic-docs-25, cubic-docs-29, cubic-docs-45, cubic-docs-26). However, community hands-on feedback in the same threads is mixed: some praise the contextual quality (cubic-comm-1, cubic-comm-7) while others report low signal quality and skepticism about the marketing stats (cubic-comm-9, cubic-comm-10), so the real-world contextual value is not uniformly corroborated. Missing for 10: independent third-party benchmark of comment relevance, and consistent community consensus on comment quality rather than mixed reports.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Comments on bugs and improvements in pull requests”
   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “Generates PR descriptions based on code changes”
   • [community] “This looks like a cool solve for this problem. Some of the other tools I tried didn't seem to contextualize the app, so the comments were su…”
   • [community] “I've been testing this for the last few months, and it is now much quieter than before, and even more useful.”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”
   • [community] “When I read '51% fewer false positives' followed immediately by 'Median comments per pull request cut by half' it makes me wonder how many t…”

   proof ↗⚑ flag

3. developerInspect diffs and run checks to catch problems before merging

   weight 3 · round to cubic
   Gemini CLI~partialcommunity6/10

   Gemini CLI supports GitHub PR review automation with contextual feedback (gemini-cli-gh-10) and issue triage, plus community reports confirm it catches bugs reviewers missed (gemini-cli-comm-20), supporting diff inspection and pre-merge checks. However, there's no dedicated diff-viewing UI or built-in test/lint-running check suite documented, and community reports raise concerns about reliability, security prompts, and agentic mistakes (gemini-cli-comm-14, gemini-cli-comm-17). missing for 10: dedicated diff-inspection UI/commands, built-in CI/test-running integration, and stronger independent corroboration of reliability for pre-merge checks.

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “However, it does seem that Gemini pays less attention to security than Claude Code. Gemini will happily open in my root directory. Claude Co…”

   proof ↗⚑ flag

   cubic✓fullcommunity8/10

   cubic provides diff-focused PR review (hiding tests, force-push re-review), a CLI (`cubic review`) to check uncommitted changes before pushing, Ultrareview for deep multi-pass checks, and auto-fix/auto-approval gating before merge — directly matching 'inspect diffs and run checks before merging'. Community feedback corroborates real-world use but also raises concerns about comment relevance and false-positive rates, tempering confidence. Missing for 10: independent quantitative validation of bug-catch accuracy and resolution of noise/false-positive concerns raised by users.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “cubic now reviews the new changes after a force-push when it can safely compare them with a previously reviewed version.”
   • [claimed-docs] “Focus on implementation changes by hiding test files from the PR diff and file tree.”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”
   • [community] “I've been testing this for the last few months, and it is now much quieter than before, and even more useful.”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”

   proof ↗⚑ flag

Safe execution

1. engineering-leadControl which external tools and integrations the agent is allowed to access

   weight 2 · round to Gemini CLI
   Gemini CLI~partialcommunity5/10

   Gemini CLI supports configuring MCP servers via ~/.gemini/settings.json and exposes /tools and /mcp commands to inspect and manage available tools, giving engineering leads some control over which integrations are enabled. However, evidence lacks any centralized admin/policy control, allowlist/denylist enforcement, or org-wide governance mechanism for restricting tool access across a team, and community reports note weak security defaults (e.g. opening root directories without prompting). missing for 10: org-level/admin enforcement of tool allowlists, granular permission scoping per tool/integration, independent verification that access controls are robust rather than just configurable per-user.

   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”
   • [community] “However, it does seem that Gemini pays less attention to security than Claude Code. Gemini will happily open in my root directory. Claude Co…”

   proof ↗⚑ flag

   cubic—none0/10

   Evidence shows cubic has RBAC for subscription/settings management (cubic-docs-47) and cubic.yaml config for review behavior (cubic-docs-16/36), but nothing documents an engineering-lead controlling which external tools, MCP servers, or integrations the cubic agent itself is permitted to access. Missing for 10: any admin-facing tool/integration allowlist or permission gate for the agent's external tool access.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “cubic.yaml lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, an…”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”

   proof ↗⚑ flag

Security checks

1. engineering-leadSee license and public-code matching references for AI-suggested code

   weight 1 · round drawn
   Gemini CLI—none0/10

   No evidence anywhere in the pack of license attribution, public-code matching, or provenance references for AI-suggested code; features listed cover code editing, review, MCP, PR automation, etc. but nothing about license/originality detection.

   ⚑ flag

   cubic—none0/10

   cubic's evidence covers PR review, bug/vulnerability detection, custom agents, analytics, and codebase scans, but there is no mention of license compliance checking or public-code/plagiarism matching references for AI-suggested code. Missing for 10: license detection features, public-code/match provenance references, any SCA or license-compliance tooling.

   ⚑ flag

2. developerGet contextual explanations and automatic fixes for security vulnerabilities

   weight 2 · round to cubic
   Gemini CLI~partialclaimed4/10

   Gemini CLI offers general debugging/explanation via natural language (gh-3, gh-12) and automated PR review with 'contextual feedback and suggestions' (gh-10), plus vague 'enterprise advanced security and compliance' (gh-15), which could incidentally surface and explain security issues, but there is no evidence of a dedicated vulnerability-scanning or automatic-fix feature specifically for security flaws. Missing for 10: explicit vulnerability detection/scanning capability, documented automatic remediation of security issues, and independent verification that PR reviews catch/fix security vulnerabilities specifically.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Enterprise features: Advanced security and compliance”

   proof ↗⚑ flag

   cubic~partialcommunity7/10

   cubic's docs show explicit support for finding vulnerabilities (codebase scans, Ultrareview for 'security-sensitive changes'), contextual explanations (chat sidebar, 'tour this PR', reply-to-comment clarification), and automatic fixes ('Fix with cubic' pushes a fix commit; CLI generates fix prompts for coding agents). However there is no vendor or independent evidence specifically validating fix quality/accuracy for security vulnerabilities, and community comments raise general skepticism about comment relevance and false-positive rates for AI review tools of this class. missing for 10: security-specific hands-on validation of fix correctness, independent benchmarking on vulnerability detection/fix accuracy.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models, and typically takes a…”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Reply to a review comment to ask for clarification”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”
   • [community] “When I read '51% fewer false positives' followed immediately by 'Median comments per pull request cut by half' it makes me wonder how many t…”

   proof ↗⚑ flag