GitHub Copilot vs Gemini CLI

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialprobed6/10

   Probes confirm docs.github.com serves an llms.txt file and a .md-formatted docs page, meaning an agent pointed at docs.github.com could consume agent-oriented docs directly; GitHub also documents MCP server usage for structured context. However, there's no evidence Copilot itself is documented to consume llms.txt as part of its own context-gathering workflow, nor first-party guidance recommending llms.txt for agent use. missing for 10: explicit product documentation instructing users/agents to point Copilot at llms.txt, and independent confirmation this integration is actually used in practice.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.github.com/llms.txt # GitHub Docs > GitHub is a developer platform for building, shipping, and mai…”
   • [probe] “PROBE docs-md: HTTP 200 at https://docs.github.com/copilot.md # GitHub Copilot documentation You can use GitHub Copilot to enhance your pro…”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “Learn how to use the GitHub Model Context Protocol (MCP) server to interact with repositories, issues, pull requests, and other GitHub featu…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence Gemini CLI has any documented feature for consuming llms.txt or agent-oriented doc manifests; the only related probe shows llms.txt returning 404 on Google's own docs site, and none of the GitHub feature list or docs mention llms.txt support. GEMINI.md context files are a different, project-local mechanism, not agent-oriented web docs discovery.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to Gemini CLI
   GitHub Copilot~partialprobed7/10

   GitHub Copilot ships a CLI for terminal/headless use and a 'cloud agent' with 'automations' that can run on a schedule or in response to repo events (e.g., issue opened), plus isolated cloud/local sandboxes for execution — all of which enable non-interactive, CI-like automation. However, evidence doesn't show explicit CI pipeline (e.g., GitHub Actions) integration steps or a documented non-interactive/scriptable flag set for true headless scripting. Missing for 10: documented CI/Actions integration examples, explicit non-interactive/headless CLI flags, and independent hands-on confirmation of automation running unattended in CI.

   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [probe] “official CLI documented at https://docs.github.com/en/copilot/how-tos/copilot-cli/set-up-copilot-cli/install-copilot-cli”

   proof ↗⚑ flag

   Gemini CLI✓fullclaimed9/10

   Gemini CLI explicitly documents non-interactive scripting mode, structured/streaming JSON output flags for programmatic parsing, and GitHub Actions-based automation (PR reviews, issue triage, on-demand assistance), which together cover headless/CI use cases well. Missing for 10: independent hands-on confirmation specifically of CI pipeline reliability (community evidence focuses more on interactive agentic quality than CI usage).

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

3. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed9/10

   GitHub Copilot documents direct MCP server integration: connecting MCP servers to Copilot Chat to extend context/tools, creating custom MCP servers, using the official GitHub MCP server, and admin controls (allow lists) for which MCP servers developers can access. This is well-documented first-party capability across IDE and chat surfaces. missing for 10: independent hands-on community verification of MCP tool usage in practice (community evidence pack is mostly about code suggestion quality/licensing, not MCP specifically).

   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”
   • [claimed-docs] “Learn how to use the GitHub Model Context Protocol (MCP) server to interact with repositories, issues, pull requests, and other GitHub featu…”
   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”
   • [claimed-docs] “Copilot works where you do—in GitHub, your IDE, the CLI, project tools, chat apps, and custom MCP servers.”

   proof ↗⚑ flag

   Gemini CLI✓fullclaimed8/10

   Gemini CLI documents first-party MCP server support: configuring servers in ~/.gemini/settings.json to add custom tools, a dedicated /mcp command, and explicit mention of connecting media-generation tools like Imagen/Veo/Lyria via MCP. This is corroborated by official docs listing /mcp among CLI commands. Missing for 10: independent hands-on verification of MCP tool usage specifically (community evidence covers general agentic reliability but not MCP integration itself), and more detail on server management/discovery UX.

   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”

   proof ↗⚑ flag

4. ai-native userUse an official CLI

   weight 2 · round to Gemini CLI
   GitHub Copilot✓fullprobed8/10

   GitHub Copilot ships an official CLI documented at docs.github.com, letting users invoke Copilot directly from the terminal with prompt/voice input, corroborated by a dedicated install guide probe. missing for 10: independent hands-on community review of the CLI itself (community evidence only covers older chat/agent features, not the CLI), and no detail on CLI feature parity with IDE agent mode.

   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [claimed-docs] “As an alternative to typing, you can speak your prompt.”
   • [probe] “official CLI documented at https://docs.github.com/en/copilot/how-tos/copilot-cli/set-up-copilot-cli/install-copilot-cli”
   • [claimed-docs] “GitHub Copilot is also supported in terminals through GitHub CLI and as a chat integration in Windows Terminal Canary.”

   proof ↗⚑ flag

   Gemini CLI✓fullprobed9/10

   Gemini CLI is itself an official, first-party CLI product by Google with extensive documentation of its features (scripting, JSON output, MCP support, context files, non-interactive mode) and independent corroboration of active use, confirming it exists and functions as an official CLI tool for AI-native workflows. missing for 10: no fully independent third-party audit of CLI completeness beyond community anecdotes.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “gemini --include-directories ../lib,../docs”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [probe] “official CLI documented at https://developers.google.com/gemini-code-assist/docs/gemini-cli”

   proof ↗⚑ flag

5. ai-native userDrive the product through a documented public API

   weight 3 · round to Gemini CLI
   GitHub Copilot~partialprobed3/10

   GitHub Copilot ships a documented CLI (docs-26, probe-4) that lets scripts/agents invoke Copilot from a terminal, and Copilot Chat can be extended via MCP servers (docs-20/21/25), giving some programmatic hooks. However, an explicit probe for a standard OpenAPI/public API spec returned 404s (probe-3), and no REST/GraphQL API for driving Copilot itself is documented in the evidence. Missing for 10: a dedicated, versioned public API (REST/GraphQL/OpenAPI) for programmatically controlling Copilot beyond CLI/MCP, and independent confirmation of its stability/coverage.

   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [probe] “official CLI documented at https://docs.github.com/en/copilot/how-tos/copilot-cli/set-up-copilot-cli/install-copilot-cli”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.github.com/openapi.json, https://docs.github.com/swagger.json, https://docs.github.com/…”

   proof ↗⚑ flag

   Gemini CLI~partialprobed5/10

   Gemini CLI documents CLI-level automation hooks — non-interactive scripting mode, `--output-format json`/`stream-json` for structured output, and MCP server configuration — which let an AI-native user drive it programmatically (gemini-cli-gh-6, gh-17, gh-18, gh-19). However, explicit probes for a formal public API/SDK (llms.txt, openapi.json) all returned 404, showing no dedicated documented API surface beyond the CLI itself. Missing for 10: a first-party REST/SDK API spec, official API reference docs, and independent confirmation of programmatic (non-CLI) usage.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

6. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed3/10

   Evidence shows governance-adjacent controls like MCP server allow lists and a central control plane with audit logs for managing agents (docs-10, docs-23), but there is no explicit documentation of issuing scoped or least-privilege API credentials/tokens specifically for an agent's actions. Missing for 10: explicit scoped API credential/token issuance mechanism for agents, fine-grained permission scoping documentation, and independent verification that these controls limit agent API access at a credential level rather than just access-list level.

   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”
   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Evidence shows Gemini CLI abstracts away API key management entirely (sign in with Google account) rather than offering scoped or least-privilege credential issuance for agents; no docs mention credential scoping, permission boundaries, or token minting for agent use.

   • [github] “No API key management - just sign in with your Google account”

   proof ↗⚑ flag

7. ai-native userBuild against official SDKs

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed4/10

   Evidence shows extensibility surfaces (MCP server integration, custom agents, partner 'agent apps') that let developers build on top of Copilot, but there is no dedicated official SDK (e.g., language client libraries or API SDK docs) described in the pack. missing for 10: explicit official SDK/client-library docs, code samples for building third-party apps against a Copilot API, independent developer confirmation of SDK usage.

   • [claimed-docs] “Agent apps let you use partner-built agents directly in your workflows on GitHub, powered by your Copilot subscription.”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”
   • [claimed-docs] “Custom agents allow you to tailor Copilot's expertise for specific tasks.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   The evidence pack documents CLI flags, MCP server extensibility, scripting output formats, and GitHub Actions integration, but contains no mention of an official SDK (e.g., a Node/Python/Go library) for programmatically building on Gemini CLI itself. Probes for API/OpenAPI specs also returned 404s, reinforcing the absence of such artifacts.

   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

8. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   GitHub Copilot—none0/10

   Evidence shows Copilot 'automations' can be triggered by repository events (e.g., issue opened) [docs-33, docs-15], but this is Copilot reacting to GitHub events, not an API/webhook mechanism for an external AI-native user to subscribe to Copilot's own events. No documentation describes a webhook subscription endpoint or event payload schema for consuming Copilot activity.

   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence of webhook subscription or event-push capability; Gemini CLI supports non-interactive scripting, MCP tool servers, and structured JSON output, but nothing about outbound webhooks or event subscriptions. Missing for 10: any webhook registration mechanism, event subscription API, or documentation of push notifications.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullcommunity8/10

   Copilot generates AI insights/suggestions from the user's own code and repository data via code completion, chat with repo/doc context, code review with severity-labeled comments, and Autofix vulnerability suggestions, and can pull context from GitHub issues/PRs/docs via MCP. Community anecdotes (comm-1, comm-6, comm-7) corroborate real productivity gains from these suggestions, though some criticize suggestion quality on edge cases (comm-2, comm-10). Missing for 10: independent benchmark data quantifying insight accuracy/usefulness and no first-party analytics-style 'insights dashboard' beyond code review/Autofix.

   • [claimed-docs] “Scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories.”
   • [claimed-docs] “GitHub Copilot Autofix provides contextual explanations and code suggestions to help developers fix vulnerabilities in code”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “Learn how to use the GitHub Model Context Protocol (MCP) server to interact with repositories, issues, pull requests, and other GitHub featu…”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [community] “I've been using the alpha for the past 2 weeks, and I'm blown away. Copilot guesses the exact code I want about one in ten times... when it …”
   • [community] “I have absolutely loved copilot so far. I especially love how fast it handles indexing complex n-dimensional arrays... I'd estimate a 10% ve…”
   • [community] “Yesterday, Copilot could not write a program with SymPy... Today it uses SymPy as well as it uses NumPy (occasional mistakes, but overall it…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI ships features that clearly aim at generating insights from a user's own data/codebase — querying and editing large codebases, natural-language debugging, automated PR review with contextual feedback, and issue triage (gemini-cli-gh-1, gh-3, gh-10, gh-11), and one community report praises its code review as catching bugs missed by humans (gemini-cli-comm-20). However, multiple hands-on reports directly contradict this, describing it as 'terrible at agentic stuff', getting stuck in loops, failing to edit/read files, and being 'useless as a coding assistant' that produces spaghetti code (gemini-cli-comm-10, comm-14, comm-15). missing for 10: independent benchmark confirming consistent quality of generated insights, resolution of the loop/failure reports, and evidence the insight-generation works reliably across data types beyond code.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   GitHub Copilot's cloud agent explicitly supports background automation: docs describe running Copilot 'automatically, on a schedule or in response to events in a repository' and working 'independently in the background to complete tasks, just like a human developer,' with a control plane to track multiple agent sessions. This directly matches the story of autonomous background automations for an AI-native user. Missing for 10: independent/community hands-on validation specifically of the scheduled/event-triggered automation feature (most community evidence is about code completion quality, not the cloud-agent automation flow).

   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity6/10

   Gemini CLI documents non-interactive scripting mode and a GitHub Action integration that runs autonomously in the background (automated PR reviews, issue triage, on-demand @gemini-cli responses), which directly supports background automations. However, independent community reports describe agentic reliability problems (getting stuck in loops, failing simple file operations, ignoring GEMINI.md context) that undercut confidence in unattended/background runs actually completing correctly. Missing for 10: independent hands-on validation that scheduled/background automations run reliably end-to-end, and more detail on failure/retry handling in autonomous mode.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “@github List my open pull requests”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullcommunity9/10

   GitHub Copilot ships extensive built-in agentic capabilities: agent mode in editors, cloud/background agents that plan-explore-execute autonomously, @copilot mentions on PRs, automations, custom agents, and a CLI, all documented first-party. Community evidence corroborates hands-on usage of the assistant delivering real productivity gains, supporting the delegation story. Missing for 10: independent hands-on validation specifically of the newer autonomous cloud-agent/background task delegation (most community evidence predates these agentic features).

   • [claimed-docs] “Edit files in your workspace in agent mode”
   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [community] “I have absolutely loved copilot so far. I especially love how fast it handles indexing complex n-dimensional arrays... I'd estimate a 10% ve…”
   • [community] “Yesterday, Copilot could not write a program with SymPy... Today it uses SymPy as well as it uses NumPy (occasional mistakes, but overall it…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI is itself billed as an agentic assistant with extensive task-delegation features (codebase queries, debugging, PR review/issue triage, operational automation via @gemini-cli mentions) per gemini-cli-gh-3/4/10/11/12/22. However, hands-on community reports concretely contradict reliable delegation: users report it is 'really really terrible at agentic stuff,' gets stuck in permanent loops, ignores GEMINI.md context, and in one case catastrophically deleted user files while apologizing for the failure.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullcommunity8/10

   GitHub Copilot offers natural-language interaction across chat, agent mode, CLI, and even voice input, letting users direct edits, reviews, and autonomous tasks conversationally (docs-2, docs-22, docs-26, docs-27). Community evidence corroborates real usage of chat/agent workflows, though some report chat availability limited to specific IDEs and mixed quality of autonomous 'fix the bug' style commands. Missing for 10: independent hands-on validation of natural-language command robustness across all surfaces (mobile, terminal) and no rigorous benchmark of command success rate.

   • [claimed-docs] “Edit files in your workspace in agent mode”
   • [claimed-docs] “chat functionality is currently available only in Visual Studio Code, JetBrains, and Visual Studio”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [claimed-docs] “As an alternative to typing, you can speak your prompt.”
   • [community] “The first video in this post is a perfect example of the problems I see in this space. First the programmer asks the AI to nebulously 'fix t…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI's entire premise is natural-language driven coding/agentic actions (querying codebases, debugging, automating PR/rebase tasks, custom GEMINI.md context) per gemini-cli-gh-1/3/4/9. However, multiple hands-on reports describe the NL-agent behavior failing badly in practice — getting stuck in error loops, botching file edits, ignoring GEMINI.md instructions, and in one case catastrophically deleting user data via misinterpreted commands.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   GitHub Copilot—none0/10

   The evidence pack shows no interactive API reference or runnable-example explorer for GitHub Copilot; a direct probe for OpenAPI/Swagger specs returned 404s on all candidate paths, and docs are plain markdown/text pages rather than an interactive API console.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.github.com/openapi.json, https://docs.github.com/swagger.json, https://docs.github.com/…”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.github.com/llms.txt # GitHub Docs > GitHub is a developer platform for building, shipping, and mai…”
   • [probe] “PROBE docs-md: HTTP 200 at https://docs.github.com/copilot.md # GitHub Copilot documentation You can use GitHub Copilot to enhance your pro…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence of an interactive API reference with runnable examples; probes explicitly show no llms.txt or OpenAPI spec found, and no docs describe an interactive reference tool.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   GitHub Copilot—none0/10

   The evidence pack shows explicit probe attempts to find an OpenAPI/machine-readable spec for GitHub Copilot's docs (openapi.json, swagger.json, etc.) all returning 404, and no other citation mentions a downloadable API spec for Copilot. No documentation or community evidence confirms a machine-readable spec exists.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.github.com/openapi.json, https://docs.github.com/swagger.json, https://docs.github.com/…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Probes explicitly show no OpenAPI/llms.txt spec is published (404s at all candidate paths), and no other evidence mentions a machine-readable API spec for Gemini CLI.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

3. ai-native userTest against a sandbox environment without touching production data

   weight 1 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed7/10

   GitHub Copilot explicitly documents that its cloud and local agent execution occurs in isolated sandboxes ('Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network resources securely on your local machine or in fully isolated cloud environments'), directly matching the story of testing/agentic work without touching production systems. Missing for 10: independent/hands-on verification of sandbox isolation guarantees, and explicit mention of protecting 'production data' specifically rather than just execution environment isolation.

   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence pack items describe a sandbox/test environment isolated from production data for Gemini CLI; the only mention of 'sandbox' appears in an unrelated community comment describing another tool's architecture, not Gemini CLI's own testing environment. missing for 10: dedicated sandbox mode/documentation, evidence of isolation from production data, any hands-on confirmation of safe test environments.

   ⚑ flag

4. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   GitHub Copilot—none0/10

   The evidence pack contains no documentation of a versioned API or deprecation policy for GitHub Copilot; the OpenAPI probe explicitly found all candidate spec paths returning 404, and no other citation addresses API versioning/deprecation commitments.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.github.com/openapi.json, https://docs.github.com/swagger.json, https://docs.github.com/…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence of versioned APIs or a documented deprecation policy for Gemini CLI; probes for llms.txt/openapi specs 404, and there is community evidence the tool itself was abruptly deprecated with no policy discussion (gemini-cli-comm-6/7/8), but no documentation of API versioning or deprecation commitments exists.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”
   • [community] “Welcome to the Google graveyard, Gemini CLI. Not that it will be missed much. Using it was the worst experience out of any harness.”
   • [community] “Google really can't help themselves but to have some internal re-org kill off a public thing people are actively using. It's honestly impres…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Gemini CLI
   GitHub Copilot~partialclaimed5/10

   Docs show Copilot can run multiple background cloud-agent sessions in parallel, track them from one control page, and trigger automations on repo events/schedules (docs-8, docs-14, docs-15, docs-33), which supports scaling to many tasks, but there's no explicit evidence of a single bulk command/batch operation (e.g., 'review 50 PRs at once' or 'fix all issues matching X') as a discrete feature. Missing for 10: an explicit bulk-action UI/API (e.g., batch PR review, batch issue triage) and independent confirmation that many items can be processed in one invocation rather than via separate parallel agent sessions.

   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity6/10

   Gemini CLI supports scripting/non-interactive automation, multi-directory context inclusion, structured JSON output for pipelines, and GitHub Action integrations like automated issue triage (bulk labeling/prioritization) and PR review across a repo — all pointing to bulk/batch style operations. However there's no explicit documented 'batch process N files/items' feature or example, and community reports note the agent can get stuck in loops or fail simple multi-step tasks, raising doubts about reliability at scale. Missing for 10: explicit bulk-operation examples/documentation (e.g., batch renaming, mass refactor across many files) and independent evidence confirming reliable execution at scale.

   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “gemini --include-directories ../lib,../docs”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   GitHub Copilot documents event/schedule-triggered automations for its cloud agent ('run Copilot cloud agent automatically, on a schedule or in response to events in a repository', 'in response to events such as an issue being opened'), plus @mention-triggered PR actions, matching the story's rule-based automatic action pattern. Missing for 10: no independent/hands-on validation of the automation reliability or examples of complex rule chains beyond schedule/issue triggers.

   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed5/10

   Gemini CLI ships GitHub Action integrations that fire automatically on repo events (PR opened → automated review, issue created → automated triage, @mention → on-demand help), which is a form of event-triggered automation, plus non-interactive/scripted execution for pipelines. However there's no evidence of a general-purpose, user-defined rule/trigger engine (e.g., custom webhooks, cron-like conditions, arbitrary event types) within the CLI itself—only fixed GitHub-event integrations. Missing for 10: a generic rule-definition mechanism for arbitrary events, documentation of custom trigger conditions, and independent confirmation these automations work reliably (community notes reliability issues with agentic behavior).

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Run non-interactively in scripts for workflow automation”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed7/10

   GitHub Copilot docs explicitly describe 'Automations' that run the cloud agent on a schedule or in response to repository events, allowing recurring/scheduled agent workflows, plus a control page to track multiple scheduled agent sessions. This directly matches the story of scheduling recurring jobs/workflows. Missing for 10: independent/hands-on corroboration of scheduling reliability, and more detail on cron-like configuration options or failure handling.

   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed4/10

   Gemini CLI supports non-interactive scripted runs and structured JSON output, which lets users wire it into external schedulers (cron, CI) for recurring automation, and its GitHub Action integrations (issue triage, PR review) imply repeatable, trigger-based workflows. However there is no first-party 'scheduled job' or cron feature documented within the CLI itself. Missing for 10: a native recurring-job/scheduler feature, explicit docs on scheduling cadence, and independent confirmation that scripted/CI-triggered runs work reliably for recurring automation.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”

   proof ↗⚑ flag

4. ai-native userVersion, review, and roll back my automations

   weight 1 · round to GitHub Copilot
   GitHub Copilot~partialclaimed5/10

   Copilot's cloud-agent automations produce PRs that can be reviewed (code review feature, docs-28/29) and tracked via audit logs and a central control plane (docs-23), and since output flows through Git, changes are inherently versioned and revertible via standard PR/commit mechanics. However, there is no direct evidence of a dedicated versioning or rollback mechanism for the automation definitions/schedules themselves (e.g., automation history, revert-to-previous-config). missing for 10: explicit versioning/rollback UI for automation configs, evidence of rolling back an automation run itself (not just its code output), independent confirmation of this workflow in practice.

   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed4/10

   Gemini CLI offers conversation checkpointing to save and resume sessions (gemini-cli-gh-8), which provides a rudimentary rollback/resume mechanism, but there is no evidence of versioning, diffing, or reviewing automation scripts/workflows themselves, nor a dedicated rollback command for automations. missing for 10: explicit version history for automations, review/diff tooling, and a documented rollback mechanism beyond session checkpoints.

   • [github] “Conversation checkpointing to save and resume complex sessions”

   proof ↗⚑ flag

Background execution

1. ai-native userHave a cloud agent build, test, and demo a feature end-to-end for my review

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed7/10

   Docs describe a genuine cloud agent that works independently in the background (assign tasks, plan/explore/execute), runs in isolated cloud sandboxes to interact with code/tools/filesystem, and produces PRs for review with automated code review and severity-labeled feedback — covering build, execute, and review end-to-end. However, 'testing' and 'demo' are only implied (sandbox execution, PR review) rather than explicitly documented as a testing/demo step, and there is no independent/hands-on corroboration of the cloud agent specifically completing a full feature end-to-end (community evidence predates/doesn't cover the cloud agent feature). Missing for 10: explicit test-running/verification evidence, a documented demo/preview mechanism, and independent hands-on validation of cloud agent outcomes.

   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Access to Cloud agent and code review”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity4/10

   Gemini CLI documents cloud-adjacent automation via its GitHub Actions integration (PR reviews, issue triage, @gemini-cli on-demand assistance, non-interactive scripting) which could kick off agentic work, but there is no vendor evidence of an autonomous cloud agent that builds, runs tests, and produces a demo end-to-end for review. Community reports also describe agentic mode getting stuck in error loops, failing at basic file edits, and even causing data loss, undercutting confidence in reliable autonomous execution. missing for 10: explicit end-to-end build+test+demo workflow, evidence of a hosted/cloud agent (vs local CLI or CI hooks) producing a reviewable demo, and independent confirmation that autonomous runs complete without failure loops.

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Run non-interactively in scripts for workflow automation”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

2. developerDelegate longer-running coding tasks to run in the background in an isolated cloud environment

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   Copilot cloud agent is well documented as delegating tasks to run autonomously in an isolated cloud sandbox, working independently in the background like a human developer, with scheduling/automations, a control page to track multiple sessions, and audit logs for governance. missing for 10: independent hands-on community verification of cloud agent reliability/performance (community evidence pack predates cloud agent feature and doesn't corroborate this specific capability).

   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Access to Cloud agent and code review”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed4/10

   Gemini CLI supports non-interactive scripting and GitHub Actions integration (@gemini-cli mentions for PR reviews, issue triage, on-demand assistance) which can run tasks in a cloud CI environment, and Cloud Shell offers a ready cloud runtime — but there's no dedicated 'run this long task in an isolated background cloud sandbox' feature akin to a hosted agent service. missing for 10: explicit isolated cloud sandbox/background execution product, evidence of long-running autonomous task delegation outside CI triggers, and independent confirmation it works reliably for extended background jobs.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”

   proof ↗⚑ flag

3. developerConfigure a reproducible cloud environment with the dependencies and setup steps my repository needs

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed4/10

   Docs mention 'Cloud and local sandboxes provide isolated execution environments' for Copilot cloud agent and background task automation, implying some environment abstraction, but there is no explicit evidence of a mechanism (e.g., a setup-steps config, devcontainer, or dependency manifest) for developers to define reproducible cloud environment setup steps. Missing for 10: explicit documentation of a configuration file/workflow for specifying dependencies/setup steps, independent confirmation of reproducibility across runs.

   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Evidence shows Gemini CLI can run in Cloud Shell without extra setup and supports GEMINI.md context files, but there is no evidence of a configurable, reproducible cloud environment (e.g., dependency/setup scripts, devcontainer-style config) that a developer can define for their repo. Missing for 10: any documented environment/setup-script configuration mechanism, evidence of reproducibility across runs, and independent confirmation it works as such.

   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”

   proof ↗⚑ flag

Parallel agents

1. ai-native userLaunch fleets of autonomous agents that work in parallel on different tasks for hours or days

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed6/10

   GitHub Copilot's cloud agent supports background autonomous work, scheduled/event-triggered automations, and a control page to track and manage multiple agent sessions in parallel (docs-8, docs-14, docs-15, docs-31, docs-33), which covers the 'fleets working in parallel' concept. However, evidence doesn't confirm true multi-hour/multi-day persistent autonomous runs at scale or independent hands-on validation of large fleets; most evidence is vendor docs rather than field reports. missing for 10: independent/hands-on confirmation of long-running (hours/days) parallel agent fleets, concrete scale limits or examples of many simultaneous agents, and community verification of duration/reliability at scale.

   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Evidence shows single-session non-interactive scripting, GitHub Actions integration for issue triage/PR review, and MCP extensibility, but nothing about launching multiple autonomous agents working in parallel for hours or days. No fleet/orchestration/multi-agent parallelism capability is documented anywhere in the pack.

   ⚑ flag

2. developerRun several task attempts in parallel and compare results before choosing one

   weight 1 · round to GitHub Copilot
   GitHub Copilot~partialclaimed5/10

   Copilot's cloud/background agents support launching and tracking multiple agent sessions in parallel from a single control page and desktop workspace (docs-8, docs-14, docs-31), which enables running concurrent tasks. However, there's no explicit documentation of running multiple attempts of the *same* task and comparing outputs before selecting one—the evidence describes managing distinct tasks/agents, not competing solutions to a single task. Missing for 10: explicit multi-attempt-per-task workflow, UI for side-by-side comparison of alternative solutions, and any hands-on/community confirmation of this specific parallel-attempt-and-choose pattern.

   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence in the pack describes running multiple parallel task attempts or comparing/diffing results before selecting one; features listed are single-session tools (checkpointing, MCP, scripting) with no multi-attempt/parallel comparison workflow mentioned. Missing for 10: any mention of parallel run/branching feature, a comparison UI or mechanism to pick the best of several attempts.

   ⚑ flag

Scheduled automation

1. ai-native userSet up always-on agents that run on schedules or triggers to maintain and fix my software autonomously

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   GitHub Copilot explicitly documents scheduled/event-triggered cloud agents ('Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository') that work independently in the background, plus a control plane to track/manage multiple agent sessions and sandboxed execution environments. This directly matches the always-on, autonomous, schedule/trigger-driven maintenance story. Missing for 10: independent/hands-on verification of scheduled agent runs actually fixing software autonomously in production, and more detail on trigger types beyond issue-opened examples.

   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity4/10

   Gemini CLI supports non-interactive scripted runs and GitHub Actions-based triggers (PR reviews, issue triage, @mention on-demand assistance) which can approximate scheduled/triggered automation, but there is no evidence of a persistent, self-scheduling 'always-on agent' that autonomously maintains and fixes software over time. missing for 10: native scheduler/cron support, persistent agent daemon or watch-mode, evidence of autonomous multi-cycle maintenance without human triggering, and reliability data (community reports actually describe agent mode getting stuck in loops or failing tasks).

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”

   proof ↗⚑ flag

Debugging

1. developerDebug a live running web application directly from my coding assistant

   weight 1 · round to Gemini CLI
   GitHub Copilot—none0/10

   Evidence covers code completion, chat, agent mode file edits, cloud agents, code review, and MCP integrations, but nothing about attaching to or debugging a live running web application (e.g., runtime inspection, breakpoints, log/trace analysis of a running process). No evidence supports this capability.

   ⚑ flag

   Gemini CLI~partialcommunity3/10

   Gemini CLI advertises general 'Debug issues and troubleshoot with natural language' capability and MCP extensibility that could in theory connect to browser/dev tools, and one community comment references an internal 'browser control stack,' but there is no first-party or hands-on evidence of live web-app debugging (e.g., attaching to a running app, inspecting DOM/network/console, or browser automation workflows). Missing for 10: explicit live-app/browser debugging workflow docs, DevTools or runtime inspection integration, and hands-on confirmation of debugging a running web app.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [community] “All in all, a 140 MB Go binary with its own browser control stack, sandbox, Git, language detector, skills runtime, and subagent system. I'm…”

   proof ↗⚑ flag

2. developerDebug issues and troubleshoot using natural-language queries

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed7/10

   Copilot Chat explicitly supports natural-language interaction for explaining concepts, code review with prioritized issue severity, and agent mode for autonomous exploration and fixing—core debugging/troubleshooting workflows (docs-4, docs-22, docs-28, docs-29). Autofix also provides contextual explanations for vulnerabilities (docs-13), reinforcing NL-driven troubleshooting. missing for 10: a dedicated 'debug' feature description, independent hands-on evidence specifically validating debugging accuracy/success (community evidence focuses on completion quality and licensing concerns, not debugging).

   • [claimed-docs] “chat functionality is currently available only in Visual Studio Code, JetBrains, and Visual Studio”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “GitHub Copilot Autofix provides contextual explanations and code suggestions to help developers fix vulnerabilities in code”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI explicitly advertises natural-language debugging/troubleshooting (gemini-cli-gh-3, gh-12/21/23) and community reports confirm strong codebase navigation and code-review value (gemini-cli-comm-1, comm-20). However, multiple hands-on reports directly contradict reliable debugging: users describe it getting stuck in error loops, failing simple file edits, and in one case catastrophically deleting user data during a troubleshooting session (gemini-cli-comm-10, comm-11, comm-14, comm-16).

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

Feature implementation

1. developerTurn a tracked issue into a complete pull request end-to-end

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   GitHub Copilot's cloud agent can be assigned directly from an issue or via @copilot mentions, working autonomously to plan, explore, execute changes, and open a pull request, with automations to trigger this on issue events; the desktop workspace lets developers track, review, and merge the resulting PR end-to-end. missing for 10: independent hands-on verification of the full issue-to-merged-PR flow (community evidence covers earlier code-completion/chat era, not cloud agent specifically) and concrete success-rate data on autonomous PR quality.

   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI's GitHub integration supports @gemini-cli task delegation from issues/PRs, automated PR reviews, and issue triage, which vendor docs frame as enabling issue-to-PR workflows (gh-12, gh-21, gh-10, gh-22, gh-4). However, hands-on community reports describe the agent getting stuck in loops, failing basic file edits, lacking a plan mode, and producing 'spaghetti code' rather than completing tasks reliably — directly undermining claims of smooth end-to-end PR generation (gemini-cli-comm-10, gemini-cli-comm-11, gemini-cli-comm-14). Missing for 10: a documented full issue→PR walkthrough, evidence of successful autonomous PR creation from an issue, and independent confirmation resolving the agentic reliability complaints.

   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “@github List my open pull requests”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”

   proof ↗⚑ flag

2. developerDescribe a feature or bug in plain language and have the agent implement or fix it across multiple files

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullcommunity8/10

   Docs describe Copilot agent mode editing files across the workspace, cloud agents that plan/explore/execute tasks autonomously (including from plain-language issue/PR descriptions via @copilot mentions), and code review/autofix capabilities, directly matching the story of describing a feature/bug and having it implemented across multiple files. Community evidence corroborates real usage of the agent for multi-file/complex code tasks, though some hands-on reports note quality limitations on nuanced 'fix the bug' requests. Missing for 10: rigorous independent benchmarking of multi-file correctness and more first-hand accounts specifically of cross-file feature implementation success/failure rates.

   • [claimed-docs] “Edit files in your workspace in agent mode”
   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [community] “The first video in this post is a perfect example of the problems I see in this space. First the programmer asks the AI to nebulously 'fix t…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Vendor docs/GitHub claim strong support for describing features/bugs in plain language and having the agent edit/debug across large codebases (gemini-cli-gh-1, gemini-cli-gh-3), but multiple hands-on community reports directly contradict this: users report the agent getting stuck in error loops, failing basic file edit/read operations, ignoring GEMINI.md context files, jumping straight into 'spaghetti code' without a plan mode, and in one case catastrophically deleting user data via botched commands. missing for 10: consistent hands-on success stories on multi-file feature implementation, resolution of the reported reliability/looping failures, and independent benchmarks confirming multi-file bug-fix accuracy.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

Maintenance automation

1. developerHave the agent write tests, fix lint errors, resolve merge conflicts, and update dependencies for me

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   Copilot's agent mode edits files, validates changes, and can autonomously plan/execute tasks (docs-2,3,22,31), code review with severity-labeled feedback and suggested fixes covers lint/quality issues (docs-28,29), and @copilot on PRs plus cloud agent covers merge conflict resolution and general code changes (docs-32). Dependency updates and explicit test-writing aren't separately documented as named features, so this is inferred from general-purpose agent code editing rather than a dedicated capability. missing for 10: explicit documented examples of writing tests, resolving merge conflicts, and updating dependencies as named use cases, and independent hands-on confirmation of these specific tasks.

   • [claimed-docs] “Edit files in your workspace in agent mode”
   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   GitHub docs claim broad code-editing, debugging, and complex-rebase (merge conflict) automation capabilities (gemini-cli-gh-1, gemini-cli-gh-3, gemini-cli-gh-4), which would cover fixing lint issues and dependency/test work as part of general codebase editing, and PR review/issue triage features suggest lint-like feedback (gemini-cli-gh-10, gemini-cli-gh-11). However, multiple hands-on community reports concretely contradict reliable agentic code work: users report it getting stuck in error loops, failing simple file edit/read operations, ignoring GEMINI.md context files, producing 'spaghetti code' with no plan mode, and in one case catastrophically deleting user data during a file operation (gemini-cli-comm-10, gemini-cli-comm-11, gemini-cli-comm-13, gemini-cli-comm-14, gemini-cli-comm-16). No explicit evidence names test-writing, lint-fixing, or dependency-updating tasks specifically. Missing for 10: explicit documentation/examples of writing tests, fixing lint errors, or updating dependencies, and independent corroboration that these specific tasks work reliably.

   • [github] “Query and edit large codebases”
   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

Multimodal generation

1. ai-native userGenerate a working app from a sketch, image, or PDF design

   weight 2 · round to Gemini CLI
   GitHub Copilot—none0/10

   No evidence that Copilot can take a sketch, image, or PDF design and generate a working app from it; documentation focuses on code completion, chat, agent mode, cloud agents, and MCP integration, with no mention of image/PDF-to-code or multimodal design-to-app generation.

   ⚑ flag

   Gemini CLI~partialcommunity6/10

   Official docs explicitly claim 'Generate new apps from PDFs, images, or sketches using multimodal capabilities,' directly matching the story, but there is no independent/hands-on corroboration of this specific capability, and broader community feedback raises general concerns about agentic reliability that could affect complex generation tasks. missing for 10: independent hands-on demonstration of sketch/PDF-to-app generation, details on fidelity/limitations of this workflow.

   • [github] “Generate new apps from PDFs, images, or sketches using multimodal capabilities”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”

   proof ↗⚑ flag

Codebase mapping

1. developerUnderstand how a codebase fits together to find where to start making changes

   weight 3 · round to GitHub Copilot
   GitHub Copilot~partialclaimed5/10

   Copilot Chat in the editor is documented to explain concepts and provide context-aware help (docs-22), and enterprise features let teams build a 'shared source of truth' from docs and repos (docs-9) plus MCP integrations that pull in repo/issue/PR context (docs-20, docs-21, docs-25), all of which support exploring an unfamiliar codebase. However, there is no explicit feature description of codebase-wide indexing, dependency/architecture mapping, or a dedicated 'explain this repo' capability, and no hands-on community evidence confirming it helps developers orient in large codebases. Missing for 10: dedicated codebase-mapping/semantic search feature docs, explicit onboarding/architecture-understanding use case, and independent corroboration of effectiveness.

   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “Scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories.”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”
   • [claimed-docs] “Learn how to use the GitHub Model Context Protocol (MCP) server to interact with repositories, issues, pull requests, and other GitHub featu…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI advertises large-codebase querying/editing (gemini-cli-gh-1) with a 1M-token context window, custom GEMINI.md context files, and --include-directories flags for scoping (gemini-cli-gh-9, gemini-cli-gh-16), and one HN user praises its ability to 'navigate and learn' large codebases effortlessly (gemini-cli-comm-1). However, other hands-on users report the opposite: it is 'stupid at navigation in the codebase' taking 10x longer (gemini-cli-comm-15) and 'consistently ignores' the GEMINI.md context file despite claiming to use it (gemini-cli-comm-13), directly undercutting the codebase-understanding claim. Missing for 10: consistent independent corroboration of reliable codebase navigation, and no contradicting failure reports.

   • [github] “Query and edit large codebases”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [github] “gemini --include-directories ../lib,../docs”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

2. developerHave the agent map and explain an entire unfamiliar codebase without manually selecting context files

   weight 3 · round to GitHub Copilot
   GitHub Copilot~partialclaimed5/10

   Copilot's agent mode and cloud agent are documented to 'plan, explore, and execute work autonomously' across a repo, and 'skills' let it perform specialized tasks, implying some autonomous codebase exploration without hand-picked files, but there's no explicit doc describing a whole-codebase 'map and explain' capability. missing for 10: dedicated codebase-mapping/explanation feature docs, evidence of automatic whole-repo context gathering without manual file selection, and independent hands-on confirmation of this specific workflow.

   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories.”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Google claims large-codebase querying/editing (gemini-cli-gh-1) and Gemini CLI's 1M-token context lets it 'navigate and learn' huge codebases 'effortlessly' per one user (gemini-cli-comm-1), but other hands-on reports directly contradict this, calling it 'so stupid at navigation in the codebase it takes 10x as long' (gemini-cli-comm-15) and prone to getting 'stuck in spaghetti code' with no plan mode (gemini-cli-comm-14), plus it reportedly ignores its own GEMINI.md context file (gemini-cli-comm-13). Missing for 10: consistent independent benchmarks confirming autonomous whole-codebase mapping without file selection, and resolution of the navigation-quality contradiction.

   • [github] “Query and edit large codebases”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

Context management

1. developerHave the agent build and recall memory automatically across sessions

   weight 2 · round to Gemini CLI
   GitHub Copilot—none0/10

   The evidence pack describes agent mode, cloud agents, MCP context, and code review, but nothing about persistent memory that is automatically built and recalled across sessions—closest is a static 'shared source of truth' repository doc feature, not agent-built memory.

   • [claimed-docs] “Scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories.”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted3/10

   Gemini CLI offers static project context via GEMINI.md files and a `/memory` command, plus manual conversation checkpointing to save/resume sessions—but these are manually configured/invoked, not automatic memory building/recall across sessions. Hands-on community evidence directly contradicts even the GEMINI.md context mechanism working reliably: a user reports it 'consistently ignores my GEMINI.md file... even though it always says 1 GEMINI.md file is being used' (gemini-cli-comm-13), undermining the claimed persistent-context capability. missing for 10: evidence of automatic memory formation/recall without user action, evidence /memory command builds persistent cross-session knowledge, independent corroboration that GEMINI.md context reliably persists.

   • [github] “Conversation checkpointing to save and resume complex sessions”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

2. developerInclude multiple project directories in a single session for broader context

   weight 2 · round to Gemini CLI
   GitHub Copilot—none0/10

   The evidence pack describes agent mode, chat, MCP integrations, and cloud agents, but contains no mention of including multiple project directories/folders in a single Copilot session for broader context. Missing for 10: any documentation of multi-root workspace support, cross-directory indexing, or explicit multi-project context sharing in one session.

   ⚑ flag

   Gemini CLI✓fullclaimed8/10

   The official CLI flag `--include-directories ../lib,../docs` explicitly allows adding multiple project directories into a single session for broader context, directly matching the story. Missing for 10: independent hands-on confirmation of multi-directory usage quality/behavior beyond the flag documentation.

   • [github] “gemini --include-directories ../lib,../docs”

   proof ↗⚑ flag

3. developerAdd a project instructions file to set coding standards and conventions the agent follows

   weight 3 · round to GitHub Copilot
   GitHub Copilot~partialclaimed4/10

   Docs mention 'creating a shared source of truth that includes context from your docs and repositories' to keep teams consistent (github-copilot-docs-9), which gestures at instructions/knowledge-context features, but the evidence pack never explicitly describes a project instructions file (e.g., copilot-instructions.md) or how coding standards/conventions are set and enforced. Missing for 10: explicit documentation of an instructions file mechanism, its scope/format, and confirmation the agent follows it during edits/completions.

   • [claimed-docs] “Scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories.”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted5/10

   Gemini CLI documents GEMINI.md custom context files for tailoring behavior/project conventions (gemini-cli-gh-9) and docs mention /memory command for managing this context (gemini-cli-docs-3). However, hands-on community feedback reports the file being ignored despite being loaded ('it consistently ignores my GEMINI.md file, both global and local, even though it always says 1 GEMINI.md file is being used' - gemini-cli-comm-13), directly contradicting reliable adherence to project instructions. Missing for 10: independent corroboration that GEMINI.md is consistently honored, more detail on precedence/hierarchy of instruction files, and resolution of the reported ignoring behavior.

   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

Issue diagnosis

1. developerReproduce issues, narrow down root causes, and verify fixes

   weight 3 · round to GitHub Copilot
   GitHub Copilot~partialclaimed5/10

   Copilot's agent mode and chat can propose edits and 'validate files' (docs-22), Autofix explains and suggests fixes for vulnerabilities (docs-13), and code review flags issues with severity (docs-28/29), which together support parts of root-cause analysis and fix verification, but there is no explicit documentation of reproducing bugs, running/debugging tests, or a dedicated root-cause investigation workflow. missing for 10: explicit reproduction-of-issue workflow, test-execution/debugging tooling, and independent hands-on evidence of root-cause narrowing.

   • [claimed-docs] “GitHub Copilot Autofix provides contextual explanations and code suggestions to help developers fix vulnerabilities in code”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted4/10

   Google markets debugging/troubleshooting via natural language and a /bug reporting flow (gh-3, gh-20), and one HN user praises its ability to navigate huge codebases (comm-1). However multiple hands-on reports directly contradict root-cause/verify-fix workflows: users describe it getting stuck in error loops, rewriting files empty, ignoring GEMINI.md context, being 'terrible at agentic stuff', and in one case catastrophically deleting user data during a file operation (comm-10, comm-11, comm-13, comm-14, comm-15, comm-16). missing for 10: reliable reproduction of bugs, consistent root-cause narrowing without loops, and independent verification of fix correctness.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Use `/bug` command to report issues directly from the CLI.”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “A lot of times Gemini models will get stuck in a loop of errors, and a lot of times it fails to edit/read or other simple function calling -…”
   • [community] “I really tried to get gemini to work properly in Agent mode. Tho it way too often went crazy, started rewriting files empty, and ran into pe…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “I love the model, hate the tool. Anthropic has the killer app with Claude Code. I tried Gemini cli for about 5 seconds and was so frustrated…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

Marketplace

1. developerEquip the agent with custom skills to perform specialized tasks

   weight 1 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed6/10

   Docs explicitly describe a 'Skills' feature ('Skills allow Copilot to perform specialized tasks') and 'Custom agents' that let developers tailor Copilot's expertise, plus MCP server extensibility to add custom tools/context. This directly matches the story of equipping the agent with custom skills, though details are thin. Missing for 10: concrete developer walkthrough of creating a skill, independent/hands-on confirmation of using custom skills, and richer documentation depth beyond a single-line description.

   • [claimed-docs] “Skills allow Copilot to perform specialized tasks.”
   • [claimed-docs] “Custom agents allow you to tailor Copilot's expertise for specific tasks.”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity6/10

   Gemini CLI supports extensibility through MCP servers (custom tools, media generation) and GEMINI.md context files to tailor agent behavior for specific projects, and a community mention references a built-in 'skills runtime' as part of its architecture. However, there is no dedicated first-party 'skills' marketplace or packaging system, and community reports note GEMINI.md is sometimes ignored in practice. Missing for 10: a documented first-class 'skills' framework/marketplace, independent corroboration that custom skills work reliably, and confirmation that the skills runtime mentioned in community feedback is a stable, documented feature.

   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [community] “All in all, a 140 MB Go binary with its own browser control stack, sandbox, Git, language detector, skills runtime, and subagent system. I'm…”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

2. engineering-leadIntegrate third-party partner-built agent apps into my workflows

   weight 1 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   Docs explicitly describe 'Agent apps' that let partner-built agents be used directly in GitHub workflows powered by Copilot subscription, plus assigning tasks to third-party agents (Claude, OpenAI Codex) and MCP server integration for extending Copilot with external tools. Missing for 10: independent/hands-on verification of partner agent app integrations and detail on governance/setup friction beyond first-party docs.

   • [claimed-docs] “Agent apps let you use partner-built agents directly in your workflows on GitHub, powered by your Copilot subscription.”
   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”
   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed5/10

   Gemini CLI supports connecting external capabilities via MCP servers (e.g., Imagen, Veo, Lyria) and integrates with GitHub via @gemini-cli mentions and Actions, showing some ecosystem extensibility for third-party tools. However, there's no evidence of a curated marketplace or directory of partner-built 'agent apps' specifically designed for cross-workflow integration, only generic MCP server configuration support. Missing for 10: a documented partner/agent-app ecosystem or marketplace, case studies of third-party agent apps being integrated, and independent confirmation of smooth interoperability.

   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [github] “@github List my open pull requests”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

Team knowledge

1. engineering-leadCreate a shared workspace from my docs and repos as a common source of truth for the team

   weight 1 · round to GitHub Copilot
   GitHub Copilot~partialclaimed5/10

   Docs explicitly claim the ability to 'scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories,' directly matching the story, and related enterprise-governance features (control planes, audit logs, MCP allow-lists) support team-wide consistency. However, this is a single vendor-claimed line item with no elaboration on setup, structure, or how it functions as a 'workspace,' and no independent/hands-on evidence corroborates it. Missing for 10: independent verification, concrete workflow/UI details, and community confirmation that teams actually use this as a shared source of truth.

   • [claimed-docs] “Scale knowledge and keep teams consistent by creating a shared source of truth that includes context from your docs and repositories.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”
   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Gemini CLI offers per-project GEMINI.md context files and --include-directories for local context, but there is no evidence of a shared, centrally managed team workspace combining docs and repos as a common source of truth across a team.

   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”
   • [github] “gemini --include-directories ../lib,../docs”
   • [community] “Tip 1, it consistently ignores my GEMINI.md file, both global and local, even though it always says '1 GEMINI.md file is being used.'”

   proof ↗⚑ flag

Tool integration

1. developerConnect the agent to workflow tools like Jira, Slack, and Google Drive to extend its context

   weight 3 · round drawn
   GitHub Copilot~partialclaimed5/10

   Copilot supports connecting to external tools via MCP servers (docs-10, docs-20, docs-21, docs-25, docs-35), and states it can create custom MCP servers for specific needs, which theoretically enables Jira/Slack/Google Drive integration. However, no evidence names first-party or documented connectors for Jira, Slack, or Google Drive specifically. missing for 10: named official integrations or docs referencing Jira/Slack/Google Drive, independent confirmation these connectors work in practice.

   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”
   • [claimed-docs] “You can create a new MCP server to fulfill your specific needs, and then integrate it with Copilot Chat.”
   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”
   • [claimed-docs] “Copilot works where you do—in GitHub, your IDE, the CLI, project tools, chat apps, and custom MCP servers.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed5/10

   Gemini CLI supports connecting MCP servers to add custom tools/capabilities (gh-5, gh-19), which is the generic mechanism that could extend context to third-party services, but the evidence never mentions Jira, Slack, or Google Drive specifically or any pre-built connectors for them. Missing for 10: named/official Jira, Slack, or Google Drive integrations or MCP servers, and any documented example of using these workflow tools with Gemini CLI.

   • [github] “Use MCP servers to connect new capabilities, including media generation with Imagen, Veo or Lyria”
   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”

   proof ↗⚑ flag

2. developerKick off agent tasks directly from GitHub, GitLab, Linear, or Slack

   weight 2 · round drawn
   GitHub Copilot~partialclaimed4/10

   Docs clearly show agent tasks can be kicked off from GitHub itself (mentioning @copilot on a PR, automations triggered by repo events, cloud agent background execution), and Copilot is described as working across 'chat apps' generically, but no evidence specifically documents launching agent tasks from GitLab, Linear, or Slack. Missing for 10: explicit GitLab integration, explicit Linear integration, explicit Slack integration for triggering agent tasks.

   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “Copilot works where you do—in GitHub, your IDE, the CLI, project tools, chat apps, and custom MCP servers.”
   • [claimed-docs] “Agent apps let you use partner-built agents directly in your workflows on GitHub, powered by your Copilot subscription.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed4/10

   Gemini CLI has a documented GitHub integration (GitHub Action/App) that lets developers trigger tasks via @gemini-cli mentions in issues/PRs, automated PR reviews, and issue triage, but there is no evidence of native GitLab, Linear, or Slack integrations for kicking off agent tasks. missing for 10: GitLab integration, Linear integration, Slack integration, independent corroboration of GitHub workflow reliability

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “@github List my open pull requests”
   • [github] “Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

Cross device continuity

1. developerStart a task on one device and continue it later from another device or browser

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed7/10

   Copilot's cloud agent and control-plane features (docs-8, docs-14, docs-31-33) let a developer assign a task to an agent from GitHub or an IDE and later check progress or continue via GitHub.com's centralized control page or desktop workspace, which is inherently accessible cross-device/browser. However, this is inferred from the cloud-agent architecture rather than an explicit 'continue from another device' claim, and there's no independent/hands-on confirmation of seamless handoff. Missing for 10: explicit documentation of cross-device session continuation and independent verification that state/context truly persists and is resumable identically on a different machine or browser.

   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Gemini CLI offers local conversation checkpointing to save/resume sessions (gh-8) and can run in Cloud Shell (docs-1), but there is no evidence of cloud-synced session state that lets a developer start a task on one device/terminal and pick it up seamlessly on another device or browser. missing for 10: cross-device session sync, browser-based continuation of an existing CLI session, any documented mechanism to transfer checkpoint state between machines.

   • [github] “Conversation checkpointing to save and resume complex sessions”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”

   proof ↗⚑ flag

Ide integration

1. developerView interactive diffs and share selected code as context from within my JetBrains IDE

   weight 1 · round to GitHub Copilot
   GitHub Copilot~partialclaimed4/10

   Docs confirm Copilot Chat and agent-mode editing are available in JetBrains IDEs (github-copilot-docs-4, github-copilot-docs-24, github-copilot-docs-22), which implies some in-IDE diff/context capability, but no evidence specifically describes an interactive diff viewer or a 'share selected code as context' feature for JetBrains. Missing for 10: explicit documentation of JetBrains-specific interactive diff UI, explicit context-selection workflow, and independent/hands-on confirmation of these JetBrains features.

   • [claimed-docs] “chat functionality is currently available only in Visual Studio Code, JetBrains, and Visual Studio”
   • [claimed-docs] “GitHub Copilot integrates with leading editors, including Visual Studio Code, Visual Studio, JetBrains IDEs, and Neovim, and, unlike other A…”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence mentions JetBrains IDE integration, interactive diffs, or sharing code context from within an IDE for Gemini CLI; evidence pack only covers terminal/CLI usage, GitHub Actions, and MCP servers.

   ⚑ flag

2. developerChat with the coding assistant directly inside my IDE for contextual help

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullcommunity9/10

   Docs confirm Copilot Chat is built into VS Code, JetBrains, and Visual Studio for contextual in-IDE chat (explaining concepts, proposing edits, agent mode), and community feedback corroborates real usage inside the editor. Missing for 10: independent hands-on report specifically about the chat UX (most community evidence focuses on completions, not chat).

   • [claimed-docs] “chat functionality is currently available only in Visual Studio Code, JetBrains, and Visual Studio”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “GitHub Copilot integrates with leading editors, including Visual Studio Code, Visual Studio, JetBrains IDEs, and Neovim, and, unlike other A…”
   • [community] “I've been using the alpha for the past 2 weeks, and I'm blown away. Copilot guesses the exact code I want about one in ten times... when it …”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   The evidence pack describes Gemini CLI as a terminal-based agent (context files, MCP servers, Cloud Shell access) but contains no mention of an IDE extension, sidebar chat, or in-editor contextual panel that would let a developer chat with it directly inside an IDE. Community threads discuss its terminal/agentic performance, not IDE integration.

   ⚑ flag

Session management

1. engineering-leadManage multiple agent-driven coding sessions from one unified workspace

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   Docs describe a unified control page/desktop workspace to launch, track, and manage multiple agent sessions (Copilot, Claude, Codex) with progress tracking, review, merge, and governance/audit logs from one control plane, directly matching the story. Missing for 10: independent hands-on validation of the multi-agent dashboard experience and any reported friction managing many concurrent sessions.

   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Evidence shows single-session features (conversation checkpointing to save/resume one session, GEGEMINI.md context files) but nothing about running or coordinating multiple concurrent agent sessions from one unified dashboard/workspace for a lead overseeing a team's work. missing for 10: multi-session dashboard/orchestration UI, evidence of concurrent session management, any lead-oriented workspace view.

   • [github] “Conversation checkpointing to save and resume complex sessions”
   • [github] “Custom context files (GEMINI.md) to tailor behavior for your projects”

   proof ↗⚑ flag

Terminal workflow

1. developerRun a coding agent locally from my terminal

   weight 3 · round to Gemini CLI
   GitHub Copilot✓fullprobed7/10

   GitHub Copilot CLI is officially documented as letting developers use Copilot directly from the terminal, including voice-to-text prompting, and is confirmed installable per docs and probe evidence. missing for 10: independent hands-on validation of the CLI agent's local execution/quality, and more detail on its autonomous/agentic capabilities (vs. just chat) within the terminal.

   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [claimed-docs] “As an alternative to typing, you can speak your prompt.”
   • [probe] “official CLI documented at https://docs.github.com/en/copilot/how-tos/copilot-cli/set-up-copilot-cli/install-copilot-cli”
   • [claimed-docs] “GitHub Copilot is also supported in terminals through GitHub CLI and as a chat integration in Windows Terminal Canary.”

   proof ↗⚑ flag

   Gemini CLI✓fullcommunity8/10

   Gemini CLI is a terminal-native coding agent with first-party docs (gemini-cli-gh-1 through -20, gemini-cli-docs-1/2/3) describing running locally, querying/editing codebases, non-interactive scripting, and Cloud Shell availability with no extra setup, and abundant community evidence (gemini-cli-comm-1, -9, -12) confirms real-world local terminal usage. Missing for 10: independent benchmark of reliability (several community reports of agentic failures/loops, e.g. gemini-cli-comm-10, -11, -14) and no first-party install/runtime docs beyond GitHub README excerpts.

   • [github] “Query and edit large codebases”
   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “gemini --include-directories ../lib,../docs”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and how it leverages that huge 1M context wind…”
   • [community] “The correct way of using Gemini CLI is: ABUSE IT! With 1M Context Window (soon 2M) and generous daily free quota are huge advantages.”

   proof ↗⚑ flag

2. developerRun the agent non-interactively in scripts for workflow automation

   weight 2 · round to Gemini CLI
   GitHub Copilot~partialclaimed5/10

   Copilot CLI (docs-26) lets you invoke Copilot from a terminal, and Copilot cloud agent 'Automations' (docs-15, docs-33) can be triggered on a schedule or repository events, which supports some non-interactive workflow automation. However, there is no direct evidence of a documented headless/non-interactive CLI flag (e.g., a scripted prompt-and-exit mode with exit codes) for running Copilot CLI itself inside arbitrary scripts. missing for 10: explicit CLI non-interactive/scripting mode docs, evidence of exit-code/output-parsing support for pipelines, independent hands-on confirmation of script usage.

   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [claimed-docs] “Automations let you run Copilot cloud agent automatically, on a schedule or in response to events in a repository.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”

   proof ↗⚑ flag

   Gemini CLI✓fullclaimed9/10

   Gemini CLI explicitly documents non-interactive scripting support with structured output flags (--output-format json / stream-json) and lists 'Run non-interactively in scripts for workflow automation' as a core feature; GitHub Actions integration for PR review/issue triage further evidences automation use cases. Missing for 10: independent hands-on validation specifically of scripting/automation workflows (community feedback focuses on interactive agent quality, not scripted use).

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Gemini CLI
   GitHub Copilot~partialprobed3/10

   Copilot offers a CLI (docs-26, probe-4) and MCP server integration (docs-25) that give some programmatic access to Copilot/GitHub features, but there is no evidence of a comprehensive public API/OpenAPI spec covering the full range of UI capabilities (chat, agent mode, cloud agent, code review) — the openapi probe returned 404 for all candidate endpoints (probe-3). Missing for 10: a documented REST/GraphQL API exposing chat, agent-mode edits, cloud-agent orchestration, and code review equivalently to the UI, and any independent confirmation that CLI/MCP covers full feature parity.

   • [claimed-docs] “The command-line interface (CLI) for GitHub Copilot allows you to use Copilot directly from your terminal.”
   • [probe] “official CLI documented at https://docs.github.com/en/copilot/how-tos/copilot-cli/set-up-copilot-cli/install-copilot-cli”
   • [claimed-docs] “Learn how to use the GitHub Model Context Protocol (MCP) server to interact with repositories, issues, pull requests, and other GitHub featu…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.github.com/openapi.json, https://docs.github.com/swagger.json, https://docs.github.com/…”

   proof ↗⚑ flag

   Gemini CLI~partialprobed5/10

   Gemini CLI supports non-interactive scripting and structured JSON/stream-JSON output (gh-6, gh-17, gh-18), suggesting most interactive capabilities can be invoked programmatically for automation. However, there's no explicit documentation confirming full feature parity between interactive sessions and scripted/API use, and probes found no formal API/OpenAPI spec (probe-1, probe-2), so completeness of parity is unverified. Missing for 10: explicit parity documentation, a formal API surface beyond CLI flags, and independent confirmation that all UI/interactive features (e.g., checkpointing, MCP tool use) are scriptable identically.

   • [github] “Run non-interactively in scripts for workflow automation”
   • [github] “use the `--output-format json` flag to get structured output”
   • [github] “use `--output-format stream-json` to get newline-delimited JSON events”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round drawn
   GitHub Copilot—none0/10

   No evidence in the pack describes any data export feature, open-format export, or account data portability mechanism for GitHub Copilot; documentation covers coding, agents, MCP, and models but nothing about exporting user data or leaving the platform with your data intact.

   ⚑ flag

   Gemini CLI—none0/10

   No evidence of any data export feature or open-format data portability in Gemini CLI; the tool is a local coding agent that reads/writes local files but nothing indicates exporting conversation history, settings, or usage data in an open format for user-controlled exit. Probes for llms.txt/openapi also failed, showing no structured data-access surface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developers.google.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developers.google.com/openapi.json, https://developers.google.com/swagger.json, https://deve…”

   proof ↗⚑ flag

3. ai-native userRead the product's source under an open license

   weight 2 · round to Gemini CLI
   GitHub Copilot—none0/10

   GitHub Copilot is closed-source proprietary software; no evidence in the pack shows any open-license source availability, and community discussion instead focuses on training-data/licensing concerns, not the product's own source code being open.

   ⚑ flag

   Gemini CLI~partialprobed5/10

   The product's source is hosted publicly at github.com/google-gemini/gemini-cli (referenced repeatedly across the evidence pack), implying open availability for reading, but no citation in the evidence pack explicitly names or confirms an open-source license (e.g., Apache/MIT) or points to a LICENSE file. Missing for 10: explicit license text/citation, confirmation of license type, and any independent corroboration of open-license terms.

   • [github] “Query and edit large codebases”
   • [github] “Use `/bug` command to report issues directly from the CLI.”
   • [probe] “official CLI documented at https://developers.google.com/gemini-code-assist/docs/gemini-cli”

   proof ↗⚑ flag

4. ai-native userSelf-host the core product

   weight 3 · round drawn
   GitHub Copilot—none0/10

   GitHub Copilot is a proprietary cloud/IDE-integrated service with no evidence of any self-hostable core model, backend, or deployment option; all documented capabilities rely on GitHub's hosted infrastructure and models. Self-hosting is a legitimate axis for AI-native openness comparisons, but nothing in the evidence pack indicates it is possible.

   ⚑ flag

   Gemini CLI—none0/10

   Gemini CLI is an open-source client, but the core product (the Gemini models/backend) is a Google-hosted cloud service accessed via Google account sign-in; no evidence anywhere in the pack describes a self-hosted or on-prem deployment option for the core model/service.

   • [github] “No API key management - just sign in with your Google account”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”

   proof ↗⚑ flag

Authentication

1. developerAuthenticate with an API key instead of an account login

   weight 2 · round to Gemini CLI
   GitHub Copilot—none0/10

   No evidence in the pack describes API-key authentication as an alternative to account login; Copilot's auth model is tied to GitHub account/subscription (IDE sign-in, CLI, etc.) with no mention of API keys for developer access.

   ⚑ flag

   Gemini CLI~partialclaimed4/10

   The docs emphasize signing in with a Google account (gh-13) as the primary flow, but they also note that developers needing 'specific model control or paid tier access' (gh-24) have an alternative path, implying API-key-based auth exists without detailing it. There's no explicit example or setup instructions for API-key authentication itself. Missing for 10: explicit API key env-var/config documentation, first-party steps for key-based auth, and independent confirmation it works without Google login.

   • [github] “No API key management - just sign in with your Google account”
   • [github] “Developers who need specific model control or paid tier access”

   proof ↗⚑ flag

2. engineering-leadAuthenticate through an enterprise identity or cloud platform for compliance and scalability

   weight 2 · round to Gemini CLI
   GitHub Copilot—none0/10

   No evidence in the pack addresses SSO/SAML, enterprise identity providers (e.g., Okta, Azure AD), or cloud platform authentication for Copilot; docs cover agents, MCP, models, and governance features but not identity/authentication for enterprise compliance. Missing for 10: SSO/SAML integration docs, enterprise IdP support (Azure AD/Okta), any mention of authentication/compliance certifications tied to identity federation.

   ⚑ flag

   Gemini CLI!disputedcontradicted4/10

   Google claims 'Enterprise features: Advanced security and compliance' and frictionless Google-account sign-in without API key management, plus Cloud Shell availability, suggesting cloud/enterprise identity support. However, a hands-on community report shows authentication explicitly failing for Workspace (enterprise) accounts ('Failed to login. Ensure your Google account is not a Workspace account'), directly contradicting the enterprise-identity claim for a core scenario. Missing for 10: documented enterprise SSO/IAM integration details, confirmation Workspace login issue is resolved, and independent verification of compliance certifications.

   • [github] “No API key management - just sign in with your Google account”
   • [github] “Enterprise features: Advanced security and compliance”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' I have had a Workspace account since GSuite and now as a Workspace…”

   proof ↗⚑ flag

3. developerSign in with my existing product subscription plan to use the coding agent

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed7/10

   Docs show that Copilot's cloud/coding agent features (agent mode, cloud agent, agent apps) are powered by and included in a user's existing Copilot subscription, e.g. 'Agent apps let you use partner-built agents directly in your workflows on GitHub, powered by your Copilot subscription' and 'Access to Cloud agent and code review' listed as plan features, meaning no separate sign-up is needed beyond the existing subscription/login. Missing for 10: explicit tier-by-tier sign-in flow documentation and independent user confirmation that no extra account creation is required beyond the existing GitHub/Copilot login.

   • [claimed-docs] “Agent apps let you use partner-built agents directly in your workflows on GitHub, powered by your Copilot subscription.”
   • [claimed-docs] “Access to Cloud agent and code review”
   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”

   proof ↗⚑ flag

   Gemini CLI!disputedcontradicted4/10

   Gemini CLI advertises frictionless Google-account sign-in with no API key management (gh-13), suggesting subscribers could just log in and go, but hands-on community reports concretely contradict this: a Gemini Pro subscriber found that paying for 'Gemini' doesn't unlock Gemini CLI usage, requiring a separate 'Gemini Code Assist Standard/Enterprise' plan, and another user explicitly asks for one unified subscription across CLI, Code Assist, Jules, etc. like Claude's Max plan. Missing for 10: evidence that an existing Google One/Gemini Advanced subscription actually raises CLI usage limits, and resolution of the reported subscription fragmentation.

   • [github] “No API key management - just sign in with your Google account”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber but I learn I should be a 'Gemini Code Assist Standard or Enterpri…”
   • [community] “Again, with the complicated subscription. Please just give us a monthly subscription for developers that I can pay whatever, and then use Ge…”
   • [github] “Developers who need specific model control or paid tier access”

   proof ↗⚑ flag

4. developerSign in with a personal account to get free-tier access without managing API keys

   weight 1 · round to Gemini CLI
   GitHub Copilot—none0/10

   The evidence pack contains no mention of a free tier, personal GitHub account sign-in flow, or API-key-free authentication for Copilot; all docs items describe features (agent mode, MCP, code review) but never address account-based free-tier access or pricing/sign-in mechanics.

   ⚑ flag

   Gemini CLI✓fullcommunity7/10

   GitHub docs explicitly state 'No API key management - just sign in with your Google account' (gemini-cli-gh-13), directly matching the story, and Cloud Shell docs describe zero-setup access. Community reports don't dispute personal-account sign-in itself (the failure noted is specific to Workspace accounts, an edge case outside 'personal account'), though some users voice confusion over how free vs paid tiers interact. Missing for 10: independent/hands-on confirmation of the free-tier quota limits and clearer documentation distinguishing personal free-tier access from paid Code Assist tiers.

   • [github] “No API key management - just sign in with your Google account”
   • [claimed-docs] “The Gemini CLI is available without additional setup in Cloud Shell”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber but I learn I should be a 'Gemini Code Assist Standard or Enterpri…”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' I have had a Workspace account since GSuite and now as a Workspace…”

   proof ↗⚑ flag

Model choice

1. developerLet the tool automatically pick the best model for each task

   weight 1 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed7/10

   GitHub's own docs explicitly state Copilot can 'Automatically select the best model for each task' (docs-17), alongside supporting claims about multiple models optimized for speed/accuracy/cost (docs-7, docs-30). Missing for 10: independent/hands-on verification that auto-selection actually works well in practice, and details on how/when it triggers vs manual model choice.

   • [claimed-docs] “Automatically select the best model for each task.”
   • [claimed-docs] “Choose from leading LLMs optimized for speed, accuracy, or cost.”
   • [claimed-docs] “GitHub Copilot supports multiple AI models, each with different strengths. Some prioritize speed and cost-efficiency, while others are optim…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Evidence shows manual model selection ('Choose specific Gemini models' for 'developers who need specific model control') rather than automatic task-based model selection; no evidence of the CLI auto-choosing the optimal model per task.

   • [github] “Model selection: Choose specific Gemini models”
   • [github] “Developers who need specific model control or paid tier access”

   proof ↗⚑ flag

2. developerChoose which underlying AI model powers my session from multiple providers

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   GitHub's own docs explicitly state Copilot supports multiple AI models from different providers (e.g., Claude, OpenAI Codex) and lets users 'choose from leading LLMs optimized for speed, accuracy, or cost,' with a dedicated supported-models reference page and an auto-select option. This directly matches the story of choosing the underlying model per session. Missing for 10: independent/hands-on community confirmation of the model-picker UI in practice and details on per-session persistence of the choice.

   • [claimed-docs] “Choose from leading LLMs optimized for speed, accuracy, or cost.”
   • [claimed-docs] “GitHub Copilot supports multiple AI models, each with different strengths. Some prioritize speed and cost-efficiency, while others are optim…”
   • [claimed-docs] “Assign tasks to agents like Copilot, Claude by Anthropic, and OpenAI Codex, and let them plan, explore, and execute work autonomously in the…”
   • [claimed-docs] “Automatically select the best model for each task.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   Evidence shows Gemini CLI only supports choosing among Google's own Gemini models (gh-14, gh-24), not switching between different AI providers (e.g., OpenAI, Anthropic); community complaints (comm-2, comm-3, comm-19) reinforce that it's locked to Google's ecosystem/billing. There is no evidence of multi-provider model selection, so the story as written (choosing from multiple providers) is not delivered.

   • [github] “Model selection: Choose specific Gemini models”
   • [github] “Developers who need specific model control or paid tier access”
   • [community] “The killer feature of Claude Code is that you can just pay for Max and not worry about API billing. Until Gemini does that, I'm sticking wit…”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber but I learn I should be a 'Gemini Code Assist Standard or Enterpri…”
   • [community] “Again, with the complicated subscription. Please just give us a monthly subscription for developers that I can pay whatever, and then use Ge…”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   GitHub Copilot—none0/10

   No evidence in the pack mentions data residency, region selection, or geographic storage controls for GitHub Copilot; only data-training opt-out is mentioned, which is a different concern.

   ⚑ flag

   Gemini CLI—none0/10

   No evidence in the pack mentions data residency, regional storage options, or configurable data location controls for Gemini CLI; only enterprise 'security and compliance' features are mentioned generically without specifics.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round to GitHub Copilot
   GitHub Copilot~partialcommunity6/10

   GitHub's docs explicitly state individual subscribers can opt out of having their data used for AI model training at any time (github-copilot-docs-12), directly satisfying the story's core ask. However, the evidence pack lacks detail on how opt-out is enforced, whether it covers all Copilot data flows (e.g., telemetry, code review, agents), and community commentary voices skepticism (not concrete contradiction) about whether enterprise code can truly be excluded. Missing for 10: independent verification that opt-out is honored in practice, clarity on enterprise/org-level data-use guarantees, and details on scope of what 'training' opt-out actually excludes.

   • [claimed-docs] “Individual subscribers can opt out of having their data used for AI model training at any time”
   • [community] “Well, this can impose a serious risk to companies and their cloud strategy based on GitHub. Can these enterprises really make sure that thei…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence in the pack addresses data usage/training opt-out policies, privacy controls, or terms governing whether user data trains Google's models; only unrelated feature/community commentary is present. Missing for 10: explicit data-usage/training policy documentation, opt-out mechanism, enterprise/no-training guarantee.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialcommunity5/10

   GitHub Copilot docs confirm individual subscribers can opt out of AI model training data use at any time, giving some control over data usage, but there is no documented self-service mechanism for deleting stored chat/history data or explicit retention period controls. Community commentary also raises unresolved skepticism about enterprise assurances that code won't be used for training. Missing for 10: explicit data-deletion tooling, documented retention windows, and enterprise-level deletion guarantees beyond opt-out.

   • [claimed-docs] “Individual subscribers can opt out of having their data used for AI model training at any time”
   • [community] “Well, this can impose a serious risk to companies and their cloud strategy based on GitHub. Can these enterprises really make sure that thei…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence pack items address data retention controls, deletion mechanisms, or privacy settings for Gemini CLI; only enterprise 'security and compliance' is vaguely mentioned without specifics. Missing for 10: documentation on data retention policy, user-controlled deletion mechanism, opt-out of data collection, and any privacy settings UI/CLI flags.

   ⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialcommunity4/10

   Docs confirm individual subscribers can opt out of having their code data used for AI model training, but this is narrower than opting out of telemetry/usage tracking broadly, and no evidence describes a general telemetry opt-out toggle. Community commentary (comm-5) even notes agreeing to 'additional telemetry terms' during a preview with no opt-out mentioned. Missing for 10: explicit telemetry/usage-tracking opt-out setting, documentation distinguishing telemetry from training-data opt-out, and independent confirmation that opting out actually stops telemetry collection.

   • [claimed-docs] “Individual subscribers can opt out of having their data used for AI model training at any time”
   • [community] “Gigantic caveat: 'I agree to these additional telemetry terms as part of the technical preview.'”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence in the pack mentions telemetry settings, opt-out flags, or usage-data collection policy for Gemini CLI. Missing for 10: any documentation of a telemetry/usage-tracking toggle, privacy settings, or opt-out mechanism.

   ⚑ flag

Data governance

1. engineering-leadOpt out of having my code and prompts used for AI model training

   weight 1 · round to GitHub Copilot
   GitHub Copilot~partialcommunity6/10

   Docs explicitly state individual subscribers can opt out of AI model training at any time (github-copilot-docs-12), which covers a developer-level version of this story. However, evidence does not show an org-wide/enterprise admin policy control that an engineering-lead could set organization-wide, and one community comment expresses skepticism about enterprise assurance (not a concrete contradiction). Missing for 10: enterprise/org-level policy documentation, admin-console controls, and independent verification of enforcement.

   • [claimed-docs] “Individual subscribers can opt out of having their data used for AI model training at any time”
   • [community] “Well, this can impose a serious risk to companies and their cloud strategy based on GitHub. Can these enterprises really make sure that thei…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence in the pack addresses data usage, training opt-out policies, or privacy controls for Gemini CLI; only feature lists and general community sentiment are present. missing for 10: any documentation of data usage/training policy, opt-out settings or enterprise privacy controls, and independent confirmation of such settings working.

   ⚑ flag

Pr review

1. developerHave the agent stage changes, write commit messages, create branches, and open pull requests

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed7/10

   GitHub Copilot's cloud/background agent is documented to work independently on tasks, make changes on existing PRs via @copilot mentions, and complete work 'just like a human developer,' which in GitHub's workflow model entails committing changes and opening/updating pull requests (docs-31, docs-32, docs-8, docs-14). However, explicit documentation of branch creation and commit-message authorship mechanics is not directly cited, and there is no independent/hands-on verification of the PR-opening workflow. Missing for 10: explicit branch-creation documentation, independent hands-on confirmation of commit/PR flow, and detail on staging-changes granularity.

   • [claimed-docs] “With Copilot cloud agent, GitHub Copilot can work independently in the background to complete tasks, just like a human developer.”
   • [claimed-docs] “Mention `@copilot` in a comment on an existing pull request to ask it to make changes.”
   • [claimed-docs] “Launch work from GitHub, track progress across multiple agents, review changes, and merge completed work—all from one desktop workspace buil…”
   • [claimed-docs] “Use one centralized control page to jump between agent sessions, check progress, and stay in control without losing your place.”
   • [claimed-docs] “Set up an automation to run Copilot automatically, on a schedule or in response to events such as an issue being opened.”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed4/10

   Evidence shows Gemini CLI can automate git-related operational tasks like querying pull requests and handling complex rebases, and its GitHub Action can do automated PR reviews and issue triage, but there's no explicit documentation of the agent staging changes, writing commit messages, creating branches, or opening new pull requests itself. Missing for 10: explicit commit-message generation, branch creation, and PR-opening workflow evidence, plus independent confirmation these work reliably.

   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “@github List my open pull requests”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”

   proof ↗⚑ flag

2. developerGet automatic code review with contextual feedback on every pull request

   weight 3 · round to Gemini CLI
   GitHub Copilot✓fullclaimed7/10

   GitHub Copilot's docs explicitly describe automated PR code review with contextual feedback, suggested fixes, and severity labeling (High/Medium/Low) for prioritization, plus 'Access to Cloud agent and code review' as a plan feature. This directly matches the story's request for automatic, contextual PR review feedback. Missing for 10: independent/hands-on community evidence specifically validating the PR-review feature's accuracy or usefulness (community citations mostly discuss code completion, not the review feature) and detail on review-triggering automation reliability.

   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “Access to Cloud agent and code review”

   proof ↗⚑ flag

   Gemini CLI✓fullcommunity8/10

   Gemini CLI's GitHub Actions integration explicitly provides automated PR code review with contextual feedback and suggestions, plus on-demand @gemini-cli assistance in PRs, and community reports corroborate favorable code review quality compared to competitors. Missing for 10: independent hands-on verification of the PR-review workflow specifically (most community feedback covers general CLI agentic use rather than the PR-review action itself), and no detail on configurability/false-positive rates.

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “On-demand Assistance: Mention `@gemini-cli` in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “@github List my open pull requests”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”

   proof ↗⚑ flag

3. developerInspect diffs and run checks to catch problems before merging

   weight 3 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   Copilot provides code review with inline suggested changes and severity-labeled comments (docs-28, docs-29), integrated with PR diffs, plus Autofix for vulnerability detection (docs-13) and agent mode validation of files (docs-22). This directly supports inspecting diffs and catching problems pre-merge. Missing for 10: independent/hands-on evidence of the code-review feature's real-world accuracy and no explicit mention of running CI/test checks as part of the flow.

   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”
   • [claimed-docs] “GitHub Copilot Autofix provides contextual explanations and code suggestions to help developers fix vulnerabilities in code”
   • [claimed-docs] “Copilot in your editor does it all, from explaining concepts and completing code, to proposing edits and validating files with agent mode.”
   • [claimed-docs] “Access to Cloud agent and code review”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity6/10

   Gemini CLI supports GitHub PR review automation with contextual feedback (gemini-cli-gh-10) and issue triage, plus community reports confirm it catches bugs reviewers missed (gemini-cli-comm-20), supporting diff inspection and pre-merge checks. However, there's no dedicated diff-viewing UI or built-in test/lint-running check suite documented, and community reports raise concerns about reliability, security prompts, and agentic mistakes (gemini-cli-comm-14, gemini-cli-comm-17). missing for 10: dedicated diff-inspection UI/commands, built-in CI/test-running integration, and stronger independent corroboration of reliability for pre-merge checks.

   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “Issue Triage: Automated labeling and prioritization of GitHub issues based on content analysis”
   • [github] “Automate operational tasks like querying pull requests or handling complex rebases”
   • [community] “We have tried out Gemini code review vs Copilot code review and Gemini is consistently offering better code review tips. It has officially c…”
   • [community] “The problem is that Gemini CLI simply doesn't work. Beside simplest tasks like creating a new release it is useless as a coding assistant. D…”
   • [community] “However, it does seem that Gemini pays less attention to security than Claude Code. Gemini will happily open in my root directory. Claude Co…”

   proof ↗⚑ flag

Safe execution

1. engineering-leadControl which external tools and integrations the agent is allowed to access

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   GitHub Copilot provides explicit admin controls to allow-list MCP servers developers can access ('Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access'), plus a centralized control plane with audit logs for governance over agents. This directly matches the engineering-lead's need to restrict external tool/integration access. Missing for 10: independent/hands-on verification of the allow-list enforcement in practice, and more granular detail on per-tool (vs per-MCP-server) restriction scope.

   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”
   • [claimed-docs] “Connect MCP servers to Copilot Chat to share context from other applications.”

   proof ↗⚑ flag

   Gemini CLI~partialcommunity5/10

   Gemini CLI supports configuring MCP servers via ~/.gemini/settings.json and exposes /tools and /mcp commands to inspect and manage available tools, giving engineering leads some control over which integrations are enabled. However, evidence lacks any centralized admin/policy control, allowlist/denylist enforcement, or org-wide governance mechanism for restricting tool access across a team, and community reports note weak security defaults (e.g. opening root directories without prompting). missing for 10: org-level/admin enforcement of tool allowlists, granular permission scoping per tool/integration, independent verification that access controls are robust rather than just configurable per-user.

   • [github] “Configure MCP servers in ~/.gemini/settings.json to extend Gemini CLI with custom tools”
   • [claimed-docs] “Comandos de Gemini CLI: /memory, /stats, /tools y /mcp”
   • [community] “However, it does seem that Gemini pays less attention to security than Claude Code. Gemini will happily open in my root directory. Claude Co…”

   proof ↗⚑ flag

2. engineering-leadHave the agent operate inside a sandbox when interacting with code, tools, and network resources

   weight 2 · round to GitHub Copilot
   GitHub Copilot✓fullclaimed8/10

   Docs explicitly state that Cloud and local sandboxes provide isolated execution environments letting Copilot safely interact with code, tools, filesystem, and network resources, either locally or in fully isolated cloud environments, with additional governance controls like MCP server allow lists and audit logs. Missing for 10: independent/hands-on verification of sandbox isolation guarantees and no detail on sandbox escape/limits.

   • [claimed-docs] “Cloud and local sandboxes provide isolated execution environments that let Copilot safely interact with code, tools, filesystem, and network…”
   • [claimed-docs] “Control which MCP servers developers can access from their IDEs, and use allow lists to prevent unauthorized access.”
   • [claimed-docs] “Track activity with detailed audit logs and enforce governance by managing agents from a single control plane.”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   The evidence pack contains no vendor documentation of a sandboxed execution mode for code/tool/network interactions—only a vague 'Enterprise features: Advanced security and compliance' bullet with no detail. Community evidence actually points the other way: reviewers note Gemini CLI 'happily opens in my root directory' without any directory-trust prompt, unlike Claude Code, and one report describes it destructively running file-system commands, suggesting a lack of sandboxing guardrails rather than presence of them.

   • [github] “Enterprise features: Advanced security and compliance”
   • [community] “However, it does seem that Gemini pays less attention to security than Claude Code. Gemini will happily open in my root directory. Claude Co…”
   • [community] “Gemini told the user: 'I have failed you completely and catastrophically... I have lost your data. This is an unacceptable, irreversible fai…”

   proof ↗⚑ flag

Security checks

1. engineering-leadSee license and public-code matching references for AI-suggested code

   weight 1 · round to GitHub Copilot
   GitHub Copilot~partialcommunity5/10

   GitHub Copilot documents a public-code matching feature that searches public GitHub repos for matches to a suggestion (docs-11), which is the closest evidence to the story's ask. However, the evidence pack gives no detail on how license attribution is actually surfaced to an engineering lead, and community discussion raises real concerns about verbatim/near-verbatim reproduction and licensing risk (comm-12, comm-13, comm-14, comm-16), with only partial rebuttal (comm-17) — indicating the feature's coverage and reliability for license-safety review is limited. Missing for 10: detailed docs on license display/attribution UI, audit/reporting workflow for engineering leads, and independent verification that the matching feature reliably flags copyleft/licensed snippets.

   • [claimed-docs] “This feature searches across public GitHub repositories for code that matches a Copilot suggestion.”
   • [community] “It certainly seems to be a laundering enabler. Say that you want to un-GPL-ify some famous copylefted code... you type a first innocuous cha…”
   • [community] “The potential inclusion of GPL'd code, and potentially even unlicensed code, is making me wary of using it. Fair Use doesn't exist here and …”
   • [community] “'We found that about 0.1% of the time, the suggestion may contain some snippets that are verbatim from the training set.' If it's spitting o…”
   • [community] “I just tested it myself on a random c file... it reproduced his full code verbatim from just the function header so clearly it does regurgit…”
   • [community] “It prints this code because you have it open in another editor tab. Wish people who don't know at all how it works stopped acting all outrag…”

   proof ↗⚑ flag

   Gemini CLI—none0/10

   No evidence anywhere in the pack of license attribution, public-code matching, or provenance references for AI-suggested code; features listed cover code editing, review, MCP, PR automation, etc. but nothing about license/originality detection.

   ⚑ flag

2. developerGet contextual explanations and automatic fixes for security vulnerabilities

   weight 2 · round to GitHub Copilot
   GitHub Copilot~partialclaimed6/10

   GitHub Copilot Autofix is explicitly documented to provide 'contextual explanations and code suggestions to help developers fix vulnerabilities in code' and Copilot code review adds severity-labeled feedback with suggested fixes, directly matching the story. However, this is first-party documentation only with no independent/hands-on validation of Autofix's real-world effectiveness, and no detail on scope/limitations (e.g., which languages, integration with Advanced Security). missing for 10: independent corroboration of Autofix accuracy, hands-on developer reports validating the fix quality, details on prerequisites/limitations of the feature.

   • [claimed-docs] “GitHub Copilot Autofix provides contextual explanations and code suggestions to help developers fix vulnerabilities in code”
   • [claimed-docs] “GitHub Copilot can review your code and provide feedback. Where possible, Copilot's feedback includes suggested changes which you can apply …”
   • [claimed-docs] “Copilot labels each comment with a severity level of "High," "Medium," or "Low" to help you prioritize the issues it finds based on their im…”

   proof ↗⚑ flag

   Gemini CLI~partialclaimed4/10

   Gemini CLI offers general debugging/explanation via natural language (gh-3, gh-12) and automated PR review with 'contextual feedback and suggestions' (gh-10), plus vague 'enterprise advanced security and compliance' (gh-15), which could incidentally surface and explain security issues, but there is no evidence of a dedicated vulnerability-scanning or automatic-fix feature specifically for security flaws. Missing for 10: explicit vulnerability detection/scanning capability, documented automatic remediation of security issues, and independent verification that PR reviews catch/fix security vulnerabilities specifically.

   • [github] “Debug issues and troubleshoot with natural language”
   • [github] “Pull Request Reviews: Automated code review with contextual feedback and suggestions”
   • [github] “On-demand Assistance: Mention @gemini-cli in issues and pull requests for help with debugging, explanations, or task delegation”
   • [github] “Enterprise features: Advanced security and compliance”

   proof ↗⚑ flag