Skip to content

AI Assistants Arena

Gemini vs Microsoft Copilot

Gemini wins · 245 (15 drawn)

Agenticness — how well agents can access and operate the productAgenticness

How well agents can access and operate the product

Agent access

  1. ai-native userPoint an agent at llms.txt or agent-oriented docs

    weight 2 · round drawn
    Gemininone0/10

    No evidence that Gemini can be pointed at llms.txt or agent-oriented documentation formats; the evidence only covers uploading files, GitHub repos, and connecting to apps, none of which address consuming llms.txt or agent-facing docs conventions. Missing for 10: any mention of llms.txt support, agent-oriented doc parsing, or a documented workflow for feeding agent-discovery docs to Gemini.

      Microsoft Copilotnone0/10

      Probes show no llms.txt, no markdown docs endpoint, and no OpenAPI spec for Microsoft Copilot's support site, and no evidence anywhere in the pack of agent-oriented documentation formats being offered. This axis applies (any product could publish llms.txt or agent-friendly docs) but there is no evidence Copilot does so.

      • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
      • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
      • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
    • ai-native userPlug MCP servers into this product so it can use their tools

      weight 3 · round drawn
      Gemininone0/10

      Evidence covers Gemini Apps' 'Connected Apps' feature (Gmail, Calendar, Maps, Flights) and coding-related uploads (GitHub repos, folders), but nothing describes plugging in Model Context Protocol (MCP) servers as a tool-connection mechanism. Missing for 10: any documentation or mention of MCP server support, MCP client configuration, or third-party tool registration via MCP standard.

      • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
      • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
      • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
      • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
      • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
      Microsoft Copilotnone0/10

      The evidence pack describes Copilot connecting to first-party consumer services (OneDrive, Outlook.com, Google Drive/Gmail) via 'Copilot connectors,' but there is no mention of MCP (Model Context Protocol) server support or an ability for users to plug in arbitrary MCP tool servers. This is an applicable axis for an AI assistant product, but no evidence shows the capability exists.

      • [claimed-docs] Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …
      • [claimed-docs] Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …
      • [claimed-docs] Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)
    • ai-native userUse an official CLI

      weight 2 · round to Gemini

      Community discussion confirms the existence of an official 'Gemini CLI' used for software development (comm-13, comm-14), but there is no first-party documentation of it in the evidence pack, and a hands-on report shows it fails to work for Workspace accounts ('Failed to login... now as a Workspace account I cant use Gemini CLI for my work') (comm-15). Missing for 10: official CLI documentation/spec, installation and usage guides, and evidence that login/account restrictions have been resolved.

      • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
      • [community] I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber, but I now learn I should be a 'Gemini Code Assist Standard or Ent…
      • [community] 'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …
      Microsoft Copilotnone0/10

      No evidence of an official CLI for Microsoft Copilot; all evidence covers chat, browser, and Office app integrations, with probes confirming no machine-readable API/CLI artifacts.

      • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
      • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
      • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
    • ai-native userDrive the product through a documented public API

      weight 3 · round to Gemini

      Community evidence confirms a public Gemini API exists and is actively used by developers (pricing tiers, model versions, Google AI Studio parameters like temperature and top_k), but the evidence pack contains no first-party API reference documentation, and one community report notes undocumented/hidden parameter behavior (fixed top_k, capped temperature) that limits full programmatic control. missing for 10: first-party API reference/docs citation, SDK/auth documentation, confirmation that documented parameters match actual behavior.

      • [community] API pricing is up to $2/M for input and $12/M for output. For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output, Gemini …
      • [community] I'm sure this is a very impressive model, but gemini-3-pro-preview is failing spectacularly at my fairly basic python benchmark. In fact, ge…
      • [community] My favorite benchmark is to analyze a very long audio file recording of a management meeting and produce very good notes along with a transc…
      • [community] Temperature continues to be gated to maximum of 0.2, and there's still the hidden top_k of 64 that you can't turn off. I love the google AI …
      • [community] It still failed my image identification test (a photoshopped picture of a dog with 5 legs)... Gemini 3 however, while still failing, at leas…
      Microsoft Copilotnone0/10

      No evidence of a documented public API for programmatically driving Microsoft Copilot; probes for OpenAPI/llms.txt specs all returned 404, and all docs describe end-user chat/UI interactions rather than API access. Missing for 10: any public API documentation, SDK, or endpoint spec that lets developers programmatically invoke Copilot's capabilities.

      • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
      • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
      • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
    • ai-native userBuild against official SDKs

      weight 2 · round drawn
      Gemininone0/10

      The evidence pack only covers Gemini's consumer-facing app features (uploads, Gemini Live, Gems, connected apps) and does not document any official SDKs for building applications (e.g., Python/Node/Go SDKs for the Gemini API). Community mentions reference API pricing and a 'Gemini CLI' having login issues, but no concrete SDK documentation or hands-on developer usage evidence is present.

      • [community] API pricing is up to $2/M for input and $12/M for output. For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output, Gemini …
      • [community] 'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …
      Microsoft Copilotnone0/10

      The evidence pack covers Microsoft Copilot as a consumer AI assistant with features like connectors, browsing, and app integrations, but contains no mention of official SDKs, developer APIs, or programmatic build tooling for third-party developers; probes for API/OpenAPI specs returned 404s, further indicating no discoverable developer SDK surface.

      • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
      • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
      • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
    • ai-native userSubscribe to events via webhooks

      weight 2 · round drawn
      Gemininone0/10

      No evidence in the pack describes Gemini offering a webhook subscription mechanism for events; the docs cover imports, connected apps, Gems, Live, Deep Research, etc., but nothing about outbound webhooks or event subscriptions for AI-native/agentic integration.

        Microsoft Copilotnone0/10

        No evidence anywhere in the pack of Copilot offering webhook subscriptions or any event-driven notification API for developers; probes for API/OpenAPI specs returned 404s, and docs only describe chat/connector features, not webhook subscription mechanisms.

        • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
        • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
        • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…

      Agentic features

      1. ai-native userGet AI-generated insights and suggestions from my data inside the product

        weight 2 · round to Gemini

        Gemini's docs show robust support for generating insights from user data: uploading documents/spreadsheets/photos/videos for 'answers, summaries, and insights' (gemini-docs-25), Notebooks for organizing and querying sources (gemini-docs-11, gemini-docs-24, gemini-docs-29), Deep Research for in-depth analysis (gemini-docs-7), and Connected Apps that summarize Gmail and productivity data (gemini-docs-30). Independent hands-on reports corroborate real usage: navigating large codebases effortlessly (gemini-comm-13), replacing an OCR vendor for document ingestion with strong accuracy (gemini-comm-17), and NotebookLM being 'really powerful for comprehending large corpuses' (gemini-comm-19), though one report notes weaker accuracy on visual bounding-box tasks (gemini-comm-18). missing for 10: broader independent benchmarking specifically on insight-generation quality across data types, and resolution of the noted accuracy gaps in some visual tasks.

        • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
        • [claimed-docs] Notebooks provide a continuous chat experience that remembers your sources, instructions, and ongoing discussions.
        • [claimed-docs] you can use notebooks to organize your projects in a dedicated, focused space.
        • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
        • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
        • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
        • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
        • [community] I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…
        • [community] I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…
        • [community] Unfortunately Gemini really seems to struggle on this, and no matter how we tried prompting it, it would generate wildly inaccurate bounding…
        Microsoft Copilotdisputedcontradicted5/10

        Microsoft heavily documents AI-generated insights across Word, Excel, PowerPoint, Outlook, Researcher, and Analyst, and describes proactive suggestions and code-run analysis (copilot-docs-2, copilot-docs-6, copilot-docs-16, copilot-docs-33, copilot-docs-31). However, hands-on community reports concretely contradict these claims for core products: a user found Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables' (copilot-comm-4), and Outlook's summarization is described as 'so bad' with a tiny UI button (copilot-comm-5); others report never finding a use case (copilot-comm-9). One community report is positive about cross-document data fetching (copilot-comm-7), so evidence is genuinely mixed rather than uniformly negative. Missing for 10: independent benchmark of insight quality/accuracy, resolution of the Word/Outlook hands-on failures, and clearer distinction of chat vs. Office-integrated Copilot performance.

        • [claimed-docs] Turn raw data into clear insights with Copilot in Excel.
        • [claimed-docs] Go from raw numbers to real insight—use Analyst to help analyze data with ease.
        • [claimed-docs] Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.
        • [claimed-docs] Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.
        • [claimed-docs] Copilot can also run code to complete complex calculations and generate graphs.
        • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
        • [community] In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.
        • [community] the way it can fetch data from across documents in 365 is really good
        • [community] I use AI everyday and never found a use case for Copilot.
      2. ai-native userSet up automations that run autonomously in the background

        weight 2 · round to Gemini
        Geminipartialclaimed6/10

        Google's docs explicitly describe scheduling recurring actions so Gemini becomes part of daily/weekly/monthly routines (gemini-docs-8), and the Daily Brief feature autonomously delivers a personalized digest without user prompting (gemini-docs-32/41), supported by action-taking integrations with other apps (gemini-docs-10/17/23/30). However, evidence is limited to first-party docs with no independent/hands-on confirmation of reliability, no detail on trigger conditions, failure handling, or scope of what 'recurring actions' can actually do autonomously. Missing for 10: independent verification that scheduled automations run reliably unattended, documentation on trigger/condition logic, and evidence of broader autonomous multi-step task execution beyond simple digests.

        • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
        • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
        • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
        • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
        • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
        • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
        • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
        Microsoft Copilotpartialclaimed4/10

        Docs mention agentic-style capabilities (Cowork multi-step task completion, automating repetitive tasks, proactive research suggestions, browser action-taking) suggesting some autonomy, but Browse with Copilot explicitly requires user attention/supervision for many actions and no docs describe scheduled or fully background-running automations without a user session. Missing for 10: explicit scheduling/trigger mechanism, evidence of unattended background execution, and independent confirmation that these automations run without active supervision.

        • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
        • [claimed-docs] Hand off repetitive work so you can focus on what matters.
        • [claimed-docs] A copilot can automate repetitive tasks, no coding required.
        • [claimed-docs] Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.
        • [claimed-docs] Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…
      3. ai-native userDelegate tasks to a built-in AI assistant inside the product

        weight 3 · round to Gemini

        Gemini's docs show extensive task delegation: connected apps to take actions in Gmail/Calendar/Maps/Flights (gemini-docs-10, gemini-docs-23, gemini-docs-30), scheduled recurring actions (gemini-docs-8), custom Gems for specific goals (gemini-docs-9), Deep Research for autonomous multi-step research (gemini-docs-7), and Daily Brief proactive digests (gemini-docs-32, gemini-docs-41). Community evidence corroborates real-world delegated use cases like large codebase analysis and audio transcription (gemini-comm-13, gemini-comm-10). missing for 10: independent hands-on verification specifically of agentic task delegation/action-taking (vs. just Q&A), and evidence of reliability/success rate when Gemini executes multi-step delegated tasks.

        • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
        • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
        • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
        • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
        • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
        • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
        • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
        • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
        • [community] My favorite benchmark is to analyze a very long audio file recording of a management meeting and produce very good notes along with a transc…
        Microsoft Copilotpartialcommunity6/10

        Microsoft's own docs describe extensive delegation features—Copilot in Word/Excel/PowerPoint/Outlook, Researcher, Analyst, Browse with Copilot performing multi-step browser actions, and Cowork handling 'bigger, multi-step tasks'—clearly positioning Copilot as a built-in assistant that can take on tasks. However, hands-on community reports contradict smooth delegation in practice (e.g., Copilot in Word 'couldn't do anything except append to the end of the document,' couldn't create tables or maintain formatting, and some users report never finding a real use case), indicating real-world task execution is often shallow or unreliable. Missing for 10: independent verification of successful complex multi-step task completion, and resolution of documented editing/execution failures in flagship apps.

        • [claimed-docs] Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.
        • [claimed-docs] Turn raw data into clear insights with Copilot in Excel.
        • [claimed-docs] Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.
        • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
        • [claimed-docs] Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.
        • [claimed-docs] A copilot can automate repetitive tasks, no coding required.
        • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
        • [community] In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.
        • [community] I use AI everyday and never found a use case for Copilot.
      4. ai-native userOperate the product with natural-language commands

        weight 2 · round to Gemini
        Geminifullclaimed8/10

        Gemini is fundamentally operated via natural-language chat and voice (Gemini Live's free-flowing conversation, 'Hey Google' voice commands, text prompts for image generation, scheduling recurring actions, custom Gems, and connected-app actions) rather than rigid commands or GUIs, per extensive first-party docs. Missing for 10: independent/hands-on verification that complex natural-language action requests (e.g., connected-app task execution) reliably work as described, and community evidence is mixed on model quality/accuracy for specific tasks rather than confirming the NL interface itself.

        • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
        • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini.
        • [claimed-docs] With Gemini Live, you can: * **Talk back and forth:** Talk to Gemini without typing, and Gemini will respond back verbally.
        • [claimed-docs] you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more details or change th…
        • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
        • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
        • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
        • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
        • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
        • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
        • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
        Microsoft Copilotdisputedcontradicted5/10

        Docs extensively describe natural-language operation—prompting Copilot in Word/Excel/PowerPoint, natural-language file/email/calendar search, and browser action commands (copilot-docs-1,2,3,8,14,20-22,26,27). However, hands-on community evidence directly contradicts this for at least one core surface: a user reports Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables! couldn't search and replace! couldn't maintain formatting' (copilot-comm-4), and others found the Outlook summarize feature and overall NL assistant underwhelming or unused (copilot-comm-5, copilot-comm-9). This is a concrete documented failure of the claimed NL command capability, not mere skepticism. Missing for 10: independent third-party benchmarking of NL command reliability across all Office apps, and resolution of the reported Word functional gaps.

        • [claimed-docs] Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.
        • [claimed-docs] Find my budget spreadsheet” or “Show me the project plan from last month.
        • [claimed-docs] Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."
        • [claimed-docs] Find Word documents about vacation plans” or “Show me all PDFs.
        • [claimed-docs] Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.”
        • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
        • [community] In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.
        • [community] I use AI everyday and never found a use case for Copilot.

      Api quality

      1. ai-native userRely on versioned APIs with a documented deprecation policy

        weight 2 · round drawn
        Gemininone0/10

        The evidence pack is entirely consumer-focused Gemini Apps documentation (image generation, Gemini Live, connected apps, notebooks) and general community sentiment about model quality/pricing; there is no mention of API versioning, version lifecycle, or a documented deprecation policy anywhere in the pack.

          Microsoft Copilotnone0/10

          Microsoft Copilot is presented here as a consumer-facing AI assistant product; there is no evidence of a public versioned API, developer API reference, or documented deprecation policy for it. Probes for API/OpenAPI specs and llms.txt all return 404, confirming absence of such developer-facing documentation.

          • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
          • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
          • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…

        Agents tasks — stories about agents tasks in this arenaAgents tasks

        Stories about agents tasks in this arena

        Agent mode

        1. power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review

          weight 3 · round to Gemini
          Geminipartialclaimed6/10

          Deep Research lets users delegate an open-ended research task that Gemini works on autonomously and returns a report for review, and scheduled/recurring actions show background task automation; Connected Apps/Gems add some autonomous action-taking on the user's behalf. However there's no clear evidence of a general-purpose multi-step 'agent mode' that plans and executes across arbitrary apps end-to-end with an explicit review/approval step, nor independent hands-on confirmation of this workflow. Missing for 10: evidence of a broad autonomous agent (beyond Deep Research/scheduling) handling arbitrary multi-step tasks across apps, and independent/community validation of such background task delegation working reliably.

          • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
          • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
          • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
          • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
          • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
          Microsoft Copilotpartialclaimed5/10

          Copilot's 'Cowork' feature is explicitly described as handling 'bigger, multi-step tasks and deliver completed to-dos,' and 'Browse with Copilot' can perform multi-step actions while pausing for user approval on sensitive steps, which aligns with delegate-and-review workflows. However, these are single thin doc mentions with no independent/hands-on validation of true background/asynchronous operation, and community feedback focuses on other Copilot surfaces (Word, Outlook) being underwhelming rather than confirming Cowork's autonomous task delivery. Missing for 10: hands-on or independent evidence of a background task actually running unattended and returning a completed result, clearer scope/limits of Cowork, and confirmation this isn't just synchronous chat-assisted editing.

          • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
          • [claimed-docs] Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.
          • [claimed-docs] You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…
          • [claimed-docs] You can see each step in real time and take control at any time.
          • [claimed-docs] Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…
        2. power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites

          weight 3 · round to Microsoft Copilot
          Geminipartialclaimed4/10

          Deep Research lets Gemini conduct 'in-depth and real-time research' across web sources, and Connected Apps let it take actions in other apps (Gmail, Calendar, Maps, Flights) with permission — showing some research/task-automation capability. However, there is no evidence of Gemini actually driving a web browser (navigating pages, clicking, filling forms) to complete tasks on arbitrary websites, only sanctioned first-party app integrations. Missing for 10: explicit browser-control/agentic navigation evidence, hands-on demonstration of completing a multi-step website task, independent corroboration of this capability.

          • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
          • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
          • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
          • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
          Microsoft Copilotpartialclaimed6/10

          Microsoft documents a dedicated 'Browse with Copilot' capability that lets Copilot click, type, and navigate tabs in Edge to complete web tasks, with real-time visibility and required user confirmation for sensitive actions like purchases or bookings, plus a 'Cowork' mode for multi-step task completion. However, all supporting evidence is first-party docs with no independent/hands-on confirmation of browser-operation success, and community feedback in the pack focuses on Office-integrated Copilot rather than this browsing agent feature. Missing for 10: independent/hands-on validation of the browse-and-complete-task capability, more detail on reliability/success rate on real websites.

          • [claimed-docs] Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.
          • [claimed-docs] You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…
          • [claimed-docs] You can see each step in real time and take control at any time.
          • [claimed-docs] Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…
          • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
        3. power-userLet the assistant see and operate applications on my computer to complete work

          weight 2 · round to Microsoft Copilot
          Geminipartialclaimed5/10

          Gemini's Connected Apps feature lets it take actions in other apps (Gmail, Calendar, Maps, Flights) with permission, and on Android it can see what's on-screen to help with context, but this is limited to a curated set of app integrations/APIs rather than general computer-use/desktop automation across arbitrary applications. Missing for 10: broader OS-level screen perception, ability to click/type across arbitrary desktop apps, and independent hands-on evidence of an agentic computer-use mode.

          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
          • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
          • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
          • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
          • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
          Microsoft Copilotpartialcommunity6/10

          Microsoft documents 'Browse with Copilot' letting the assistant click, type, and navigate tabs directly in Edge, plus 'Cowork' for multi-step task completion and Vision for seeing images/screens, with human-in-the-loop confirmation for sensitive actions. However, this operating capability is scoped mainly to the browser and Office apps rather than general desktop application control, and community reports describe weak real-world execution (e.g., Copilot in Word failing at basic edits, Outlook integration being minimal), undercutting the strength of the claim. Missing for 10: broad OS-level/desktop app automation beyond Edge/Office, and independent hands-on validation that agentic actions reliably complete tasks.

          • [claimed-docs] Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.
          • [claimed-docs] You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…
          • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
          • [claimed-docs] Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…
          • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
          • [community] In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.

        Tasks

        1. power-userSchedule recurring or one-off tasks that run automatically and come back to me with results

          weight 2 · round to Gemini
          Geminipartialclaimed6/10

          Gemini docs confirm scheduling recurring actions (gemini-docs-8) and Daily Brief personalized digest (gemini-docs-32/41), showing one-off/recurring automated tasks that return results. However, evidence lacks detail on task complexity, multi-step agent tasks, notification delivery mechanisms, or independent/community corroboration of this specific feature working reliably. missing for 10: detailed documentation on scheduling flexibility, agentic multi-step task execution, notification/result delivery mechanisms, and independent hands-on validation of the scheduled-tasks feature.

          • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
          • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
          • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
          Microsoft Copilotnone0/10

          The evidence shows Copilot can handle multi-step tasks (Cowork) and automate repetitive work, but there is no mention of scheduling recurring or one-off tasks that run automatically and return results later. Missing for 10: any documentation of a task-scheduling feature, recurrence settings, or proactive notification of completed scheduled runs.

          • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
          • [claimed-docs] Hand off repetitive work so you can focus on what matters.
          • [claimed-docs] A copilot can automate repetitive tasks, no coding required.

        Apps devices — stories about apps devices in this arenaApps devices

        Stories about apps devices in this arena

        Apps

        1. power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen

          weight 2 · round to Gemini
          Geminipartialclaimed5/10

          Docs confirm an official Mac desktop app with a global OS-level keyboard shortcut (Option+Space) to summon Gemini without opening a browser [gemini-docs-15, gemini-docs-36, gemini-docs-20], but the only 'see what's on your screen' capability documented is for the Android mobile app via 'Hey Google' [gemini-docs-6], not the desktop app. Missing for 10: evidence of desktop screen-reading/screenshare capability, and independent/hands-on confirmation of the desktop shortcut and screen access working together.

          • [claimed-docs] you can also use the keyboard shortcut Option + Space to bring up the Gemini chat window after the app is installed and running
          • [claimed-docs] The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…
          • [claimed-docs] What you need to use the Gemini app on Mac * A personal Google Account you manage on your own, or a work or school account that your adminis…
          • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
          Microsoft Copilotnone0/10

          The evidence pack covers web/Office integrations, browser automation (Edge), and mobile/iOS/Android connectors, but nowhere documents an official standalone desktop app with OS-level keyboard shortcuts or the ability to see/interact with the user's screen content outside a browser. Vision (copilot-docs-30) is limited to photo/image analysis, not live screen capture, and Browse with Copilot (copilot-docs-9, -15, -24) is scoped to actions inside Microsoft Edge, not OS-wide screen access.

          • [claimed-docs] Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.
          • [claimed-docs] You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…
          • [claimed-docs] You can see each step in real time and take control at any time.
          • [claimed-docs] See and understand. Use Vision to analyze images, get insights from photos, and search visually.
        2. knowledge-workerUse full-featured official mobile apps for iOS and Android

          weight 2 · round drawn
          Geminipartialclaimed6/10

          Docs confirm a full-featured Gemini mobile app with rich functionality (Gemini Live voice conversations, screen-aware Android assistant via 'Hey Google', Maps/Flights integration, daily briefs, scheduling, image generation, coding help) showing strong Android support, and generic mobile-app language implies broader availability, but the evidence never explicitly names or details an iOS app or iOS-specific parity. missing for 10: explicit iOS app documentation/feature parity, App Store presence, and any cross-platform comparison confirming equal functionality on iOS vs Android.

          • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
          • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
          • [claimed-docs] Make plans with Google Maps and Google Flights
          • [claimed-docs] The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…
          • [claimed-docs] get help with writing, brainstorming, coding, and more, without needing to open a web browser.
          • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
          • [claimed-docs] If you have access to Gemini Apps with a work or school account, some Gemini mobile app features aren’t available.
          • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
          Microsoft Copilotpartialclaimed6/10

          Docs explicitly confirm 'Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)', establishing official iOS/Android apps exist and support core connector/chat features. However, there's no first-party or hands-on evidence detailing mobile-specific feature parity (e.g., Word/Excel/PowerPoint copilots, Vision, voice mode) on the mobile apps, and community feedback focuses only on desktop/Office integration quality, not mobile experience. Missing for 10: mobile-specific feature parity details, hands-on mobile app reviews, and confirmation of full functionality (Vision, Voice, connectors) actually working within the mobile app UI.

          • [claimed-docs] Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)
          • [claimed-docs] Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …
          • [claimed-docs] If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.
          • [claimed-docs] See and understand. Use Vision to analyze images, get insights from photos, and search visually.

        Custom bots

        1. power-userBuild and share custom assistants with their own instructions and knowledge

          weight 2 · round to Gemini
          Geminipartialclaimed6/10

          Gemini's "Gems" feature (gemini-docs-9) lets power-users create a custom Gem with its own instructions and requirements, and Gems can be given knowledge via uploaded files/sources (gemini-docs-25), directly matching the core of this story. However, evidence does not confirm a straightforward sharing/publishing mechanism for Gems to other users, nor independent hands-on validation of the feature's robustness. Missing for 10: documentation of sharing/publishing custom Gems with other users, evidence of knowledge-base scope/limits, and independent community corroboration of Gems in practice.

          • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
          • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
          Microsoft Copilotnone0/10

          No evidence describes creating custom Copilot agents/assistants with custom instructions and knowledge base (like Copilot Studio agents or GPT-builder equivalents) nor sharing them with others; evidence only covers built-in Office integrations, connectors, and memory features. Missing for 10: any mention of an agent/assistant builder, custom instructions, custom knowledge upload, and sharing/publishing mechanism for user-built assistants.

          Automation depth — how much of the product can run unattendedAutomation depth

          How much of the product can run unattended

          1. ai-native userPerform bulk operations across many items at once

            weight 2 · round drawn

            Gemini supports uploading whole code folders/repos and large codebases (a form of bulk ingestion) and can take actions across connected apps or run scheduled recurring actions, but there is no explicit documentation of a bulk/batch operation feature (e.g., applying an action to many items at once like bulk-editing files, mass-tagging, or batch task execution) as an AI-native automation capability. missing for 10: explicit bulk-action/batch-processing feature, evidence of applying one instruction across many discrete items simultaneously, independent corroboration of this specific capability.

            • [claimed-docs] To add a code folder: click More Uploads Import Code Upload folder.
            • [claimed-docs] To add a code folder: click More Uploads ... Import Code ... Upload folder.
            • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
            • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
            • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
            Microsoft Copilotpartialcommunity3/10

            Docs mention general automation of 'repetitive tasks' and multi-step task completion via Cowork, but there's no concrete evidence of bulk operations across many items (e.g., batch-editing many files, mass email actions, or large-scale spreadsheet manipulation). Community feedback (copilot-comm-4) reports Copilot in Word failing at basic single-document tasks like search-and-replace, casting doubt on any claim of robust bulk-item processing. missing for 10: explicit bulk/batch operation examples (e.g., mass-processing many files/rows/emails at once), independent hands-on evidence of successful bulk actions, and confirmation that Cowork or Analyst can operate at scale across many items reliably.

            • [claimed-docs] With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.
            • [claimed-docs] Hand off repetitive work so you can focus on what matters.
            • [claimed-docs] A copilot can automate repetitive tasks, no coding required.
            • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
          2. ai-native userDefine rules that trigger actions automatically on events

            weight 3 · round to Gemini
            Geminipartialclaimed4/10

            Gemini supports 'scheduling recurring actions' as part of daily/weekly/monthly routines (gemini-docs-8), which is a form of automation, but this is time-based scheduling rather than user-defined conditional rules that trigger on arbitrary events. Connected Apps let Gemini take actions in other apps (gemini-docs-10, gemini-docs-23, gemini-docs-30) but only in response to a direct user request, not an automatic event trigger. Missing for 10: evidence of event-based (not just time-based) trigger conditions, ability to define custom 'if X happens then do Y' rules, and any confirmation of conditional logic beyond fixed recurring schedules.

            • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
            • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
            • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
            • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
            Microsoft Copilotnone0/10

            The evidence describes Copilot responding to prompts, browsing, summarizing, and connecting to services, but there is no mention of user-defined rules or triggers that fire actions automatically on events (e.g., 'when email arrives, do X' style automation). No scheduling, event-trigger, or workflow-builder capability is documented.

            • ai-native userSchedule recurring jobs or workflows

              weight 2 · round to Gemini
              Geminipartialclaimed6/10

              Gemini docs explicitly confirm scheduling recurring actions ('daily, weekly, and monthly routines') via a dedicated feature (gemini-docs-8), and Daily Brief shows an example of a recurring automated digest (gemini-docs-32/41). However, evidence lacks detail on workflow complexity, chaining multiple steps/tools, error handling, or independent/community validation of this scheduling feature. missing for 10: detail on multi-step workflow scheduling, chaining across apps, reliability/error handling, and independent hands-on confirmation.

              • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
              • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
              • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
              Microsoft Copilotnone0/10

              No evidence describes scheduling recurring jobs, timers, or automated recurring workflows in Microsoft Copilot; the pack shows one-off task automation (Cowork, connectors, browse actions) but nothing about recurrence or scheduling.

              • ai-native userVersion, review, and roll back my automations

                weight 1 · round drawn
                Gemininone0/10

                No evidence of version control, review workflows, or rollback capabilities for automations (e.g., scheduled actions, Gems, or connected app actions). The evidence only covers scheduling recurring actions and connecting apps, with no mention of versioning, diffing, review approval, or rollback of automations.

                  Microsoft Copilotnone0/10

                  No evidence describes any versioning, history, review workflow, or rollback capability for Copilot's automations (e.g., Cowork, connectors, or agent tasks); evidence only covers connecting services, browsing, memory, and privacy controls. Missing for 10: version history UI, diff/review of automation changes, rollback/undo mechanism, any audit trail for automation edits.

                  Connectors apps — stories about connectors apps in this arenaConnectors apps

                  Stories about connectors apps in this arena

                  Connectors

                  1. power-userBrowse a directory of third-party apps and connectors and add them to the assistant

                    weight 2 · round to Gemini
                    Geminipartialclaimed6/10

                    Gemini docs describe a 'Connected Apps' feature that lets users link Gmail, Calendar, Maps, Flights and 'a variety of productivity apps' so Gemini can search/create content and take actions, which matches the connectors-directory concept ([gemini-docs-10],[gemini-docs-17],[gemini-docs-23],[gemini-docs-30],[gemini-docs-33],[gemini-docs-19]). However, the evidence never shows a browsable app-store-like directory UI, doesn't clarify how many third-party (non-Google) apps are included, and there's no independent/hands-on confirmation of the browse-and-add experience. Missing for 10: explicit directory/marketplace UI screenshots or docs, breadth of third-party (non-Google) app listings, independent user corroboration of adding connectors.

                    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                    • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                    • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
                    • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
                    • [claimed-docs] Make plans with Google Maps and Google Flights
                    Microsoft Copilotpartialclaimed4/10

                    Docs confirm Copilot supports 'connectors' to a small fixed list of services (OneDrive, Outlook.com, Google Drive, Gmail/Calendar/Contacts) and note these are available on Copilot.com/Mobile, but there is no evidence of a browsable directory/marketplace of third-party apps that power-users can explore and add beyond this short built-in list. missing for 10: evidence of a searchable app/connector marketplace, breadth of third-party (non-Microsoft/Google) integrations, and any independent confirmation of the browsing/add experience.

                    • [claimed-docs] Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …
                    • [claimed-docs] Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …
                    • [claimed-docs] Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)
                    • [claimed-docs] Copilot can connect with the following consumer services: ... Google Drive ... Google Gmail, Calendar, Contacts
                    • [claimed-docs] Copilot can connect with the following consumer services: Microsoft OneDrive... Google Drive... Google Gmail, Calendar, Contacts
                  2. knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers

                    weight 3 · round drawn
                    Geminifullclaimed8/10

                    Google's docs describe first-party 'Connected Apps' letting Gemini summarize Gmail, create Calendar events, search across productivity apps, and use personal Gmail/Drive as sources for Deep Research, directly matching the story's cloud drive/email/calendar connector requirement. Missing for 10: independent/hands-on verification of search quality and confirmation that calendar reading (not just event creation) works reliably.

                    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                    • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                    • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                    • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
                    • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
                    Microsoft Copilotfullcommunity8/10

                    Microsoft's documentation explicitly describes connecting Copilot to OneDrive, Outlook.com (email/calendar/contacts), Google Drive, and Google Gmail/Calendar/Contacts, with example queries for finding files, emails, and calendar events, indicating the assistant can search and use this data in answers. Community evidence corroborates that cross-document/data fetching works well in some contexts, though other complaints focus on unrelated feature quality issues (e.g., editing limitations) rather than disputing the connector capability itself. Missing for 10: independent hands-on verification specifically of the cloud-drive/email/calendar connector search feature (rather than in-app Office Copilot) and more detail on reliability/completeness of search results.

                    • [claimed-docs] Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …
                    • [claimed-docs] Find my budget spreadsheet” or “Show me the project plan from last month.
                    • [claimed-docs] Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …
                    • [claimed-docs] Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."
                    • [claimed-docs] Find Word documents about vacation plans” or “Show me all PDFs.
                    • [claimed-docs] Show me emails from Sarah about the budget” or “Find my flight confirmation email.
                    • [claimed-docs] What's on my calendar for tomorrow?” or “When is my next dentist appointment?
                    • [claimed-docs] Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.”
                    • [claimed-docs] Check in on your calendar: “What’s on my calendar for tomorrow?” or “When is my next dentist appointment?”
                    • [claimed-docs] Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)
                    • [community] the way it can fetch data from across documents in 365 is really good

                  Files analysis — stories about files analysis in this arenaFiles analysis

                  Stories about files analysis in this arena

                  Analysis

                  1. power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files

                    weight 3 · round to Microsoft Copilot
                    Gemininone0/10

                    The evidence pack shows Gemini can import/upload code folders and GitHub repos and get 'insights' from uploaded documents/spreadsheets, but there is no evidence of an actual code-execution/sandbox feature that writes and runs code to produce charts, computed answers, or downloadable output files. No docs or community reports describe this specific data-analysis-with-code-execution workflow.

                    • [claimed-docs] To add a GitHub repository: More Uploads Import Code and enter the GitHub repository or branch URL.
                    • [claimed-docs] To add a code folder: click More Uploads Import Code Upload folder.
                    • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                    Microsoft Copilotpartialclaimed6/10

                    Docs explicitly state Copilot can 'run code to complete complex calculations and generate graphs' and the 'Analyst' feature 'analyzes data with ease,' plus Excel/Word integrations for working with attached data—covering charts and computed answers. However, there is no explicit documentation of producing downloadable files as an output of this code-execution flow, and no hands-on/community evidence corroborates this specific capability working well (community comments focus on other Office Copilot shortcomings, not code-execution). Missing for 10: explicit downloadable-file output evidence, independent/hands-on confirmation of the code-execution feature itself.

                    • [claimed-docs] Copilot can also run code to complete complex calculations and generate graphs.
                    • [claimed-docs] Go from raw numbers to real insight—use Analyst to help analyze data with ease.
                    • [claimed-docs] Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.
                    • [claimed-docs] Turn raw data into clear insights with Copilot in Excel.

                  Artifacts

                  1. knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export

                    weight 2 · round to Gemini
                    Geminipartialclaimed4/10

                    Evidence documents Gemini's ability to generate and iteratively edit images (Nano Banana) with export/download at set resolutions, and general writing assistance, but there is no evidence of a dedicated document or presentation creation/editing workflow (e.g., a canvas-style doc/slide editor) with export to file formats. Missing for 10: explicit documentation of creating/iterating on text documents or slide decks, and exporting them to standard file formats (docx/pptx/pdf).

                    • [claimed-docs] You can create captivating images in seconds with Nano Banana 2. From work, play, or anything in between, Gemini Apps can help you generate …
                    • [claimed-docs] Local edits: Making quick and specific changes to parts of an image.
                    • [claimed-docs] Character consistency: Maintain the look of a person or character across various generated images, including the ability to combine multiple…
                    • [claimed-docs] Download images at at 2K resolution with a Google AI plan or at 1K without an AI plan.
                    • [claimed-docs] Blend text, images, and video to bring your ideas to life.
                    • [claimed-docs] The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…
                    Microsoft Copilotdisputedcontradicted4/10

                    Microsoft's own docs claim Copilot in Word/Excel/PowerPoint can create and iteratively refine documents, spreadsheets, and presentations via chat (copilot-docs-1,2,3,16), which would let users export finished files. However, a hands-on community report directly contradicts this for Word, stating Copilot 'couldn't do anything except append to the end of the document,' couldn't create tables, search/replace, or maintain formatting (copilot-comm-4), and another user calls Outlook's summarize feature 'so bad' (copilot-comm-5). This is a concrete documented capability failure, not mere skepticism. Missing for 10: independent corroboration of successful iterative multi-turn editing, PowerPoint/Excel hands-on validation, and confirmation of clean export/formatting fidelity.

                    • [claimed-docs] Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.
                    • [claimed-docs] Turn raw data into clear insights with Copilot in Excel.
                    • [claimed-docs] Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.
                    • [claimed-docs] Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.
                    • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
                    • [community] In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.

                  Files

                  1. knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents

                    weight 3 · round to Gemini

                    First-party docs explicitly state users can upload documents, spreadsheets, and more to get answers, summaries, and insights (gemini-docs-25), and independent hands-on evidence corroborates accurate document/PDF analysis (a fintech user reporting 96% OCR accuracy on PDFs, comm-17) plus praise for NotebookLM's ability to comprehend large source corpora (comm-19). Missing for 10: dedicated evidence on spreadsheet-specific accuracy and broader independent benchmarking across document types beyond the single fintech PDF case.

                    • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                    • [community] I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…
                    • [community] I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…
                    Microsoft Copilotpartialcommunity6/10

                    Microsoft's own docs describe multiple file-analysis capabilities—attaching data in Excel, analyzing notes in Word, finding/searching PDFs and Office documents, an 'Analyst' tool for data insight, and code execution for calculations—giving broad first-party coverage of the story. However, hands-on community reports contradict smooth real-world usability (e.g. Word Copilot 'couldn't do anything except append text... couldn't maintain formatting' and Outlook summarization deemed 'so bad'), while another user praises cross-document data-fetching, so the accuracy/quality of analysis is mixed rather than assured. Missing for 10: independent verification of analysis accuracy on complex spreadsheets/PDFs, and resolution of the documented Word-editing/formatting failures.

                    • [claimed-docs] Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.
                    • [claimed-docs] Turn raw data into clear insights with Copilot in Excel.
                    • [claimed-docs] Go from raw numbers to real insight—use Analyst to help analyze data with ease.
                    • [claimed-docs] Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.
                    • [claimed-docs] Find Word documents about vacation plans” or “Show me all PDFs.
                    • [claimed-docs] Copilot can also run code to complete complex calculations and generate graphs.
                    • [community] I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…
                    • [community] the way it can fetch data from across documents in 365 is really good

                  Memory context — stories about memory context in this arenaMemory context

                  Stories about memory context in this arena

                  Memory

                  1. power-userHave the assistant remember relevant context from previous chats and apply it in new conversations

                    weight 3 · round to Gemini
                    Geminifullclaimed8/10

                    Gemini docs explicitly describe a personalization feature where 'the memory of your past Gemini chats' informs new conversations, plus user controls to review/delete that activity, confirming both the capability and its persistence across sessions. Missing for 10: independent hands-on validation of cross-chat memory recall accuracy and more detail on scope/duration of retained context.

                    • [claimed-docs] You can get a personalized experience in Gemini Apps based on: The memory of your past Gemini chats
                    • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                    Microsoft Copilotpartialclaimed6/10

                    First-party docs confirm a memory feature: Copilot can store facts users ask it to remember and use that context in future responses, and can proactively surface suggestions based on past queries and memory (copilot-docs-32, copilot-docs-33). However, this is opt-in/explicit fact storage rather than full automatic context carry-over, and there is no independent/hands-on evidence confirming it works reliably across conversations. missing for 10: independent verification of cross-conversation recall, detail on scope/limits of automatic memory use, and confirmation it isn't just facts explicitly asked to be remembered.

                    • [claimed-docs] Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…
                    • [claimed-docs] Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.
                    • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                  2. power-userSet persistent custom instructions and preferences that shape every response

                    weight 1 · round drawn
                    Geminipartialclaimed5/10

                    Gemini offers a 'memory of past chats' personalization feature (gemini-docs-18) and custom Gems that let users pre-set instructions/goals (gemini-docs-9), which together approximate persistent customization, but there's no documented single 'custom instructions' setting that explicitly shapes every response across all chats. Missing for 10: explicit persistent instruction/preference settings applied globally to every response, independent verification of memory consistency, and detail on how memory interacts with different chat sessions.

                    • [claimed-docs] You can get a personalized experience in Gemini Apps based on: The memory of your past Gemini chats
                    • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                    • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                    Microsoft Copilotpartialclaimed5/10

                    Docs confirm a memory feature where Copilot can store facts users ask it to remember and use them to personalize future responses and suggestions, plus controls to view/delete memory (copilot-docs-32, copilot-docs-33, copilot-docs-38). However there is no dedicated 'custom instructions' setting described (unlike explicit persona/tone controls), and no independent/hands-on evidence confirming these stored facts consistently shape *every* response. Missing for 10: explicit custom-instructions UI documentation, hands-on confirmation that memory reliably influences all responses, and community corroboration of the feature's effectiveness.

                    • [claimed-docs] Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…
                    • [claimed-docs] Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.
                    • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                    • [claimed-docs] opt out of use of your conversation activity for model training

                  Projects

                  1. knowledge-workerOrganize related chats and files into a project or space that shares context and instructions

                    weight 2 · round to Gemini

                    Gemini's 'Notebooks' feature explicitly provides a continuous, focused space that remembers sources, instructions, and ongoing chat history, and lets users upload documents, code, and other files into that same organized context (gemini-docs-11, gemini-docs-24, gemini-docs-25, gemini-docs-29). Custom Gems (gemini-docs-9) further let users set persistent instructions for recurring tasks, and independent commentary confirms NotebookLM/Notebooks are genuinely useful for organizing large source sets into a coherent project workspace (gemini-comm-19), though that same source flags UI/display shortcomings. Missing for 10: no first-party doc detailing multi-chat organization within one persistent 'project' the way competitors define it, and no hands-on evidence of shared-instruction consistency across many chats in the same notebook.

                    • [claimed-docs] Notebooks provide a continuous chat experience that remembers your sources, instructions, and ongoing discussions.
                    • [claimed-docs] you can use notebooks to organize your projects in a dedicated, focused space.
                    • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                    • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                    • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                    • [community] I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…
                    Microsoft Copilotnone0/10

                    The evidence pack shows Copilot memory (storing facts), connectors to files/email/calendar, and per-app integrations, but nowhere describes a 'project' or 'space' concept that lets a user group related chats and files together with shared instructions/context, unlike competitors' project/space features. Community feedback focuses on integration quality issues, not on organizational/workspace features. Missing for 10: any documented 'project', 'space', 'workspace', or chat-grouping feature with shared custom instructions and file scoping.

                    • [claimed-docs] Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…
                    • [claimed-docs] Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.
                    • [claimed-docs] Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …

                  Multimodal — stories about multimodal in this arenaMultimodal

                  Stories about multimodal in this arena

                  Images

                  1. knowledge-workerGenerate and edit images from natural-language prompts

                    weight 2 · round to Gemini
                    Geminifullclaimed8/10

                    Gemini docs explicitly describe generating and editing images via natural-language prompts (Nano Banana 2), including local edits, character consistency, blending images, and resolution export options. missing for 10: independent hands-on corroboration of image editing quality and no community evidence testing this specific feature.

                    • [claimed-docs] You can create captivating images in seconds with Nano Banana 2. From work, play, or anything in between, Gemini Apps can help you generate …
                    • [claimed-docs] Local edits: Making quick and specific changes to parts of an image.
                    • [claimed-docs] Character consistency: Maintain the look of a person or character across various generated images, including the ability to combine multiple…
                    • [claimed-docs] You can create captivating images in seconds with Nano Banana 2.
                    • [claimed-docs] Download images at at 2K resolution with a Google AI plan or at 1K without an AI plan.
                    • [claimed-docs] Blend text, images, and video to bring your ideas to life.
                    Microsoft Copilotnone0/10

                    The evidence pack only shows Copilot's 'Vision' feature for analyzing and understanding images (copilot-docs-30), not generating or editing images from text prompts; no docs, community, or probe evidence mentions an image-generation or image-editing capability (e.g., a Designer/DALL·E-style feature).

                    • [claimed-docs] See and understand. Use Vision to analyze images, get insights from photos, and search visually.
                  2. knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them

                    weight 2 · round to Microsoft Copilot

                    Docs confirm users can upload photos/screenshots and get insights (gemini-docs-25) and get screen-context help via 'Hey Google' (gemini-docs-6), but hands-on reports show real accuracy failures: Gemini generated 'wildly inaccurate bounding boxes' on images (gemini-comm-18) and failed to correctly interpret a manipulated photo, missing key details even in the latest version (gemini-comm-12). A positive OCR use case exists (gemini-comm-17) but that's for PDFs, not general screenshot/photo scene interpretation, so the core 'accurately interpret' claim is contradicted by concrete hands-on failures. Missing for 10: independent benchmarks specifically on screenshot/UI interpretation accuracy, and resolution of the documented bounding-box/detail-recognition failures.

                    • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                    • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
                    • [community] Unfortunately Gemini really seems to struggle on this, and no matter how we tried prompting it, it would generate wildly inaccurate bounding…
                    • [community] It still failed my image identification test (a photoshopped picture of a dog with 5 legs)... Gemini 3 however, while still failing, at leas…
                    • [community] I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…
                    Microsoft Copilotpartialclaimed5/10

                    Docs confirm Copilot has a 'Vision' capability to analyze images and photos ([copilot-docs-30]), directly supporting the story, but this is a single first-party mention with no elaboration on screenshot-specific use cases or accuracy, and no independent/hands-on evidence corroborates real-world interpretation quality. Missing for 10: detailed documentation on screenshot vs photo handling, accuracy benchmarks, and independent/community verification of correct image interpretation.

                    • [claimed-docs] See and understand. Use Vision to analyze images, get insights from photos, and search visually.

                  Voice

                  1. knowledge-workerHave a natural, real-time voice conversation with the assistant

                    weight 2 · round to Gemini
                    Geminifullclaimed8/10

                    Gemini Live is explicitly documented to support natural, free-flowing, interruptible voice conversations where Gemini talks back verbally in real time, directly matching the story. Missing for 10: independent/hands-on community corroboration specifically validating the voice conversation experience (community evidence covers other Gemini features/models but not Live voice interactions).

                    • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
                    • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini.
                    • [claimed-docs] With Gemini Live, you can: * **Talk back and forth:** Talk to Gemini without typing, and Gemini will respond back verbally.
                    • [claimed-docs] you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more details or change th…
                    Microsoft Copilotfullclaimed6/10

                    Microsoft's transparency docs explicitly describe Copilot Voice mode: users send natural-language voice prompts and receive audio responses, with citations shown in conversation transcripts, confirming real-time spoken interaction. Missing for 10: independent/hands-on corroboration of voice mode's real-time quality, latency, or interruption handling, and no community evidence specifically validates or disputes the voice experience.

                    • [claimed-docs] If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.
                    • [claimed-docs] This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…

                  Openness — open source, data portability, and self-hosting storiesOpenness

                  Open source, data portability, and self-hosting stories

                  1. ai-native userDo everything through the API that I can do in the UI

                    weight 2 · round drawn
                    Gemininone0/10

                    The evidence pack details many Gemini Apps UI-only features (Gems, Deep Research, Connected Apps, Daily Brief, Live conversations, Notebooks, scheduling) with no corresponding API documentation showing these are exposed programmatically. Community evidence (e.g., gemini-comm-11) even notes the API/AI Studio path is more restricted (capped temperature, hidden top_k) than the full product, reinforcing that API and UI capability sets are not equivalent.

                    • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
                    • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                    • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
                    • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                    • [community] Temperature continues to be gated to maximum of 0.2, and there's still the hidden top_k of 64 that you can't turn off. I love the google AI …
                    Microsoft Copilotnone0/10

                    No evidence of a public API exposing Copilot's UI capabilities (chat, connectors, Word/Excel/PowerPoint copilots) programmatically; probes for OpenAPI/docs endpoints returned 404s, and all evidence describes UI/chat-only functionality. Missing for 10: any documented API/SDK, endpoint parity documentation, or third-party confirmation of programmatic access to Copilot features.

                    • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
                    • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
                    • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
                    • [claimed-docs] Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.
                    • [claimed-docs] Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.
                  2. ai-native userExport all of my data in open formats and leave

                    weight 3 · round drawn
                    Gemininone0/10

                    Evidence covers activity deletion/review (gemini-docs-31) but no mention of exporting data in open/portable formats or data-export tooling for leaving the platform. Missing for 10: any documentation of a data export/download feature (e.g., Google Takeout integration), open-format export options, or independent confirmation of data portability.

                    • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                    Microsoft Copilotnone0/10

                    No evidence of a data export/portability feature or open-format export mechanism; docs only mention deleting conversation history, not exporting it, and probes for machine-readable docs/APIs 404. There is nothing showing users can export chats, memory, or generated content in open formats to leave the platform.

                    • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                    • [claimed-docs] opt out of use of your conversation activity for model training
                    • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
                    • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
                    • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…

                  Privacy posture — data-handling and privacy storiesPrivacy posture

                  Data-handling and privacy stories

                  1. ai-native userChoose where my data is stored (region/residency)

                    weight 2 · round drawn
                    Gemininone0/10

                    The evidence pack covers Gemini's features and privacy/data-use settings (e.g., activity retention, human review opt-outs) but contains no mention of data residency or regional storage controls for AI-native/enterprise users. missing for 10: any documentation of region selection, data residency guarantees, or enterprise data-location controls.

                      Microsoft Copilotnone0/10

                      No evidence in the pack mentions data residency, regional storage controls, or any user-facing setting to choose where data is stored; the docs cover features, connectors, and privacy opt-outs but not geographic data residency choices.

                      • ai-native userPrevent my data from being used to train AI models

                        weight 3 · round to Gemini
                        Geminipartialclaimed7/10

                        Google's support docs state that chats and uploaded files in Gemini Apps are not reviewed by humans or used to improve generative AI models, and users can manage/delete their activity via 'My Activity' and toggle 'Keep Activity' off (gemini-docs-38, gemini-docs-31). However, a separate doc notes that audio/video from Gemini Live can be used to train models unless the user opts out, showing the training-data control is feature-specific rather than a single unified setting (gemini-docs-37). Missing for 10: a clear, centralized opt-out control covering all Gemini surfaces (not just chat text), independent/hands-on verification that opted-out data is truly excluded from training, and clarity for enterprise/Workspace accounts.

                        • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                        • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                        • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                        Microsoft Copilotpartialcommunity6/10

                        Microsoft's privacy FAQ explicitly states users can opt out of having conversation activity used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38), giving a documented mechanism to prevent training use. However, community reports (copilot-comm-6, copilot-comm-1) show real confusion about scope — a user working in Word had no clear indication whether their document content was being fed to training, and commenters note the opt-out/behavior differs between standalone Copilot chat and 365-integrated Copilot, undermining confidence that the control is comprehensive or transparent across all surfaces. missing for 10: independent verification that opt-out actually blocks training across all integrated products (Word/Excel/Outlook), clearer UI-level opt-out controls inside Office apps, and confirmation the toggle covers enterprise/connector data sources.

                        • [claimed-docs] opt out of use of your conversation activity for model training
                        • [claimed-docs] Train our generative AI models to create a better experience for you and others.
                        • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                        • [community] When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…
                        • [community] To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.
                      • ai-native userControl data retention and deletion

                        weight 2 · round to Gemini
                        Geminifullclaimed8/10

                        Google's support docs explicitly describe controls to review prompts, delete Gemini Apps activity, and turn off 'Keep Activity' (gemini-docs-31), plus explicit statements that chats/files are not used for model training by default (gemini-docs-38) while audio/video in Gemini Live can be opted in/out of training use (gemini-docs-37) — directly matching retention/deletion control for an AI-native user. Missing for 10: independent/hands-on verification that deletion actually removes data, and detail on data export or full account-level deletion workflows.

                        • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                        • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                        • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                        Microsoft Copilotpartialcommunity6/10

                        Docs confirm users can delete individual conversations or entire history and opt out of conversation data being used for model training, giving basic retention/deletion control for the standalone Copilot chat experience (copilot-docs-35, copilot-docs-38). However, community evidence notes this applies only to the standalone Copilot app/site, not to Copilot embedded in Office apps like Word, where a user reported uncertainty about whether their document was being auto-pushed for training with no visible deletion controls (copilot-comm-1, copilot-comm-6). Missing for 10: enterprise/Office-integrated retention controls, clarity on data retention duration before deletion, and independent verification that deletion actually removes data from training pipelines.

                        • [claimed-docs] opt out of use of your conversation activity for model training
                        • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                        • [community] To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.
                        • [community] When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…
                      • ai-native userOpt out of telemetry and usage tracking

                        weight 2 · round to Gemini
                        Geminipartialclaimed6/10

                        Docs show Gemini provides some privacy controls: reviewing/deleting prompts and turning off 'Keep Activity' (gemini-docs-31), and settings around whether audio/video/chats are used to improve models (gemini-docs-37, gemini-docs-38). This addresses usage-history and training-data opt-out but not a full 'telemetry/usage tracking' opt-out (e.g., diagnostic/product analytics separate from chat history) and there's no independent verification of these controls' effectiveness. Missing for 10: explicit documentation of a general telemetry/analytics opt-out toggle beyond activity/training-data settings, and independent/hands-on confirmation that opting out actually stops tracking.

                        • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                        • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                        • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                        Microsoft Copilotdisputedcontradicted5/10

                        Microsoft's own privacy FAQ states users can opt out of having conversation activity used for model training and can delete individual or entire conversation history (copilot-docs-35, copilot-docs-38), which is a real opt-out mechanism for the standalone Copilot chat. However, community reports directly contradict this for Copilot as embedded in Office apps: a Word for Mac user reports 'no way of turning it off' and 'no opt-out mechanism' (copilot-comm-3), and another user reports uncertainty over whether their document was being auto-pushed to Copilot for training with no visible control (copilot-comm-6) — and copilot-comm-1 clarifies the training opt-out only applies to the standalone chat app, not the Office-integrated Copilot surfaces. Missing for 10: a unified, product-wide opt-out control covering all Copilot surfaces (Office, Edge, Windows), independent verification that the training opt-out actually stops data use, and clarity on telemetry beyond training data.

                        • [claimed-docs] opt out of use of your conversation activity for model training
                        • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                        • [community] To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.
                        • [community] Hate that if you use Word for Mac, you now have Copilot next to your cursor with no way of turning it off. I just want to use Word... Now th…
                        • [community] When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…

                      Research answers — stories about research answers in this arenaResearch answers

                      Stories about research answers in this arena

                      Research

                      1. knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report

                        weight 3 · round to Gemini
                        Geminifullclaimed7/10

                        Gemini Apps has a documented Deep Research feature that conducts in-depth, real-time research across sources and allows adding personal sources (Gmail, Drive, uploads, NotebookLM notebooks) for the research, matching the autonomous multi-source research story. missing for 10: explicit documentation of citation formatting in the final report and independent hands-on evidence of report quality/citation accuracy from third parties.

                        • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
                        • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                        Microsoft Copilotpartialclaimed5/10

                        Copilot's 'Researcher' agent is documented as designed to 'find, synthesize, and understand information faster' and Copilot's web-grounded answers include hyperlinked citations, which maps to the deep-research/cited-report story, but there is no detail on autonomous multi-source search depth, report format, or any hands-on/independent validation of report quality. Missing for 10: documentation of the autonomous multi-step search process, description of report output structure, and independent corroboration of research depth/accuracy.

                        • [claimed-docs] Find, synthesize, and understand information faster with Researcher.
                        • [claimed-docs] This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…
                        • [claimed-docs] Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.
                      2. knowledge-workerGet answers grounded in current web results with citations back to the sources

                        weight 2 · round to Microsoft Copilot
                        Geminipartialclaimed6/10

                        Gemini's Deep Research feature explicitly supports 'in-depth and real-time research on almost any subject,' implying grounded, current-web-based answers, and users can add further sources for research context. However, the evidence pack never explicitly documents inline citation links back to specific web sources, nor independent confirmation that citations are reliably shown. Missing for 10: explicit documentation of citation/source-linking UI, independent verification that citations are accurate and consistently displayed.

                        • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
                        • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                        Microsoft Copilotfullclaimed8/10

                        Docs explicitly state Copilot grounds responses in high-ranking web content and provides hyperlinked citations after generated responses, directly matching the story; this is corroborated by broader documentation on research/answer features (Researcher, ask questions and get answers fast). Missing for 10: independent hands-on verification of citation accuracy/quality and no community evidence specifically testing web-grounded citation behavior.

                        • [claimed-docs] This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…
                        • [claimed-docs] Ask questions and get answers fast.
                        • [claimed-docs] Find, synthesize, and understand information faster with Researcher.

                      Trust controls — stories about trust controls in this arenaTrust controls

                      Stories about trust controls in this arena

                      Admin

                      1. team-adminManage members, permissions, and data policies for my organization's workspace

                        weight 2 · round drawn
                        Gemininone0/10

                        Evidence only shows end-user features (image generation, Live conversations, notebooks, connected apps) and passing mentions that a 'work or school account' administrator can 'enable Gemini,' but there is no evidence of an admin console for managing members, setting permissions, or configuring org-wide data policies.

                          Microsoft Copilotnone0/10

                          The evidence pack covers only individual/consumer Copilot features (writing, spreadsheets, browsing, memory, privacy opt-outs for personal conversations) with no mention of team/workspace admin controls such as member management, role-based permissions, or organizational data policies. Missing for 10: admin console documentation, member/role management, org-wide data governance policies, and any evidence of a team-admin experience.

                          Data controls

                          1. knowledge-workerExport my complete chat history and account data

                            weight 1 · round drawn
                            Gemininone0/10

                            The evidence only covers reviewing and deleting Gemini activity via My Activity (gemini-docs-31) and privacy settings for Live audio (gemini-docs-37, gemini-docs-38), but there is no mention of exporting chat history or account data (e.g., via Google Takeout or a dedicated export tool). missing for 10: any documentation of an export/download feature for chat history or account data, independent confirmation of export completeness.

                            • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                            Microsoft Copilotnone0/10

                            Evidence shows users can delete individual conversations or entire history (copilot-docs-38) and opt out of training use (copilot-docs-35), but there is no mention of an export/download feature for complete chat history or account data as required by the story.

                            • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                            • [claimed-docs] opt out of use of your conversation activity for model training
                          2. knowledge-workerControl whether my conversations are used to train models

                            weight 3 · round to Gemini
                            Geminifullclaimed8/10

                            Google's own support docs state that by default chats/uploaded files aren't used to improve generative AI models unless a user opts in via 'Keep Activity', and that users can review, delete activity, or turn off Keep Activity at any time; separately, users must explicitly consent to let Google use Gemini Live audio/video for model training. This gives knowledge-workers clear, documented control over whether conversations feed model training. Missing for 10: independent/hands-on verification that these settings work as described and clarity on enterprise/Workspace account defaults.

                            • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                            • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                            • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                            Microsoft Copilotpartialcommunity6/10

                            Microsoft's own docs confirm a control exists: users can opt out of conversation activity being used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38). However, community evidence indicates confusion about scope—one commenter notes the opt-out applies to standalone Copilot chat/app, not to Copilot embedded in Office apps like Word (copilot-comm-1), and another user reports genuine uncertainty whether their Word document was being used for training with no clear indication (copilot-comm-6). Missing for 10: clear unified documentation covering training-data opt-out scope across all Copilot surfaces (Office-integrated vs standalone), and independent verification that the opt-out setting functions as described.

                            • [claimed-docs] opt out of use of your conversation activity for model training
                            • [claimed-docs] Train our generative AI models to create a better experience for you and others.
                            • [claimed-docs] you can delete individual conversations or your entire conversation history at any time
                            • [community] To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.
                            • [community] When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…

                          Not comparable on these axes

                          1. ai-native userRun the product headlessly / in CI for automation

                            weight 2 · not comparable
                            Gemininone0/10

                            The evidence pack is dominated by consumer-facing Gemini Apps documentation (chat, image generation, Gemini Live, notebooks) and contains no first-party documentation of a headless mode, CI integration, or automation-friendly API/CLI usage. The only hint of a CLI tool appears in community complaints (gemini-comm-14, gemini-comm-15) about login failures for Workspace accounts trying to use 'Gemini CLI' for software development, which does not establish that headless/CI automation works.

                            • [community] I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber, but I now learn I should be a 'Gemini Code Assist Standard or Ent…
                            • [community] 'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …
                            Microsoft Copilotn/a

                            Microsoft Copilot is a consumer/office chat assistant product, not a developer tool or API/CLI designed for headless automation or CI pipelines; there's no evidence of any API, CLI, or SDK for scripted/headless invocation. This axis is a category mismatch for this product type.

                            • ai-native userConnect an agent via an official MCP server

                              weight 3 · not comparable
                              Geminin/a

                              Gemini is itself an AI assistant/agent product; the evidence shows only that it can connect outward to other apps (Connected Apps, code import) as a client, not that it exposes an official MCP server for other agents to connect to it. Per the agent-role exception, this axis does not apply unless Gemini documents running as an MCP server, which no evidence here shows.

                              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                              • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                              • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
                              Microsoft Copilotn/a

                              Microsoft Copilot is itself an AI assistant/agent; the evidence only shows it acting as a client connecting to other services (OneDrive, Gmail, etc.) rather than exposing itself as an MCP server for other agents. Per the agent-role exception, this axis does not apply unless there's evidence of Copilot running as an MCP server, which is absent here.

                              • [claimed-docs] Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …
                              • [claimed-docs] Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)
                            • ai-native userIssue scoped/least-privilege API credentials for an agent

                              weight 2 · not comparable
                              Geminin/a

                              Gemini is an AI product/app, not a platform issuing API credentials with scoped permissions for agents; the evidence pack covers consumer features (imports, images, connected apps) with no mention of credential scoping or API key/permission management for agents, so this axis is a category error for this product's evidenced role.

                                Microsoft Copilotnone0/10

                                No evidence describes issuing scoped or least-privilege API credentials for an agent; Copilot's documented connectors involve OAuth-style account sign-in to consumer services, not developer-controlled scoped credential issuance. missing for 10: any mention of API keys, scoped tokens, permission scoping, or credential management for agent access.

                                • ai-native userExplore an interactive API reference with runnable examples

                                  weight 2 · not comparable
                                  Geminin/a

                                  This story asks for an interactive API reference with runnable examples, which is a developer-portal/API-docs concern, not a fair axis for Gemini Apps (the consumer product surfaced in this evidence pack). The evidence pack covers Gemini's app features (Gems, Connected Apps, Deep Research, Live) but contains no mention of an interactive API reference, making this a wrong-axis question for the product as evidenced.

                                    Microsoft Copilotn/a

                                    Microsoft Copilot is a consumer/productivity AI assistant, not a developer API/SDK product, so the concept of an interactive API reference with runnable examples is a category error for this axis.

                                    • ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

                                      weight 2 · not comparable
                                      Geminin/a

                                      Gemini here refers to the consumer AI assistant app/product; the story asks for a downloadable machine-readable API spec (OpenAPI), which is a developer-platform artifact, not a consumer app feature. This axis applies to API/platform products, not to the Gemini Apps experience described in the evidence.

                                        Microsoft Copilotnone0/10

                                        No evidence of a machine-readable API spec; explicit probes for OpenAPI/swagger endpoints all returned 404, and no docs mention a public API or spec for Microsoft Copilot as an end-user product.

                                        • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
                                        • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
                                        • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
                                      • ai-native userTest against a sandbox environment without touching production data

                                        weight 1 · not comparable
                                        Geminin/a

                                        Gemini is a consumer/enterprise assistant product, not a dev platform with sandbox/production data environments; the evidence pack shows no sandbox testing environment concept, making this axis a category error for this product type.

                                          Microsoft Copilotn/a

                                          Microsoft Copilot is a consumer/productivity AI assistant, not a developer platform with sandbox/test environments distinct from production data; no evidence pack content addresses sandbox testing concepts at all, and this axis is a category error for this product type.

                                          • ai-native userRead the product's source under an open license

                                            weight 2 · not comparable
                                            Geminin/a

                                            Gemini is a closed, proprietary AI product; no evidence suggests its source code is available under an open license, and open-sourcing the model itself is not a plausible axis for this kind of commercial closed product.

                                              Microsoft Copilotnone0/10

                                              Microsoft Copilot is closed-source proprietary software; no evidence indicates any open-license source availability, and probes for docs/API artifacts returned 404s. This is an applicable axis (a product could conceivably be open-sourced) but no evidence supports it, so verdict is none rather than na.

                                              • [probe] PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt
                                              • [probe] PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md
                                              • [probe] PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…
                                            • ai-native userSelf-host the core product

                                              weight 3 · not comparable
                                              Geminin/a

                                              Gemini is a closed, proprietary hosted AI service with no evidence of any self-hostable model weights or on-prem deployment option; self-hosting is not a plausible axis for this cloud-only consumer/enterprise product category.

                                                Microsoft Copilotnone0/10

                                                Microsoft Copilot is a cloud-hosted SaaS product with no evidence of any self-hosted or on-premises deployment option; all documentation describes it as a hosted service (Copilot.com, Microsoft 365 cloud integration, Edge browser actions) with no self-hosting mechanism mentioned.