Gemini vs Grok

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to Grok
   Gemini—none0/10

   No evidence that Gemini can be pointed at llms.txt or agent-oriented documentation formats; the evidence only covers uploading files, GitHub repos, and connecting to apps, none of which address consuming llms.txt or agent-facing docs conventions. Missing for 10: any mention of llms.txt support, agent-oriented doc parsing, or a documented workflow for feeding agent-discovery docs to Gemini.

   ⚑ flag

   Grok✓fullprobed9/10

   The docs site serves a discoverable llms.txt (HTTP 200, describing itself as official xAI developer documentation) and every doc page is also available in plain markdown form, which is exactly the agent-oriented docs pattern the story asks for. Missing for 10: independent/community confirmation that agents actually consume this llms.txt successfully in practice.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
   • [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
   • [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to Grok
   Gemini—none0/10

   The evidence pack is dominated by consumer-facing Gemini Apps documentation (chat, image generation, Gemini Live, notebooks) and contains no first-party documentation of a headless mode, CI integration, or automation-friendly API/CLI usage. The only hint of a CLI tool appears in community complaints (gemini-comm-14, gemini-comm-15) about login failures for Workspace accounts trying to use 'Gemini CLI' for software development, which does not establish that headless/CI automation works.

   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber, but I now learn I should be a 'Gemini Code Assist Standard or Ent…”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …”

   proof ↗⚑ flag

   Grok~partialprobed6/10

   The xAI API (REST, OpenAPI spec confirmed via probe, streaming, structured outputs, quickstart script) provides a clear headless programmatic interface suitable for automation/CI, and community mentions a 'terminal' mode for Grok Build. However there is no explicit CI/CD documentation, GitHub Actions example, or non-interactive automation guide. missing for 10: dedicated CI/CD integration docs, GitHub Actions or pipeline examples, explicit 'headless mode' documentation.

   • [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
   • [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
   • [claimed-docs] “Streaming outputs is **supported by all models with text output capability**”
   • [claimed-docs] “Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
   • [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
   • [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”

   proof ↗⚑ flag

3. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round to Grok
   Gemini—none0/10

   Evidence covers Gemini Apps' 'Connected Apps' feature (Gmail, Calendar, Maps, Flights) and coding-related uploads (GitHub repos, folders), but nothing describes plugging in Model Context Protocol (MCP) servers as a tool-connection mechanism. Missing for 10: any documentation or mention of MCP server support, MCP client configuration, or third-party tool registration via MCP standard.

   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses.”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [claimed-docs] “Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.”

   proof ↗⚑ flag

   Grok✓fullclaimed7/10

   xAI docs explicitly describe adding custom MCP connectors and tunneling a local MCP server so Grok can reach it and use its tools, alongside built-in OAuth connectors for other tools (grok-docs-2, grok-docs-3, grok-docs-38, grok-docs-19). Missing for 10: independent/hands-on confirmation that custom MCP tool-calling works reliably in practice, and more detail on protocol/version compatibility.

   • [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
   • [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
   • [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”

   proof ↗⚑ flag

4. ai-native userUse an official CLI

   weight 2 · round to Gemini
   Gemini~partialcommunity4/10

   Community discussion confirms the existence of an official 'Gemini CLI' used for software development (comm-13, comm-14), but there is no first-party documentation of it in the evidence pack, and a hands-on report shows it fails to work for Workspace accounts ('Failed to login... now as a Workspace account I cant use Gemini CLI for my work') (comm-15). Missing for 10: official CLI documentation/spec, installation and usage guides, and evidence that login/account restrictions have been resolved.

   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…”
   • [community] “I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber, but I now learn I should be a 'Gemini Code Assist Standard or Ent…”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …”

   proof ↗⚑ flag

   Grok~partialcommunity3/10

   There's no official CLI documentation for Grok, but a community comment references a terminal-based interface for 'Grok Build' ('terminal is nice but codex desktop app is very useful'), suggesting some CLI-like coding tool exists even though it isn't documented in the official docs pack. missing for 10: official CLI documentation/reference, installation instructions, and command examples confirming a first-party CLI product.

   • [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
   • [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”

   proof ↗⚑ flag

5. ai-native userDrive the product through a documented public API

   weight 3 · round to Grok
   Gemini~partialcommunity5/10

   Community evidence confirms a public Gemini API exists and is actively used by developers (pricing tiers, model versions, Google AI Studio parameters like temperature and top_k), but the evidence pack contains no first-party API reference documentation, and one community report notes undocumented/hidden parameter behavior (fixed top_k, capped temperature) that limits full programmatic control. missing for 10: first-party API reference/docs citation, SDK/auth documentation, confirmation that documented parameters match actual behavior.

   • [community] “API pricing is up to $2/M for input and $12/M for output. For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output, Gemini …”
   • [community] “I'm sure this is a very impressive model, but gemini-3-pro-preview is failing spectacularly at my fairly basic python benchmark. In fact, ge…”
   • [community] “My favorite benchmark is to analyze a very long audio file recording of a management meeting and produce very good notes along with a transc…”
   • [community] “Temperature continues to be gated to maximum of 0.2, and there's still the hidden top_k of 64 that you can't turn off. I love the google AI …”
   • [community] “It still failed my image identification test (a photoshopped picture of a dog with 5 legs)... Gemini 3 however, while still failing, at leas…”

   proof ↗⚑ flag

   Grok✓fullprobed9/10

   xAI publishes a full public REST API with documented endpoints for text, image, video, tool use, structured outputs, and an OpenAPI spec confirmed live by probe, plus a quickstart guide, satisfying the AI-native/agentic driving story. missing for 10: independent third-party benchmarking of API reliability/completeness beyond xAI's own docs and anecdotal community chatter about tool-calling quirks.

   • [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
   • [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
   • [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
   • [claimed-docs] “Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
   • [claimed-docs] “Streaming outputs is **supported by all models with text output capability**”
   • [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”

   proof ↗⚑ flag

6. ai-native userBuild against official SDKs

   weight 2 · round to Grok
   Gemini—none0/10

   The evidence pack only covers Gemini's consumer-facing app features (uploads, Gemini Live, Gems, connected apps) and does not document any official SDKs for building applications (e.g., Python/Node/Go SDKs for the Gemini API). Community mentions reference API pricing and a 'Gemini CLI' having login issues, but no concrete SDK documentation or hands-on developer usage evidence is present.

   • [community] “API pricing is up to $2/M for input and $12/M for output. For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output, Gemini …”
   • [community] “'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …”

   proof ↗⚑ flag

   Grok~partialprobed3/10

   The evidence shows an official xAI developer API with a published OpenAPI spec, quickstart docs, and text-generation/tool-use guides (grok-docs-20, grok-docs-27, grok-probe-3), which implies programmatic access an AI-native builder could use, but none of the evidence explicitly names or documents an official SDK (e.g., Python/JS client library) as opposed to raw REST/OpenAPI usage. Missing for 10: explicit documentation of a first-party SDK package, install instructions, or code samples showing SDK usage, plus any independent/community confirmation of SDK quality or adoption.

   • [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
   • [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
   • [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”

   proof ↗⚑ flag

7. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   Gemini—none0/10

   No evidence in the pack describes Gemini offering a webhook subscription mechanism for events; the docs cover imports, connected apps, Gems, Live, Deep Research, etc., but nothing about outbound webhooks or event subscriptions for AI-native/agentic integration.

   ⚑ flag

   Grok—none0/10

   No evidence of any webhook subscription mechanism for Grok events; the docs describe connectors, tools, image/video generation, and inbound MCP tunneling, but nothing about outbound event notifications or webhook endpoints. Missing for 10: any webhook subscription API, event types, or delivery/registration mechanism.

   ⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to Gemini
   Gemini✓fullcommunity8/10

   Gemini's docs show robust support for generating insights from user data: uploading documents/spreadsheets/photos/videos for 'answers, summaries, and insights' (gemini-docs-25), Notebooks for organizing and querying sources (gemini-docs-11, gemini-docs-24, gemini-docs-29), Deep Research for in-depth analysis (gemini-docs-7), and Connected Apps that summarize Gmail and productivity data (gemini-docs-30). Independent hands-on reports corroborate real usage: navigating large codebases effortlessly (gemini-comm-13), replacing an OCR vendor for document ingestion with strong accuracy (gemini-comm-17), and NotebookLM being 'really powerful for comprehending large corpuses' (gemini-comm-19), though one report notes weaker accuracy on visual bounding-box tasks (gemini-comm-18). missing for 10: broader independent benchmarking specifically on insight-generation quality across data types, and resolution of the noted accuracy gaps in some visual tasks.

   • [claimed-docs] “You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…”
   • [claimed-docs] “Notebooks provide a continuous chat experience that remembers your sources, instructions, and ongoing discussions.”
   • [claimed-docs] “you can use notebooks to organize your projects in a dedicated, focused space.”
   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…”
   • [community] “I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…”
   • [community] “I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…”
   • [community] “Unfortunately Gemini really seems to struggle on this, and no matter how we tried prompting it, it would generate wildly inaccurate bounding…”

   proof ↗⚑ flag

   Grok~partialcommunity6/10

   Grok's connectors (Gmail/Calendar, Google Drive, Microsoft Teams, Salesforce, custom APIs/MCP) let it read and act on a user's own data inside the chat, and features like Realtime Multi-agent Research suggest Grok can analyze and synthesize that data into insights. However, the evidence is mostly first-party docs describing data access rather than concrete examples of proactive 'insights and suggestions,' and one hands-on report notes Grok has 'real trouble with agentic tool calling,' undercutting confidence in reliable in-context analysis. Missing for 10: independent hands-on demonstration of Grok surfacing unprompted insights/suggestions from connected data, and confirmation that tool-calling reliability issues don't undermine this in practice.

   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
   • [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
   • [claimed-docs] “Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
   • [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Google's docs explicitly describe scheduling recurring actions so Gemini becomes part of daily/weekly/monthly routines (gemini-docs-8), and the Daily Brief feature autonomously delivers a personalized digest without user prompting (gemini-docs-32/41), supported by action-taking integrations with other apps (gemini-docs-10/17/23/30). However, evidence is limited to first-party docs with no independent/hands-on confirmation of reliability, no detail on trigger conditions, failure handling, or scope of what 'recurring actions' can actually do autonomously. Missing for 10: independent verification that scheduled automations run reliably unattended, documentation on trigger/condition logic, and evidence of broader autonomous multi-step task execution beyond simple digests.

   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses.”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”

   proof ↗⚑ flag

   Grok~partialclaimed4/10

   Grok Bot is described as an AI teammate running on a 'persistent cloud computer' and Grok supports multi-agent orchestration for research tasks, hinting at some background/autonomous agent capability, but there is no documentation of scheduling, triggers, or recurring/timed automation setup. Missing for 10: explicit scheduling/trigger mechanism, details on how automations run without user prompting, and independent confirmation of autonomous background execution.

   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Gemini
   Gemini✓fullcommunity8/10

   Gemini's docs show extensive task delegation: connected apps to take actions in Gmail/Calendar/Maps/Flights (gemini-docs-10, gemini-docs-23, gemini-docs-30), scheduled recurring actions (gemini-docs-8), custom Gems for specific goals (gemini-docs-9), Deep Research for autonomous multi-step research (gemini-docs-7), and Daily Brief proactive digests (gemini-docs-32, gemini-docs-41). Community evidence corroborates real-world delegated use cases like large codebase analysis and audio transcription (gemini-comm-13, gemini-comm-10). missing for 10: independent hands-on verification specifically of agentic task delegation/action-taking (vs. just Q&A), and evidence of reliability/success rate when Gemini executes multi-step delegated tasks.

   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…”
   • [community] “My favorite benchmark is to analyze a very long audio file recording of a management meeting and produce very good notes along with a transc…”

   proof ↗⚑ flag

   Grok!disputedcontradicted6/10

   xAI docs describe strong built-in agentic delegation — Grok Bot hands work to 'AI teammates on a persistent cloud computer,' Realtime Multi-agent Research orchestrates multiple agents for research tasks, and connectors let Grok act on email/calendar/Salesforce from chat (grok-docs-15, grok-docs-26, grok-docs-11, grok-docs-16, grok-docs-19). However, hands-on community testing directly contradicts smooth agentic delegation: a user reports Grok 'had real trouble with agentic tool calling - the model felt like it hadn't been trained to think of tool calling as one of its primary modalities' (grok-comm-6), and another notes the lack of a proper GUI for Grok Build limiting usability (grok-comm-7). Missing for 10: independent verification that Grok Bot/multi-agent research reliably completes delegated tasks end-to-end, and resolution of the reported tool-calling weakness.

   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
   • [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Gemini
   Gemini✓fullclaimed8/10

   Gemini is fundamentally operated via natural-language chat and voice (Gemini Live's free-flowing conversation, 'Hey Google' voice commands, text prompts for image generation, scheduling recurring actions, custom Gems, and connected-app actions) rather than rigid commands or GUIs, per extensive first-party docs. Missing for 10: independent/hands-on verification that complex natural-language action requests (e.g., connected-app task execution) reliably work as described, and community evidence is mixed on model quality/accuracy for specific tasks rather than confirming the NL interface itself.

   • [claimed-docs] “With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…”
   • [claimed-docs] “With Gemini Live, you can have a natural, free-flowing conversation with Gemini.”
   • [claimed-docs] “With Gemini Live, you can: * **Talk back and forth:** Talk to Gemini without typing, and Gemini will respond back verbally.”
   • [claimed-docs] “you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more details or change th…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses.”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [claimed-docs] “On Android, say “Hey Google” to ask Gemini for help with what’s on your screen”

   proof ↗⚑ flag

   Grok~partialcommunity6/10

   Grok's docs describe a chat/voice interface where natural-language input drives text generation, image/video creation, and connector actions like creating Salesforce records or searching email 'directly from chat' (grok-docs-11, grok-docs-16, grok-docs-35, grok-docs-40), which is core evidence for NL-command operation. However, hands-on community testing reports real trouble with agentic tool calling, saying the model 'hadn't been trained to think of tool calling as one of its primary modalities' (grok-comm-6), which tempers confidence that NL commands reliably trigger tool/connector actions. Missing for 10: independent benchmarks or user reports specifically confirming reliable NL-to-action execution across the built-in connectors, and no clear resolution of the tool-calling reliability concern.

   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
   • [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
   • [claimed-docs] “Talk to Grok hands-free with voice.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”

   proof ↗⚑ flag

Api quality

1. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Gemini—none0/10

   The evidence pack is entirely consumer-focused Gemini Apps documentation (image generation, Gemini Live, connected apps, notebooks) and general community sentiment about model quality/pricing; there is no mention of API versioning, version lifecycle, or a documented deprecation policy anywhere in the pack.

   ⚑ flag

   Grok—none0/10

   The evidence shows model version slugs (grok-4.6, grok-4.5) and an OpenAPI spec, but no documentation of a formal deprecation policy, sunset timelines, or versioning guarantees for the API. Release notes describe new features and model updates but never state how/when older model versions are retired.

   • [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
   • [claimed-docs] “grok-4.6` and `grok-4.5` support the `reasoning_effort` parameter, which controls how much effort the model spends thinking before respondin…”
   • [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”

   proof ↗⚑ flag

Agent mode

1. power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review

   weight 3 · round drawn
   Gemini~partialclaimed6/10

   Deep Research lets users delegate an open-ended research task that Gemini works on autonomously and returns a report for review, and scheduled/recurring actions show background task automation; Connected Apps/Gems add some autonomous action-taking on the user's behalf. However there's no clear evidence of a general-purpose multi-step 'agent mode' that plans and executes across arbitrary apps end-to-end with an explicit review/approval step, nor independent hands-on confirmation of this workflow. Missing for 10: evidence of a broad autonomous agent (beyond Deep Research/scheduling) handling arbitrary multi-step tasks across apps, and independent/community validation of such background task delegation working reliably.

   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”

   proof ↗⚑ flag

   Grok~partialcommunity6/10

   Docs describe 'Grok Bot' as handing 'real work to AI teammates on a persistent cloud computer' and a 'Realtime Multi-agent Research' feature that orchestrates multi-step research autonomously, directly matching the story's core idea of background delegation and review. However, evidence is vendor-doc only with no independent confirmation of the async review workflow (notifications, task state, resuming), and community feedback (grok-comm-6) notes real trouble with agentic tool calling, suggesting reliability caveats. Missing for 10: independent hands-on validation of the background-task lifecycle, detail on how results are surfaced for review, and confirmation tool-calling reliability issues don't undermine multi-step autonomy.

   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
   • [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
   • [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”

   proof ↗⚑ flag

2. power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites

   weight 3 · round to Gemini
   Gemini~partialclaimed4/10

   Deep Research lets Gemini conduct 'in-depth and real-time research' across web sources, and Connected Apps let it take actions in other apps (Gmail, Calendar, Maps, Flights) with permission — showing some research/task-automation capability. However, there is no evidence of Gemini actually driving a web browser (navigating pages, clicking, filling forms) to complete tasks on arbitrary websites, only sanctioned first-party app integrations. Missing for 10: explicit browser-control/agentic navigation evidence, hands-on demonstration of completing a multi-step website task, independent corroboration of this capability.

   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence shows connectors for APIs, email, calendar, Salesforce, and a vague 'Grok Bot' cloud computer teammate, but nothing documents Grok actually driving a web browser to navigate sites or complete tasks (no browsing/computer-use agent feature is described). Multi-agent research (grok-docs-26) is about research orchestration, not website interaction, so this applicable-but-unevidenced capability is 'none'.

   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”

   proof ↗⚑ flag

3. power-userLet the assistant see and operate applications on my computer to complete work

   weight 2 · round to Gemini
   Gemini~partialclaimed5/10

   Gemini's Connected Apps feature lets it take actions in other apps (Gmail, Calendar, Maps, Flights) with permission, and on Android it can see what's on-screen to help with context, but this is limited to a curated set of app integrations/APIs rather than general computer-use/desktop automation across arbitrary applications. Missing for 10: broader OS-level screen perception, ability to click/type across arbitrary desktop apps, and independent hands-on evidence of an agentic computer-use mode.

   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses.”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [claimed-docs] “On Android, say “Hey Google” to ask Gemini for help with what’s on your screen”
   • [claimed-docs] “Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.”

   proof ↗⚑ flag

   Grok—none0/10

   Grok offers connectors (Gmail, Drive, Teams, Salesforce, custom MCP) and a 'Grok Bot' that operates on a persistent *cloud* computer, but there is no evidence of Grok seeing or controlling applications running on the user's own local machine/desktop (e.g., screen/GUI control akin to computer-use agents). Missing for 10: any documented local-computer screen/GUI control, first-party or hands-on evidence of operating a user's own desktop apps.

   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”

   proof ↗⚑ flag

Tasks

1. power-userSchedule recurring or one-off tasks that run automatically and come back to me with results

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Gemini docs confirm scheduling recurring actions (gemini-docs-8) and Daily Brief personalized digest (gemini-docs-32/41), showing one-off/recurring automated tasks that return results. However, evidence lacks detail on task complexity, multi-step agent tasks, notification delivery mechanisms, or independent/community corroboration of this specific feature working reliably. missing for 10: detailed documentation on scheduling flexibility, agentic multi-step task execution, notification/result delivery mechanisms, and independent hands-on validation of the scheduled-tasks feature.

   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack shows connectors, tool integrations, and a 'Grok Bot' persistent cloud agent for handing off work, but no mention of scheduling recurring or one-off tasks that run automatically and report back results.

   ⚑ flag

Apps

1. power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen

   weight 2 · round to Gemini
   Gemini~partialclaimed5/10

   Docs confirm an official Mac desktop app with a global OS-level keyboard shortcut (Option+Space) to summon Gemini without opening a browser [gemini-docs-15, gemini-docs-36, gemini-docs-20], but the only 'see what's on your screen' capability documented is for the Android mobile app via 'Hey Google' [gemini-docs-6], not the desktop app. Missing for 10: evidence of desktop screen-reading/screenshare capability, and independent/hands-on confirmation of the desktop shortcut and screen access working together.

   • [claimed-docs] “you can also use the keyboard shortcut Option + Space to bring up the Gemini chat window after the app is installed and running”
   • [claimed-docs] “The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…”
   • [claimed-docs] “What you need to use the Gemini app on Mac * A personal Google Account you manage on your own, or a work or school account that your adminis…”
   • [claimed-docs] “On Android, say “Hey Google” to ask Gemini for help with what’s on your screen”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack shows only cross-platform sign-in sync and hands-free voice, but no mention of an official desktop app with OS-level shortcuts or screen-reading/access capability; a community comment even notes the lack of a proper GUI for Grok's coding product ('still waiting for a proper gui for grok build ... codex desktop app is very useful'), suggesting no such desktop tool exists.

   • [claimed-docs] “Sign in once and your conversations, settings, and subscription stay in sync across every platform.”
   • [claimed-docs] “Talk to Grok hands-free with voice.”
   • [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”

   proof ↗⚑ flag

2. knowledge-workerUse full-featured official mobile apps for iOS and Android

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Docs confirm a full-featured Gemini mobile app with rich functionality (Gemini Live voice conversations, screen-aware Android assistant via 'Hey Google', Maps/Flights integration, daily briefs, scheduling, image generation, coding help) showing strong Android support, and generic mobile-app language implies broader availability, but the evidence never explicitly names or details an iOS app or iOS-specific parity. missing for 10: explicit iOS app documentation/feature parity, App Store presence, and any cross-platform comparison confirming equal functionality on iOS vs Android.

   • [claimed-docs] “On Android, say “Hey Google” to ask Gemini for help with what’s on your screen”
   • [claimed-docs] “With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…”
   • [claimed-docs] “Make plans with Google Maps and Google Flights”
   • [claimed-docs] “The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…”
   • [claimed-docs] “get help with writing, brainstorming, coding, and more, without needing to open a web browser.”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [claimed-docs] “If you have access to Gemini Apps with a work or school account, some Gemini mobile app features aren’t available.”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”

   proof ↗⚑ flag

   Grok~partialclaimed4/10

   Docs mention voice mode ('Talk to Grok hands-free with voice') and cross-platform sync of conversations/settings/subscriptions, implying mobile app support, but there is no explicit confirmation of dedicated full-featured iOS and Android apps, no app-store links, and no community/hands-on feedback about mobile app quality or feature parity with desktop/web. Missing for 10: explicit iOS/Android app documentation, feature-parity details, and independent user reviews of the mobile apps themselves.

   • [claimed-docs] “Talk to Grok hands-free with voice.”
   • [claimed-docs] “Sign in once and your conversations, settings, and subscription stay in sync across every platform.”

   proof ↗⚑ flag

Custom bots

1. power-userBuild and share custom assistants with their own instructions and knowledge

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Gemini's "Gems" feature (gemini-docs-9) lets power-users create a custom Gem with its own instructions and requirements, and Gems can be given knowledge via uploaded files/sources (gemini-docs-25), directly matching the core of this story. However, evidence does not confirm a straightforward sharing/publishing mechanism for Gems to other users, nor independent hands-on validation of the feature's robustness. Missing for 10: documentation of sharing/publishing custom Gems with other users, evidence of knowledge-base scope/limits, and independent community corroboration of Gems in practice.

   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [claimed-docs] “You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack covers connectors, tool integrations, MCP, image/video generation, and enterprise features, but there is no mention of a feature to create and share custom assistants/personas with their own instructions and knowledge base (akin to OpenAI's GPTs or Claude Projects).

   ⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Grok
   Gemini~partialcommunity3/10

   Gemini supports uploading whole code folders/repos and large codebases (a form of bulk ingestion) and can take actions across connected apps or run scheduled recurring actions, but there is no explicit documentation of a bulk/batch operation feature (e.g., applying an action to many items at once like bulk-editing files, mass-tagging, or batch task execution) as an AI-native automation capability. missing for 10: explicit bulk-action/batch-processing feature, evidence of applying one instruction across many discrete items simultaneously, independent corroboration of this specific capability.

   • [claimed-docs] “To add a code folder: click More Uploads Import Code Upload folder.”
   • [claimed-docs] “To add a code folder: click More Uploads ... Import Code ... Upload folder.”
   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [community] “I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…”

   proof ↗⚑ flag

   Grok~partialclaimed4/10

   The docs mention batch generation of multiple images and support for up to 5 source images in a single edit, which is a narrow form of bulk operation, but there's no evidence of general-purpose bulk operations (e.g., bulk file processing, bulk record updates, batch text API) across many items or arbitrary data types. Missing for 10: a true batch/bulk API for text or file processing, bulk actions on connector data (e.g., mass email/calendar updates), and independent confirmation that these batch features work reliably at scale.

   • [claimed-docs] “Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ra…”
   • [claimed-docs] “Image editing now accepts up to 5 source images per request (was 3).”
   • [claimed-docs] “Use up to five source images for a single image edit.”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to Gemini
   Gemini~partialclaimed4/10

   Gemini supports 'scheduling recurring actions' as part of daily/weekly/monthly routines (gemini-docs-8), which is a form of automation, but this is time-based scheduling rather than user-defined conditional rules that trigger on arbitrary events. Connected Apps let Gemini take actions in other apps (gemini-docs-10, gemini-docs-23, gemini-docs-30) but only in response to a direct user request, not an automatic event trigger. Missing for 10: evidence of event-based (not just time-based) trigger conditions, ability to define custom 'if X happens then do Y' rules, and any confirmation of conditional logic beyond fixed recurring schedules.

   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”

   proof ↗⚑ flag

   Grok—none0/10

   Grok's docs describe connectors, tool integrations, and a persistent 'Grok Bot' cloud agent, but nothing describes user-defined rules that trigger actions automatically on external events (e.g., webhooks, triggers, if-this-then-that automations, or scheduled event listeners). The axis is plausible for an AI-native product with tool/connector access, so this is 'none' rather than 'na'.

   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Gemini docs explicitly confirm scheduling recurring actions ('daily, weekly, and monthly routines') via a dedicated feature (gemini-docs-8), and Daily Brief shows an example of a recurring automated digest (gemini-docs-32/41). However, evidence lacks detail on workflow complexity, chaining multiple steps/tools, error handling, or independent/community validation of this scheduling feature. missing for 10: detail on multi-step workflow scheduling, chaining across apps, reliability/error handling, and independent hands-on confirmation.

   • [claimed-docs] “You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”

   proof ↗⚑ flag

   Grok—none0/10

   No evidence of scheduling, cron-like recurrence, or persistent recurring workflow features anywhere in the docs; Grok Bot ('persistent cloud computer') and connectors describe on-demand agents/tools, not scheduled recurring jobs.

   ⚑ flag

4. ai-native userVersion, review, and roll back my automations

   weight 1 · round drawn
   Gemini—none0/10

   No evidence of version control, review workflows, or rollback capabilities for automations (e.g., scheduled actions, Gems, or connected app actions). The evidence only covers scheduling recurring actions and connecting apps, with no mention of versioning, diffing, review approval, or rollback of automations.

   ⚑ flag

   Grok—none0/10

   No evidence describes any versioning, review, diffing, or rollback mechanism for automations/agents/connectors built with Grok; the docs cover connectors, generation capabilities, and workspace management but nothing about tracking or reverting automation history.

   ⚑ flag

Connectors

1. power-userBrowse a directory of third-party apps and connectors and add them to the assistant

   weight 2 · round drawn
   Gemini~partialclaimed6/10

   Gemini docs describe a 'Connected Apps' feature that lets users link Gmail, Calendar, Maps, Flights and 'a variety of productivity apps' so Gemini can search/create content and take actions, which matches the connectors-directory concept ([gemini-docs-10],[gemini-docs-17],[gemini-docs-23],[gemini-docs-30],[gemini-docs-33],[gemini-docs-19]). However, the evidence never shows a browsable app-store-like directory UI, doesn't clarify how many third-party (non-Google) apps are included, and there's no independent/hands-on confirmation of the browse-and-add experience. Missing for 10: explicit directory/marketplace UI screenshots or docs, breadth of third-party (non-Google) app listings, independent user corroboration of adding connectors.

   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses.”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [claimed-docs] “Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.”
   • [claimed-docs] “Make plans with Google Maps and Google Flights”

   proof ↗⚑ flag

   Grok~partialclaimed6/10

   Docs show Grok exposes a set of built-in, OAuth-authenticated connectors (Salesforce, Gmail, Google Calendar, Google Drive, Microsoft Teams) plus custom/MCP connectors that a user can add to reach external tools (grok-docs-16,19,35,36,37,2,3). This matches the 'add third-party apps/connectors' part of the story, but there's no explicit evidence of a browsable directory/marketplace UI, ratings, or a curated catalog page for discovering connectors. missing for 10: a documented directory/marketplace UI for browsing connectors, independent user confirmation of the browse experience.

   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
   • [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
   • [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
   • [claimed-docs] “Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
   • [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
   • [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”

   proof ↗⚑ flag

2. knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers

   weight 3 · round drawn
   Gemini✓fullclaimed8/10

   Google's docs describe first-party 'Connected Apps' letting Gemini summarize Gmail, create Calendar events, search across productivity apps, and use personal Gmail/Drive as sources for Deep Research, directly matching the story's cloud drive/email/calendar connector requirement. Missing for 10: independent/hands-on verification of search quality and confirmation that calendar reading (not just event creation) works reliably.

   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses.”
   • [claimed-docs] “With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.”
   • [claimed-docs] “You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…”
   • [claimed-docs] “Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…”
   • [claimed-docs] “Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.”

   proof ↗⚑ flag

   Grok✓fullclaimed8/10

   Grok docs explicitly describe built-in OAuth connectors for Gmail, Google Calendar, and Google Drive that let it search emails, read files, and manage calendar items right inside chat, plus a broader connectors framework for other SaaS tools. This directly matches the story of connecting cloud drive, email, and calendar for search/use in answers. Missing for 10: independent/hands-on confirmation of these specific connectors working reliably in practice (community evidence largely covers coding/chat quality, not connector behavior).

   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
   • [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”

   proof ↗⚑ flag

Analysis

1. power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files

   weight 3 · round drawn
   Gemini—none0/10

   The evidence pack shows Gemini can import/upload code folders and GitHub repos and get 'insights' from uploaded documents/spreadsheets, but there is no evidence of an actual code-execution/sandbox feature that writes and runs code to produce charts, computed answers, or downloadable output files. No docs or community reports describe this specific data-analysis-with-code-execution workflow.

   • [claimed-docs] “To add a GitHub repository: More Uploads Import Code and enter the GitHub repository or branch URL.”
   • [claimed-docs] “To add a code folder: click More Uploads Import Code Upload folder.”
   • [claimed-docs] “You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence describes Grok's coding assistant (Grok Build), connectors for email/calendar/files, image/video generation, and multi-agent research, but nothing documents a code-interpreter style capability where Grok writes and executes code against user-supplied data to produce charts, computed answers, or downloadable output files. Community comments discuss coding quality and agentic tool-calling issues but not this specific data-analysis/file-output workflow.

   • [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
   • [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”

   proof ↗⚑ flag

Artifacts

1. knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export

   weight 2 · round to Gemini
   Gemini~partialclaimed4/10

   Evidence documents Gemini's ability to generate and iteratively edit images (Nano Banana) with export/download at set resolutions, and general writing assistance, but there is no evidence of a dedicated document or presentation creation/editing workflow (e.g., a canvas-style doc/slide editor) with export to file formats. Missing for 10: explicit documentation of creating/iterating on text documents or slide decks, and exporting them to standard file formats (docx/pptx/pdf).

   • [claimed-docs] “You can create captivating images in seconds with Nano Banana 2. From work, play, or anything in between, Gemini Apps can help you generate …”
   • [claimed-docs] “Local edits: Making quick and specific changes to parts of an image.”
   • [claimed-docs] “Character consistency: Maintain the look of a person or character across various generated images, including the ability to combine multiple…”
   • [claimed-docs] “Download images at at 2K resolution with a Google AI plan or at 1K without an AI plan.”
   • [claimed-docs] “Blend text, images, and video to bring your ideas to life.”
   • [claimed-docs] “The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack shows Grok connectors for reading/searching Google Drive, Gmail, Calendar, and Salesforce, plus image/video generation and coding via Grok Build, but nothing describes a document/presentation authoring or iterative-editing feature (e.g., a canvas-style doc editor) with export to file formats like Word/PowerPoint/PDF.

   • [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”

   proof ↗⚑ flag

Files

1. knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents

   weight 3 · round to Gemini
   Gemini✓fullcommunity8/10

   First-party docs explicitly state users can upload documents, spreadsheets, and more to get answers, summaries, and insights (gemini-docs-25), and independent hands-on evidence corroborates accurate document/PDF analysis (a fintech user reporting 96% OCR accuracy on PDFs, comm-17) plus praise for NotebookLM's ability to comprehend large source corpora (comm-19). Missing for 10: dedicated evidence on spreadsheet-specific accuracy and broader independent benchmarking across document types beyond the single fintech PDF case.

   • [claimed-docs] “You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…”
   • [community] “I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…”
   • [community] “I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…”

   proof ↗⚑ flag

   Grok~partialclaimed5/10

   Docs show Grok can ingest images and connect to Google Drive/Gmail to search and read files, and boasts a 500k context window for knowledge work, implying some document handling, but there is no explicit documentation of native PDF or spreadsheet upload/parsing in the core chat UI, nor any accuracy benchmarks or hands-on validation of document analysis. Missing for 10: explicit PDF/spreadsheet upload feature docs, accuracy testing/validation, independent user reports confirming reliable document analysis.

   • [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
   • [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
   • [claimed-docs] “Some models allow images in the input. The model will consider the image context when generating the response.”
   • [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”

   proof ↗⚑ flag

Memory

1. power-userHave the assistant remember relevant context from previous chats and apply it in new conversations

   weight 3 · round to Gemini
   Gemini✓fullclaimed8/10

   Gemini docs explicitly describe a personalization feature where 'the memory of your past Gemini chats' informs new conversations, plus user controls to review/delete that activity, confirming both the capability and its persistence across sessions. Missing for 10: independent hands-on validation of cross-chat memory recall accuracy and more detail on scope/duration of retained context.

   • [claimed-docs] “You can get a personalized experience in Gemini Apps based on: The memory of your past Gemini chats”
   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack shows conversation storage (grok-docs-21) and cross-device sync of conversations/settings (grok-docs-41), but nothing describing a memory feature that recalls relevant context from past chats and applies it to new, unrelated conversations. No docs or community reports confirm persistent cross-chat memory recall.

   ⚑ flag

2. power-userSet persistent custom instructions and preferences that shape every response

   weight 1 · round to Gemini
   Gemini~partialclaimed5/10

   Gemini offers a 'memory of past chats' personalization feature (gemini-docs-18) and custom Gems that let users pre-set instructions/goals (gemini-docs-9), which together approximate persistent customization, but there's no documented single 'custom instructions' setting that explicitly shapes every response across all chats. Missing for 10: explicit persistent instruction/preference settings applied globally to every response, independent verification of memory consistency, and detail on how memory interacts with different chat sessions.

   • [claimed-docs] “You can get a personalized experience in Gemini Apps based on: The memory of your past Gemini chats”
   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”

   proof ↗⚑ flag

   Grok—none0/10

   No evidence pack items describe a settings feature for persistent custom instructions or personality/preference profiles that shape all future responses; only per-request system prompts, connectors, and server-side storage of past prompts/responses are documented.

   ⚑ flag

Projects

1. knowledge-workerOrganize related chats and files into a project or space that shares context and instructions

   weight 2 · round to Gemini
   Gemini✓fullcommunity7/10

   Gemini's 'Notebooks' feature explicitly provides a continuous, focused space that remembers sources, instructions, and ongoing chat history, and lets users upload documents, code, and other files into that same organized context (gemini-docs-11, gemini-docs-24, gemini-docs-25, gemini-docs-29). Custom Gems (gemini-docs-9) further let users set persistent instructions for recurring tasks, and independent commentary confirms NotebookLM/Notebooks are genuinely useful for organizing large source sets into a coherent project workspace (gemini-comm-19), though that same source flags UI/display shortcomings. Missing for 10: no first-party doc detailing multi-chat organization within one persistent 'project' the way competitors define it, and no hands-on evidence of shared-instruction consistency across many chats in the same notebook.

   • [claimed-docs] “Notebooks provide a continuous chat experience that remembers your sources, instructions, and ongoing discussions.”
   • [claimed-docs] “you can use notebooks to organize your projects in a dedicated, focused space.”
   • [claimed-docs] “You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…”
   • [claimed-docs] “You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…”
   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [community] “I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence describes team 'workspaces' for licensing, SSO, and sharing conversations among teammates, plus connectors for external tools, but there is no mention of a project/space construct that groups related chats and files together with shared custom instructions or context, unlike dedicated 'Projects' features in other chat products.

   • [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
   • [claimed-docs] “Share conversations only with team members who have active licenses.”
   • [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”

   proof ↗⚑ flag

Images

1. knowledge-workerGenerate and edit images from natural-language prompts

   weight 2 · round to Grok
   Gemini✓fullclaimed8/10

   Gemini docs explicitly describe generating and editing images via natural-language prompts (Nano Banana 2), including local edits, character consistency, blending images, and resolution export options. missing for 10: independent hands-on corroboration of image editing quality and no community evidence testing this specific feature.

   • [claimed-docs] “You can create captivating images in seconds with Nano Banana 2. From work, play, or anything in between, Gemini Apps can help you generate …”
   • [claimed-docs] “Local edits: Making quick and specific changes to parts of an image.”
   • [claimed-docs] “Character consistency: Maintain the look of a person or character across various generated images, including the ability to combine multiple…”
   • [claimed-docs] “You can create captivating images in seconds with Nano Banana 2.”
   • [claimed-docs] “Download images at at 2K resolution with a Google AI plan or at 1K without an AI plan.”
   • [claimed-docs] “Blend text, images, and video to bring your ideas to life.”

   proof ↗⚑ flag

   Grok✓fullclaimed9/10

   Grok Imagine and the API both explicitly support text-to-image generation and image editing (including multi-image edits up to 5 sources, aspect ratio control) with docs describing prompt-driven creation and editing directly relevant to knowledge-worker use. Missing for 10: independent hands-on community corroboration specifically of image generation/editing quality (community evidence pack focuses on coding/text/voice, not images).

   • [claimed-docs] “Create images and video with Grok Imagine.”
   • [claimed-docs] “Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ra…”
   • [claimed-docs] “Edit an existing image by providing a source image along with your prompt. The model understands the image content and applies your requeste…”
   • [claimed-docs] “Use up to five source images for a single image edit.”
   • [claimed-docs] “Image editing now accepts up to 5 source images per request (was 3).”
   • [claimed-docs] “New aspect ratios. Image generation and editing accept 21:9 (cinematic widescreen) and 5:2 (wide banners).”
   • [claimed-docs] “Requests to the slug will be served by grok-imagine-image-2.0 with quality set to low, with no change to the request or response shape”

   proof ↗⚑ flag

2. knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them

   weight 2 · round to Grok
   Gemini!disputedcontradicted4/10

   Docs confirm users can upload photos/screenshots and get insights (gemini-docs-25) and get screen-context help via 'Hey Google' (gemini-docs-6), but hands-on reports show real accuracy failures: Gemini generated 'wildly inaccurate bounding boxes' on images (gemini-comm-18) and failed to correctly interpret a manipulated photo, missing key details even in the latest version (gemini-comm-12). A positive OCR use case exists (gemini-comm-17) but that's for PDFs, not general screenshot/photo scene interpretation, so the core 'accurately interpret' claim is contradicted by concrete hands-on failures. Missing for 10: independent benchmarks specifically on screenshot/UI interpretation accuracy, and resolution of the documented bounding-box/detail-recognition failures.

   • [claimed-docs] “You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…”
   • [claimed-docs] “On Android, say “Hey Google” to ask Gemini for help with what’s on your screen”
   • [community] “Unfortunately Gemini really seems to struggle on this, and no matter how we tried prompting it, it would generate wildly inaccurate bounding…”
   • [community] “It still failed my image identification test (a photoshopped picture of a dog with 5 legs)... Gemini 3 however, while still failing, at leas…”
   • [community] “I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…”

   proof ↗⚑ flag

   Grok✓fullclaimed7/10

   Docs confirm image understanding is a first-class capability: models accept image input and 'consider the image context when generating the response' (grok-docs-25), plus related image editing docs show the model 'understands the image content' (grok-docs-29). No independent hands-on report specifically tests screenshot/photo interpretation accuracy. missing for 10: independent/community corroboration of accuracy on real screenshots or photos, detail on multi-image or OCR-style interpretation limits.

   • [claimed-docs] “Some models allow images in the input. The model will consider the image context when generating the response.”
   • [claimed-docs] “Edit an existing image by providing a source image along with your prompt. The model understands the image content and applies your requeste…”
   • [claimed-docs] “Use up to five source images for a single image edit.”

   proof ↗⚑ flag

Voice

1. knowledge-workerHave a natural, real-time voice conversation with the assistant

   weight 2 · round to Gemini
   Gemini✓fullclaimed8/10

   Gemini Live is explicitly documented to support natural, free-flowing, interruptible voice conversations where Gemini talks back verbally in real time, directly matching the story. Missing for 10: independent/hands-on community corroboration specifically validating the voice conversation experience (community evidence covers other Gemini features/models but not Live voice interactions).

   • [claimed-docs] “With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…”
   • [claimed-docs] “With Gemini Live, you can have a natural, free-flowing conversation with Gemini.”
   • [claimed-docs] “With Gemini Live, you can: * **Talk back and forth:** Talk to Gemini without typing, and Gemini will respond back verbally.”
   • [claimed-docs] “you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more details or change th…”

   proof ↗⚑ flag

   Grok✓fullcommunity6/10

   xAI documents hands-free voice conversations directly in Grok ('Talk to Grok hands-free with voice') and separately documents real-time streaming speech-to-text with VAD tuning, indicating a live voice-conversation feature exists. However, missing for 10: independent/hands-on corroboration of voice conversation naturalness or latency, and no detail on turn-taking/interruption handling beyond the VAD parameter.

   • [claimed-docs] “Talk to Grok hands-free with voice.”
   • [claimed-docs] “Speech to Text now accepts a vad_threshold parameter (streaming query param and batch multipart field) to tune the voice-activity gate”
   • [community] “I am excited for the voice mode promised in 'a week' or so. ChatGPT Advanced Voice has been a big disappointment for me... If Grok 3 voice m…”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Grok
   Gemini—none0/10

   The evidence pack details many Gemini Apps UI-only features (Gems, Deep Research, Connected Apps, Daily Brief, Live conversations, Notebooks, scheduling) with no corresponding API documentation showing these are exposed programmatically. Community evidence (e.g., gemini-comm-11) even notes the API/AI Studio path is more restricted (capped temperature, hidden top_k) than the full product, reinforcing that API and UI capability sets are not equivalent.

   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “To create a custom Gem to meet your goals, provide info about your request and requirements.”
   • [claimed-docs] “Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…”
   • [claimed-docs] “With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…”
   • [claimed-docs] “Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…”
   • [community] “Temperature continues to be gated to maximum of 0.2, and there's still the hidden top_k of 64 that you can't turn off. I love the google AI …”

   proof ↗⚑ flag

   Grok~partialprobed5/10

   The xAI API exposes core Grok model capabilities (text, images, video, tools, structured outputs, multi-agent research, connectors) documented alongside an OpenAPI spec, so much of the UI functionality is API-accessible. However, UI-only features like Grok Bot persistent cloud computer, team workspace/SSO/billing management, and built-in OAuth connectors (Gmail, Calendar, Teams, Salesforce) appear tied to the consumer/business app rather than exposed as general API endpoints, and there's no evidence of full parity. Missing for 10: confirmation that workspace/team management, SSO, billing, and native connector orchestration are API-accessible rather than UI-exclusive, plus independent corroboration of full feature parity.

   • [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
   • [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
   • [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
   • [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
   • [claimed-docs] “Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
   • [claimed-docs] “Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”
   • [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round drawn
   Gemini—none0/10

   Evidence covers activity deletion/review (gemini-docs-31) but no mention of exporting data in open/portable formats or data-export tooling for leaving the platform. Missing for 10: any documentation of a data export/download feature (e.g., Google Takeout integration), open-format export options, or independent confirmation of data portability.

   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”

   proof ↗⚑ flag

   Grok—none0/10

   No evidence pack item mentions any data export feature, open format (e.g., JSON/Markdown conversation export) or account data portability tool for Grok; documentation covers connectors, models, and billing but never data export/leave-with-your-data capability.

   ⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Gemini—none0/10

   The evidence pack covers Gemini's features and privacy/data-use settings (e.g., activity retention, human review opt-outs) but contains no mention of data residency or regional storage controls for AI-native/enterprise users. missing for 10: any documentation of region selection, data residency guarantees, or enterprise data-location controls.

   ⚑ flag

   Grok—none0/10

   No evidence in the pack mentions data residency, region selection, or storage location choices for Grok; docs only confirm data is stored on xAI's servers without any residency options (grok-docs-21). Missing for 10: any mention of regional data storage options, residency controls, or compliance certifications tied to geography.

   • [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”

   proof ↗⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round to Gemini
   Gemini~partialclaimed7/10

   Google's support docs state that chats and uploaded files in Gemini Apps are not reviewed by humans or used to improve generative AI models, and users can manage/delete their activity via 'My Activity' and toggle 'Keep Activity' off (gemini-docs-38, gemini-docs-31). However, a separate doc notes that audio/video from Gemini Live can be used to train models unless the user opts out, showing the training-data control is feature-specific rather than a single unified setting (gemini-docs-37). Missing for 10: a clear, centralized opt-out control covering all Gemini surfaces (not just chat text), independent/hands-on verification that opted-out data is truly excluded from training, and clarity for enterprise/Workspace accounts.

   • [claimed-docs] “Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.”
   • [claimed-docs] “You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…”
   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack documents data retention (prompts and responses stored on xAI's servers, grok-docs-21) and vague 'enterprise-grade privacy protections' for team workspaces (grok-docs-13), but nowhere mentions an opt-out toggle, training-data exclusion setting, or policy statement about excluding user conversations from model training. This axis clearly applies to a consumer/enterprise AI chat product, so absence of evidence yields 'none' rather than 'na'.

   • [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
   • [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
   • [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”

   proof ↗⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round to Gemini
   Gemini✓fullclaimed8/10

   Google's support docs explicitly describe controls to review prompts, delete Gemini Apps activity, and turn off 'Keep Activity' (gemini-docs-31), plus explicit statements that chats/files are not used for model training by default (gemini-docs-38) while audio/video in Gemini Live can be opted in/out of training use (gemini-docs-37) — directly matching retention/deletion control for an AI-native user. Missing for 10: independent/hands-on verification that deletion actually removes data, and detail on data export or full account-level deletion workflows.

   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”
   • [claimed-docs] “You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…”
   • [claimed-docs] “Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.”

   proof ↗⚑ flag

   Grok—none0/10

   Docs confirm that inputs, reasoning, and responses are stored on xAI's servers (grok-docs-21) and mention vague 'enterprise-grade privacy protections' for team workspaces (grok-docs-13), but there is no documented mechanism for users to view, control, or delete their stored data/conversation history. Missing for 10: explicit data retention settings, a user-facing deletion/export tool, and any policy detailing retention periods or opt-out controls.

   • [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
   • [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”

   proof ↗⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Docs show Gemini provides some privacy controls: reviewing/deleting prompts and turning off 'Keep Activity' (gemini-docs-31), and settings around whether audio/video/chats are used to improve models (gemini-docs-37, gemini-docs-38). This addresses usage-history and training-data opt-out but not a full 'telemetry/usage tracking' opt-out (e.g., diagnostic/product analytics separate from chat history) and there's no independent verification of these controls' effectiveness. Missing for 10: explicit documentation of a general telemetry/analytics opt-out toggle beyond activity/training-data settings, and independent/hands-on confirmation that opting out actually stops tracking.

   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”
   • [claimed-docs] “You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…”
   • [claimed-docs] “Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.”

   proof ↗⚑ flag

   Grok—none0/10

   The evidence pack confirms xAI stores prompts, reasoning, and responses on its servers (grok-docs-21) but contains no documentation of any telemetry/usage-tracking opt-out setting, privacy toggle, or data-collection preference control for individual or ai-native users.

   • [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”

   proof ↗⚑ flag

Research

1. knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report

   weight 3 · round to Gemini
   Gemini✓fullclaimed7/10

   Gemini Apps has a documented Deep Research feature that conducts in-depth, real-time research across sources and allows adding personal sources (Gmail, Drive, uploads, NotebookLM notebooks) for the research, matching the autonomous multi-source research story. missing for 10: explicit documentation of citation formatting in the final report and independent hands-on evidence of report quality/citation accuracy from third parties.

   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…”

   proof ↗⚑ flag

   Grok~partialclaimed6/10

   Grok's docs describe a dedicated 'Realtime Multi-agent Research' capability that orchestrates multiple AI agents to perform deep, multi-step research tasks, matching the core of the story [grok-docs-26]. However, the docs don't explicitly describe the output format (a cited report with sources) and there is no independent/hands-on corroboration of this specific feature in the evidence pack. Missing for 10: explicit documentation of citation/report formatting in the research output, and independent user validation that the feature works as described.

   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”

   proof ↗⚑ flag

2. knowledge-workerGet answers grounded in current web results with citations back to the sources

   weight 2 · round to Gemini
   Gemini~partialclaimed6/10

   Gemini's Deep Research feature explicitly supports 'in-depth and real-time research on almost any subject,' implying grounded, current-web-based answers, and users can add further sources for research context. However, the evidence pack never explicitly documents inline citation links back to specific web sources, nor independent confirmation that citations are reliably shown. Missing for 10: explicit documentation of citation/source-linking UI, independent verification that citations are accurate and consistently displayed.

   • [claimed-docs] “You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.”
   • [claimed-docs] “You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…”

   proof ↗⚑ flag

   Grok~partialcommunity4/10

   Evidence shows Grok has a 'Realtime Multi-agent Research' capability for deep, multi-step research tasks and community notes suggest it can discuss current events from live X/web data, implying some grounding, but nothing in the pack explicitly documents inline citations or source links back to web results in Grok's answers. missing for 10: explicit documentation of citation formatting/source links, first-party description of real-time web search grounding, and independent verification that citations are reliably attached to responses.

   • [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
   • [community] “I am excited for the voice mode promised in 'a week' or so. ChatGPT Advanced Voice has been a big disappointment for me... If Grok 3 voice m…”

   proof ↗⚑ flag

Admin

1. team-adminManage members, permissions, and data policies for my organization's workspace

   weight 2 · round to Grok
   Gemini—none0/10

   Evidence only shows end-user features (image generation, Live conversations, notebooks, connected apps) and passing mentions that a 'work or school account' administrator can 'enable Gemini,' but there is no evidence of an admin console for managing members, setting permissions, or configuring org-wide data policies.

   ⚑ flag

   Grok~partialclaimed6/10

   Docs show a business/team workspace admin story: inviting members via email (grok-docs-18), SSO integration with IdP (grok-docs-17), workspace switching with business-plan-protected conversations (grok-docs-39), license-gated sharing (grok-docs-14), and 'enterprise-grade privacy protections' (grok-docs-13). This covers member invitation, authentication/SSO, and some data-policy framing for admins. Missing for 10: detailed role/permission granularity (e.g., admin vs member roles, per-connector access control), explicit data retention/DLP policy configuration UI, and any independent/community corroboration of the admin console working as documented.

   • [claimed-docs] “Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
   • [claimed-docs] “Invite new team members to join your Grok Business workspace with a simple email invitation process.”
   • [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
   • [claimed-docs] “Share conversations only with team members who have active licenses.”
   • [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”

   proof ↗⚑ flag

Data controls

1. knowledge-workerExport my complete chat history and account data

   weight 1 · round drawn
   Gemini—none0/10

   The evidence only covers reviewing and deleting Gemini activity via My Activity (gemini-docs-31) and privacy settings for Live audio (gemini-docs-37, gemini-docs-38), but there is no mention of exporting chat history or account data (e.g., via Google Takeout or a dedicated export tool). missing for 10: any documentation of an export/download feature for chat history or account data, independent confirmation of export completeness.

   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”

   proof ↗⚑ flag

   Grok—none0/10

   No evidence in the pack mentions a data export or account-data download feature for Grok; docs cover connectors, models, billing, SSO, and workspace features but never a 'export my chat history/data' capability. This is a fair trust-controls axis for a consumer chat product, so absence of evidence yields 'none' rather than 'na'.

   ⚑ flag

2. knowledge-workerControl whether my conversations are used to train models

   weight 3 · round to Gemini
   Gemini✓fullclaimed8/10

   Google's own support docs state that by default chats/uploaded files aren't used to improve generative AI models unless a user opts in via 'Keep Activity', and that users can review, delete activity, or turn off Keep Activity at any time; separately, users must explicitly consent to let Google use Gemini Live audio/video for model training. This gives knowledge-workers clear, documented control over whether conversations feed model training. Missing for 10: independent/hands-on verification that these settings work as described and clarity on enterprise/Workspace account defaults.

   • [claimed-docs] “You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.”
   • [claimed-docs] “You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…”
   • [claimed-docs] “Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.”

   proof ↗⚑ flag

   Grok—none0/10

   Docs mention 'enterprise-grade privacy protections' for team workspaces and that prompts are stored on xAI servers, but there is no documented setting or toggle letting a knowledge-worker control whether their conversations are used to train models. Community commentary raises general distrust but does not confirm or deny a specific training opt-out control.

   • [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
   • [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
   • [community] “Musk already has too much power, won't trust him with my AI conversations.”

   proof ↗⚑ flag