Microsoft Copilot vs Grok
Grok wins · 14–16 (18 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round to GrokMicrosoft Copilotnone0/10Probes show no llms.txt, no markdown docs endpoint, and no OpenAPI spec for Microsoft Copilot's support site, and no evidence anywhere in the pack of agent-oriented documentation formats being offered. This axis applies (any product could publish llms.txt or agent-friendly docs) but there is no evidence Copilot does so.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
The docs site serves a discoverable llms.txt (HTTP 200, describing itself as official xAI developer documentation) and every doc page is also available in plain markdown form, which is exactly the agent-oriented docs pattern the story asks for. Missing for 10: independent/community confirmation that agents actually consume this llms.txt successfully in practice.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
- [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · round to GrokMicrosoft Copilotnone0/10The evidence pack describes Copilot connecting to first-party consumer services (OneDrive, Outlook.com, Google Drive/Gmail) via 'Copilot connectors,' but there is no mention of MCP (Model Context Protocol) server support or an ability for users to plug in arbitrary MCP tool servers. This is an applicable axis for an AI assistant product, but no evidence shows the capability exists.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
xAI docs explicitly describe adding custom MCP connectors and tunneling a local MCP server so Grok can reach it and use its tools, alongside built-in OAuth connectors for other tools (grok-docs-2, grok-docs-3, grok-docs-38, grok-docs-19). Missing for 10: independent/hands-on confirmation that custom MCP tool-calling works reliably in practice, and more detail on protocol/version compatibility.
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
- [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
ai-native userUse an official CLI
weight 2 · round to GrokMicrosoft Copilotnone0/10No evidence of an official CLI for Microsoft Copilot; all evidence covers chat, browser, and Office app integrations, with probes confirming no machine-readable API/CLI artifacts.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
There's no official CLI documentation for Grok, but a community comment references a terminal-based interface for 'Grok Build' ('terminal is nice but codex desktop app is very useful'), suggesting some CLI-like coding tool exists even though it isn't documented in the official docs pack. missing for 10: official CLI documentation/reference, installation instructions, and command examples confirming a first-party CLI product.
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
ai-native userDrive the product through a documented public API
weight 3 · round to GrokMicrosoft Copilotnone0/10No evidence of a documented public API for programmatically driving Microsoft Copilot; probes for OpenAPI/llms.txt specs all returned 404, and all docs describe end-user chat/UI interactions rather than API access. Missing for 10: any public API documentation, SDK, or endpoint spec that lets developers programmatically invoke Copilot's capabilities.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
xAI publishes a full public REST API with documented endpoints for text, image, video, tool use, structured outputs, and an OpenAPI spec confirmed live by probe, plus a quickstart guide, satisfying the AI-native/agentic driving story. missing for 10: independent third-party benchmarking of API reliability/completeness beyond xAI's own docs and anecdotal community chatter about tool-calling quirks.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
- [claimed-docs] “Streaming outputs is **supported by all models with text output capability**”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence describes issuing scoped or least-privilege API credentials for an agent; Copilot's documented connectors involve OAuth-style account sign-in to consumer services, not developer-controlled scoped credential issuance. missing for 10: any mention of API keys, scoped tokens, permission scoping, or credential management for agent access.
Groknone0/10The xAI API is a developer product with API keys, so scoped/least-privilege credential issuance is a fair capability to expect, but the evidence pack contains no mention of API key scopes, roles, granular permissions, or least-privilege credential controls — only OAuth-based connector authentication (grok-docs-19) for built-in tools, which is about connecting Grok to external services, not issuing scoped agent credentials.
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
ai-native userBuild against official SDKs
weight 2 · round to GrokMicrosoft Copilotnone0/10The evidence pack covers Microsoft Copilot as a consumer AI assistant with features like connectors, browsing, and app integrations, but contains no mention of official SDKs, developer APIs, or programmatic build tooling for third-party developers; probes for API/OpenAPI specs returned 404s, further indicating no discoverable developer SDK surface.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
The evidence shows an official xAI developer API with a published OpenAPI spec, quickstart docs, and text-generation/tool-use guides (grok-docs-20, grok-docs-27, grok-probe-3), which implies programmatic access an AI-native builder could use, but none of the evidence explicitly names or documents an official SDK (e.g., Python/JS client library) as opposed to raw REST/OpenAPI usage. Missing for 10: explicit documentation of a first-party SDK package, install instructions, or code samples showing SDK usage, plus any independent/community confirmation of SDK quality or adoption.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
ai-native userSubscribe to events via webhooks
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence anywhere in the pack of Copilot offering webhook subscriptions or any event-driven notification API for developers; probes for API/OpenAPI specs returned 404s, and docs only describe chat/connector features, not webhook subscription mechanisms.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Groknone0/10No evidence of any webhook subscription mechanism for Grok events; the docs describe connectors, tools, image/video generation, and inbound MCP tunneling, but nothing about outbound event notifications or webhook endpoints. Missing for 10: any webhook subscription API, event types, or delivery/registration mechanism.
Agentic features
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · round to GrokMicrosoft Copilotdisputedcontradicted5/10Microsoft heavily documents AI-generated insights across Word, Excel, PowerPoint, Outlook, Researcher, and Analyst, and describes proactive suggestions and code-run analysis (copilot-docs-2, copilot-docs-6, copilot-docs-16, copilot-docs-33, copilot-docs-31). However, hands-on community reports concretely contradict these claims for core products: a user found Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables' (copilot-comm-4), and Outlook's summarization is described as 'so bad' with a tiny UI button (copilot-comm-5); others report never finding a use case (copilot-comm-9). One community report is positive about cross-document data fetching (copilot-comm-7), so evidence is genuinely mixed rather than uniformly negative. Missing for 10: independent benchmark of insight quality/accuracy, resolution of the Word/Outlook hands-on failures, and clearer distinction of chat vs. Office-integrated Copilot performance.
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
- [community] “the way it can fetch data from across documents in 365 is really good”
- [community] “I use AI everyday and never found a use case for Copilot.”
Grok's connectors (Gmail/Calendar, Google Drive, Microsoft Teams, Salesforce, custom APIs/MCP) let it read and act on a user's own data inside the chat, and features like Realtime Multi-agent Research suggest Grok can analyze and synthesize that data into insights. However, the evidence is mostly first-party docs describing data access rather than concrete examples of proactive 'insights and suggestions,' and one hands-on report notes Grok has 'real trouble with agentic tool calling,' undercutting confidence in reliable in-context analysis. Missing for 10: independent hands-on demonstration of Grok surfacing unprompted insights/suggestions from connected data, and confirmation that tool-calling reliability issues don't undermine this in practice.
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [claimed-docs] “Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
ai-native userSet up automations that run autonomously in the background
weight 2 · round drawnDocs mention agentic-style capabilities (Cowork multi-step task completion, automating repetitive tasks, proactive research suggestions, browser action-taking) suggesting some autonomy, but Browse with Copilot explicitly requires user attention/supervision for many actions and no docs describe scheduled or fully background-running automations without a user session. Missing for 10: explicit scheduling/trigger mechanism, evidence of unattended background execution, and independent confirmation that these automations run without active supervision.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
Grok Bot is described as an AI teammate running on a 'persistent cloud computer' and Grok supports multi-agent orchestration for research tasks, hinting at some background/autonomous agent capability, but there is no documentation of scheduling, triggers, or recurring/timed automation setup. Missing for 10: explicit scheduling/trigger mechanism, details on how automations run without user prompting, and independent confirmation of autonomous background execution.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round to Microsoft CopilotMicrosoft's own docs describe extensive delegation features—Copilot in Word/Excel/PowerPoint/Outlook, Researcher, Analyst, Browse with Copilot performing multi-step browser actions, and Cowork handling 'bigger, multi-step tasks'—clearly positioning Copilot as a built-in assistant that can take on tasks. However, hands-on community reports contradict smooth delegation in practice (e.g., Copilot in Word 'couldn't do anything except append to the end of the document,' couldn't create tables or maintain formatting, and some users report never finding a real use case), indicating real-world task execution is often shallow or unreliable. Missing for 10: independent verification of successful complex multi-step task completion, and resolution of documented editing/execution failures in flagship apps.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.”
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
- [community] “I use AI everyday and never found a use case for Copilot.”
Grokdisputedcontradicted6/10xAI docs describe strong built-in agentic delegation — Grok Bot hands work to 'AI teammates on a persistent cloud computer,' Realtime Multi-agent Research orchestrates multiple agents for research tasks, and connectors let Grok act on email/calendar/Salesforce from chat (grok-docs-15, grok-docs-26, grok-docs-11, grok-docs-16, grok-docs-19). However, hands-on community testing directly contradicts smooth agentic delegation: a user reports Grok 'had real trouble with agentic tool calling - the model felt like it hadn't been trained to think of tool calling as one of its primary modalities' (grok-comm-6), and another notes the lack of a proper GUI for Grok Build limiting usability (grok-comm-7). Missing for 10: independent verification that Grok Bot/multi-agent research reliably completes delegated tasks end-to-end, and resolution of the reported tool-calling weakness.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
ai-native userOperate the product with natural-language commands
weight 2 · round to GrokMicrosoft Copilotdisputedcontradicted5/10Docs extensively describe natural-language operation—prompting Copilot in Word/Excel/PowerPoint, natural-language file/email/calendar search, and browser action commands (copilot-docs-1,2,3,8,14,20-22,26,27). However, hands-on community evidence directly contradicts this for at least one core surface: a user reports Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables! couldn't search and replace! couldn't maintain formatting' (copilot-comm-4), and others found the Outlook summarize feature and overall NL assistant underwhelming or unused (copilot-comm-5, copilot-comm-9). This is a concrete documented failure of the claimed NL command capability, not mere skepticism. Missing for 10: independent third-party benchmarking of NL command reliability across all Office apps, and resolution of the reported Word functional gaps.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Find my budget spreadsheet” or “Show me the project plan from last month.”
- [claimed-docs] “Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
- [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
- [claimed-docs] “Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
- [community] “I use AI everyday and never found a use case for Copilot.”
Grok's docs describe a chat/voice interface where natural-language input drives text generation, image/video creation, and connector actions like creating Salesforce records or searching email 'directly from chat' (grok-docs-11, grok-docs-16, grok-docs-35, grok-docs-40), which is core evidence for NL-command operation. However, hands-on community testing reports real trouble with agentic tool calling, saying the model 'hadn't been trained to think of tool calling as one of its primary modalities' (grok-comm-6), which tempers confidence that NL commands reliably trigger tool/connector actions. Missing for 10: independent benchmarks or user reports specifically confirming reliable NL-to-action execution across the built-in connectors, and no clear resolution of the tool-calling reliability concern.
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
Api quality
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round to GrokMicrosoft Copilotnone0/10No evidence of a machine-readable API spec; explicit probes for OpenAPI/swagger endpoints all returned 404, and no docs mention a public API or spec for Microsoft Copilot as an end-user product.
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
A direct probe confirms https://docs.x.ai/openapi.json returns HTTP 200 and contains an 'openapi' key, i.e., a downloadable, machine-readable OpenAPI spec for the xAI API, and this is corroborated by extensive first-party API docs describing the full endpoint surface (text, images, video, tools). Missing for 10: independent/community confirmation that developers actually consume this spec (e.g., via SDK codegen) beyond the automated probe.
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · round drawnMicrosoft Copilotnone0/10Microsoft Copilot is presented here as a consumer-facing AI assistant product; there is no evidence of a public versioned API, developer API reference, or documented deprecation policy for it. Probes for API/OpenAPI specs and llms.txt all return 404, confirming absence of such developer-facing documentation.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Groknone0/10The evidence shows model version slugs (grok-4.6, grok-4.5) and an OpenAPI spec, but no documentation of a formal deprecation policy, sunset timelines, or versioning guarantees for the API. Release notes describe new features and model updates but never state how/when older model versions are retired.
- [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
- [claimed-docs] “grok-4.6` and `grok-4.5` support the `reasoning_effort` parameter, which controls how much effort the model spends thinking before respondin…”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
Agents tasks — stories about agents tasks in this arenaAgents tasks
Stories about agents tasks in this arena
Agent mode
power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review
weight 3 · round to GrokCopilot's 'Cowork' feature is explicitly described as handling 'bigger, multi-step tasks and deliver completed to-dos,' and 'Browse with Copilot' can perform multi-step actions while pausing for user approval on sensitive steps, which aligns with delegate-and-review workflows. However, these are single thin doc mentions with no independent/hands-on validation of true background/asynchronous operation, and community feedback focuses on other Copilot surfaces (Word, Outlook) being underwhelming rather than confirming Cowork's autonomous task delivery. Missing for 10: hands-on or independent evidence of a background task actually running unattended and returning a completed result, clearer scope/limits of Cowork, and confirmation this isn't just synchronous chat-assisted editing.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “You can see each step in real time and take control at any time.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
Docs describe 'Grok Bot' as handing 'real work to AI teammates on a persistent cloud computer' and a 'Realtime Multi-agent Research' feature that orchestrates multi-step research autonomously, directly matching the story's core idea of background delegation and review. However, evidence is vendor-doc only with no independent confirmation of the async review workflow (notifications, task state, resuming), and community feedback (grok-comm-6) notes real trouble with agentic tool calling, suggesting reliability caveats. Missing for 10: independent hands-on validation of the background-task lifecycle, detail on how results are surfaced for review, and confirmation tool-calling reliability issues don't undermine multi-step autonomy.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites
weight 3 · round to Microsoft CopilotMicrosoft documents a dedicated 'Browse with Copilot' capability that lets Copilot click, type, and navigate tabs in Edge to complete web tasks, with real-time visibility and required user confirmation for sensitive actions like purchases or bookings, plus a 'Cowork' mode for multi-step task completion. However, all supporting evidence is first-party docs with no independent/hands-on confirmation of browser-operation success, and community feedback in the pack focuses on Office-integrated Copilot rather than this browsing agent feature. Missing for 10: independent/hands-on validation of the browse-and-complete-task capability, more detail on reliability/success rate on real websites.
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “You can see each step in real time and take control at any time.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
Groknone0/10The evidence shows connectors for APIs, email, calendar, Salesforce, and a vague 'Grok Bot' cloud computer teammate, but nothing documents Grok actually driving a web browser to navigate sites or complete tasks (no browsing/computer-use agent feature is described). Multi-agent research (grok-docs-26) is about research orchestration, not website interaction, so this applicable-but-unevidenced capability is 'none'.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
power-userLet the assistant see and operate applications on my computer to complete work
weight 2 · round to Microsoft CopilotMicrosoft documents 'Browse with Copilot' letting the assistant click, type, and navigate tabs directly in Edge, plus 'Cowork' for multi-step task completion and Vision for seeing images/screens, with human-in-the-loop confirmation for sensitive actions. However, this operating capability is scoped mainly to the browser and Office apps rather than general desktop application control, and community reports describe weak real-world execution (e.g., Copilot in Word failing at basic edits, Outlook integration being minimal), undercutting the strength of the claim. Missing for 10: broad OS-level/desktop app automation beyond Edge/Office, and independent hands-on validation that agentic actions reliably complete tasks.
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
Groknone0/10Grok offers connectors (Gmail, Drive, Teams, Salesforce, custom MCP) and a 'Grok Bot' that operates on a persistent *cloud* computer, but there is no evidence of Grok seeing or controlling applications running on the user's own local machine/desktop (e.g., screen/GUI control akin to computer-use agents). Missing for 10: any documented local-computer screen/GUI control, first-party or hands-on evidence of operating a user's own desktop apps.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
Tasks
power-userSchedule recurring or one-off tasks that run automatically and come back to me with results
weight 2 · round drawnMicrosoft Copilotnone0/10The evidence shows Copilot can handle multi-step tasks (Cowork) and automate repetitive work, but there is no mention of scheduling recurring or one-off tasks that run automatically and return results later. Missing for 10: any documentation of a task-scheduling feature, recurrence settings, or proactive notification of completed scheduled runs.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
Apps devices — stories about apps devices in this arenaApps devices
Stories about apps devices in this arena
Apps
power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen
weight 2 · round drawnMicrosoft Copilotnone0/10The evidence pack covers web/Office integrations, browser automation (Edge), and mobile/iOS/Android connectors, but nowhere documents an official standalone desktop app with OS-level keyboard shortcuts or the ability to see/interact with the user's screen content outside a browser. Vision (copilot-docs-30) is limited to photo/image analysis, not live screen capture, and Browse with Copilot (copilot-docs-9, -15, -24) is scoped to actions inside Microsoft Edge, not OS-wide screen access.
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “You can see each step in real time and take control at any time.”
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
Groknone0/10The evidence pack shows only cross-platform sign-in sync and hands-free voice, but no mention of an official desktop app with OS-level shortcuts or screen-reading/access capability; a community comment even notes the lack of a proper GUI for Grok's coding product ('still waiting for a proper gui for grok build ... codex desktop app is very useful'), suggesting no such desktop tool exists.
- [claimed-docs] “Sign in once and your conversations, settings, and subscription stay in sync across every platform.”
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
knowledge-workerUse full-featured official mobile apps for iOS and Android
weight 2 · round to Microsoft CopilotDocs explicitly confirm 'Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)', establishing official iOS/Android apps exist and support core connector/chat features. However, there's no first-party or hands-on evidence detailing mobile-specific feature parity (e.g., Word/Excel/PowerPoint copilots, Vision, voice mode) on the mobile apps, and community feedback focuses only on desktop/Office integration quality, not mobile experience. Missing for 10: mobile-specific feature parity details, hands-on mobile app reviews, and confirmation of full functionality (Vision, Voice, connectors) actually working within the mobile app UI.
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.”
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
Docs mention voice mode ('Talk to Grok hands-free with voice') and cross-platform sync of conversations/settings/subscriptions, implying mobile app support, but there is no explicit confirmation of dedicated full-featured iOS and Android apps, no app-store links, and no community/hands-on feedback about mobile app quality or feature parity with desktop/web. Missing for 10: explicit iOS/Android app documentation, feature-parity details, and independent user reviews of the mobile apps themselves.
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [claimed-docs] “Sign in once and your conversations, settings, and subscription stay in sync across every platform.”
Custom bots
power-userBuild and share custom assistants with their own instructions and knowledge
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence describes creating custom Copilot agents/assistants with custom instructions and knowledge base (like Copilot Studio agents or GPT-builder equivalents) nor sharing them with others; evidence only covers built-in Office integrations, connectors, and memory features. Missing for 10: any mention of an agent/assistant builder, custom instructions, custom knowledge upload, and sharing/publishing mechanism for user-built assistants.
Groknone0/10The evidence pack covers connectors, tool integrations, MCP, image/video generation, and enterprise features, but there is no mention of a feature to create and share custom assistants/personas with their own instructions and knowledge base (akin to OpenAI's GPTs or Claude Projects).
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round to GrokDocs mention general automation of 'repetitive tasks' and multi-step task completion via Cowork, but there's no concrete evidence of bulk operations across many items (e.g., batch-editing many files, mass email actions, or large-scale spreadsheet manipulation). Community feedback (copilot-comm-4) reports Copilot in Word failing at basic single-document tasks like search-and-replace, casting doubt on any claim of robust bulk-item processing. missing for 10: explicit bulk/batch operation examples (e.g., mass-processing many files/rows/emails at once), independent hands-on evidence of successful bulk actions, and confirmation that Cowork or Analyst can operate at scale across many items reliably.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
The docs mention batch generation of multiple images and support for up to 5 source images in a single edit, which is a narrow form of bulk operation, but there's no evidence of general-purpose bulk operations (e.g., bulk file processing, bulk record updates, batch text API) across many items or arbitrary data types. Missing for 10: a true batch/bulk API for text or file processing, bulk actions on connector data (e.g., mass email/calendar updates), and independent confirmation that these batch features work reliably at scale.
- [claimed-docs] “Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ra…”
- [claimed-docs] “Image editing now accepts up to 5 source images per request (was 3).”
- [claimed-docs] “Use up to five source images for a single image edit.”
ai-native userDefine rules that trigger actions automatically on events
weight 3 · round drawnMicrosoft Copilotnone0/10The evidence describes Copilot responding to prompts, browsing, summarizing, and connecting to services, but there is no mention of user-defined rules or triggers that fire actions automatically on events (e.g., 'when email arrives, do X' style automation). No scheduling, event-trigger, or workflow-builder capability is documented.
Groknone0/10Grok's docs describe connectors, tool integrations, and a persistent 'Grok Bot' cloud agent, but nothing describes user-defined rules that trigger actions automatically on external events (e.g., webhooks, triggers, if-this-then-that automations, or scheduled event listeners). The axis is plausible for an AI-native product with tool/connector access, so this is 'none' rather than 'na'.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
ai-native userSchedule recurring jobs or workflows
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence describes scheduling recurring jobs, timers, or automated recurring workflows in Microsoft Copilot; the pack shows one-off task automation (Cowork, connectors, browse actions) but nothing about recurrence or scheduling.
ai-native userVersion, review, and roll back my automations
weight 1 · round drawnMicrosoft Copilotnone0/10No evidence describes any versioning, history, review workflow, or rollback capability for Copilot's automations (e.g., Cowork, connectors, or agent tasks); evidence only covers connecting services, browsing, memory, and privacy controls. Missing for 10: version history UI, diff/review of automation changes, rollback/undo mechanism, any audit trail for automation edits.
Connectors apps — stories about connectors apps in this arenaConnectors apps
Stories about connectors apps in this arena
Connectors
power-userBrowse a directory of third-party apps and connectors and add them to the assistant
weight 2 · round to GrokDocs confirm Copilot supports 'connectors' to a small fixed list of services (OneDrive, Outlook.com, Google Drive, Gmail/Calendar/Contacts) and note these are available on Copilot.com/Mobile, but there is no evidence of a browsable directory/marketplace of third-party apps that power-users can explore and add beyond this short built-in list. missing for 10: evidence of a searchable app/connector marketplace, breadth of third-party (non-Microsoft/Google) integrations, and any independent confirmation of the browsing/add experience.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
- [claimed-docs] “Copilot can connect with the following consumer services: ... Google Drive ... Google Gmail, Calendar, Contacts”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive... Google Drive... Google Gmail, Calendar, Contacts”
Docs show Grok exposes a set of built-in, OAuth-authenticated connectors (Salesforce, Gmail, Google Calendar, Google Drive, Microsoft Teams) plus custom/MCP connectors that a user can add to reach external tools (grok-docs-16,19,35,36,37,2,3). This matches the 'add third-party apps/connectors' part of the story, but there's no explicit evidence of a browsable directory/marketplace UI, ratings, or a curated catalog page for discovering connectors. missing for 10: a documented directory/marketplace UI for browsing connectors, independent user confirmation of the browse experience.
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [claimed-docs] “Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers
weight 3 · round drawnMicrosoft's documentation explicitly describes connecting Copilot to OneDrive, Outlook.com (email/calendar/contacts), Google Drive, and Google Gmail/Calendar/Contacts, with example queries for finding files, emails, and calendar events, indicating the assistant can search and use this data in answers. Community evidence corroborates that cross-document/data fetching works well in some contexts, though other complaints focus on unrelated feature quality issues (e.g., editing limitations) rather than disputing the connector capability itself. Missing for 10: independent hands-on verification specifically of the cloud-drive/email/calendar connector search feature (rather than in-app Office Copilot) and more detail on reliability/completeness of search results.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Find my budget spreadsheet” or “Show me the project plan from last month.”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
- [claimed-docs] “Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
- [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
- [claimed-docs] “Show me emails from Sarah about the budget” or “Find my flight confirmation email.”
- [claimed-docs] “What's on my calendar for tomorrow?” or “When is my next dentist appointment?”
- [claimed-docs] “Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
- [claimed-docs] “Check in on your calendar: “What’s on my calendar for tomorrow?” or “When is my next dentist appointment?””
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
- [community] “the way it can fetch data from across documents in 365 is really good”
Grok docs explicitly describe built-in OAuth connectors for Gmail, Google Calendar, and Google Drive that let it search emails, read files, and manage calendar items right inside chat, plus a broader connectors framework for other SaaS tools. This directly matches the story of connecting cloud drive, email, and calendar for search/use in answers. Missing for 10: independent/hands-on confirmation of these specific connectors working reliably in practice (community evidence largely covers coding/chat quality, not connector behavior).
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
Files analysis — stories about files analysis in this arenaFiles analysis
Stories about files analysis in this arena
Analysis
power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files
weight 3 · round to Microsoft CopilotDocs explicitly state Copilot can 'run code to complete complex calculations and generate graphs' and the 'Analyst' feature 'analyzes data with ease,' plus Excel/Word integrations for working with attached data—covering charts and computed answers. However, there is no explicit documentation of producing downloadable files as an output of this code-execution flow, and no hands-on/community evidence corroborates this specific capability working well (community comments focus on other Office Copilot shortcomings, not code-execution). Missing for 10: explicit downloadable-file output evidence, independent/hands-on confirmation of the code-execution feature itself.
- [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
- [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
Groknone0/10The evidence describes Grok's coding assistant (Grok Build), connectors for email/calendar/files, image/video generation, and multi-agent research, but nothing documents a code-interpreter style capability where Grok writes and executes code against user-supplied data to produce charts, computed answers, or downloadable output files. Community comments discuss coding quality and agentic tool-calling issues but not this specific data-analysis/file-output workflow.
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
Artifacts
knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export
weight 2 · round to Microsoft CopilotMicrosoft Copilotdisputedcontradicted4/10Microsoft's own docs claim Copilot in Word/Excel/PowerPoint can create and iteratively refine documents, spreadsheets, and presentations via chat (copilot-docs-1,2,3,16), which would let users export finished files. However, a hands-on community report directly contradicts this for Word, stating Copilot 'couldn't do anything except append to the end of the document,' couldn't create tables, search/replace, or maintain formatting (copilot-comm-4), and another user calls Outlook's summarize feature 'so bad' (copilot-comm-5). This is a concrete documented capability failure, not mere skepticism. Missing for 10: independent corroboration of successful iterative multi-turn editing, PowerPoint/Excel hands-on validation, and confirmation of clean export/formatting fidelity.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
Groknone0/10The evidence pack shows Grok connectors for reading/searching Google Drive, Gmail, Calendar, and Salesforce, plus image/video generation and coding via Grok Build, but nothing describes a document/presentation authoring or iterative-editing feature (e.g., a canvas-style doc editor) with export to file formats like Word/PowerPoint/PDF.
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
Files
knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents
weight 3 · round to Microsoft CopilotMicrosoft's own docs describe multiple file-analysis capabilities—attaching data in Excel, analyzing notes in Word, finding/searching PDFs and Office documents, an 'Analyst' tool for data insight, and code execution for calculations—giving broad first-party coverage of the story. However, hands-on community reports contradict smooth real-world usability (e.g. Word Copilot 'couldn't do anything except append text... couldn't maintain formatting' and Outlook summarization deemed 'so bad'), while another user praises cross-document data-fetching, so the accuracy/quality of analysis is mixed rather than assured. Missing for 10: independent verification of analysis accuracy on complex spreadsheets/PDFs, and resolution of the documented Word-editing/formatting failures.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
- [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “the way it can fetch data from across documents in 365 is really good”
Docs show Grok can ingest images and connect to Google Drive/Gmail to search and read files, and boasts a 500k context window for knowledge work, implying some document handling, but there is no explicit documentation of native PDF or spreadsheet upload/parsing in the core chat UI, nor any accuracy benchmarks or hands-on validation of document analysis. Missing for 10: explicit PDF/spreadsheet upload feature docs, accuracy testing/validation, independent user reports confirming reliable document analysis.
- [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Some models allow images in the input. The model will consider the image context when generating the response.”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
Memory context — stories about memory context in this arenaMemory context
Stories about memory context in this arena
Memory
power-userHave the assistant remember relevant context from previous chats and apply it in new conversations
weight 3 · round to Microsoft CopilotFirst-party docs confirm a memory feature: Copilot can store facts users ask it to remember and use that context in future responses, and can proactively surface suggestions based on past queries and memory (copilot-docs-32, copilot-docs-33). However, this is opt-in/explicit fact storage rather than full automatic context carry-over, and there is no independent/hands-on evidence confirming it works reliably across conversations. missing for 10: independent verification of cross-conversation recall, detail on scope/limits of automatic memory use, and confirmation it isn't just facts explicitly asked to be remembered.
- [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
Groknone0/10The evidence pack shows conversation storage (grok-docs-21) and cross-device sync of conversations/settings (grok-docs-41), but nothing describing a memory feature that recalls relevant context from past chats and applies it to new, unrelated conversations. No docs or community reports confirm persistent cross-chat memory recall.
power-userSet persistent custom instructions and preferences that shape every response
weight 1 · round to Microsoft CopilotDocs confirm a memory feature where Copilot can store facts users ask it to remember and use them to personalize future responses and suggestions, plus controls to view/delete memory (copilot-docs-32, copilot-docs-33, copilot-docs-38). However there is no dedicated 'custom instructions' setting described (unlike explicit persona/tone controls), and no independent/hands-on evidence confirming these stored facts consistently shape *every* response. Missing for 10: explicit custom-instructions UI documentation, hands-on confirmation that memory reliably influences all responses, and community corroboration of the feature's effectiveness.
- [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [claimed-docs] “opt out of use of your conversation activity for model training”
Projects
knowledge-workerOrganize related chats and files into a project or space that shares context and instructions
weight 2 · round drawnMicrosoft Copilotnone0/10The evidence pack shows Copilot memory (storing facts), connectors to files/email/calendar, and per-app integrations, but nowhere describes a 'project' or 'space' concept that lets a user group related chats and files together with shared instructions/context, unlike competitors' project/space features. Community feedback focuses on integration quality issues, not on organizational/workspace features. Missing for 10: any documented 'project', 'space', 'workspace', or chat-grouping feature with shared custom instructions and file scoping.
- [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
Groknone0/10The evidence describes team 'workspaces' for licensing, SSO, and sharing conversations among teammates, plus connectors for external tools, but there is no mention of a project/space construct that groups related chats and files together with shared custom instructions or context, unlike dedicated 'Projects' features in other chat products.
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
- [claimed-docs] “Share conversations only with team members who have active licenses.”
- [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
Multimodal — stories about multimodal in this arenaMultimodal
Stories about multimodal in this arena
Images
knowledge-workerGenerate and edit images from natural-language prompts
weight 2 · round to GrokMicrosoft Copilotnone0/10The evidence pack only shows Copilot's 'Vision' feature for analyzing and understanding images (copilot-docs-30), not generating or editing images from text prompts; no docs, community, or probe evidence mentions an image-generation or image-editing capability (e.g., a Designer/DALL·E-style feature).
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
Grok Imagine and the API both explicitly support text-to-image generation and image editing (including multi-image edits up to 5 sources, aspect ratio control) with docs describing prompt-driven creation and editing directly relevant to knowledge-worker use. Missing for 10: independent hands-on community corroboration specifically of image generation/editing quality (community evidence pack focuses on coding/text/voice, not images).
- [claimed-docs] “Create images and video with Grok Imagine.”
- [claimed-docs] “Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ra…”
- [claimed-docs] “Edit an existing image by providing a source image along with your prompt. The model understands the image content and applies your requeste…”
- [claimed-docs] “Use up to five source images for a single image edit.”
- [claimed-docs] “Image editing now accepts up to 5 source images per request (was 3).”
- [claimed-docs] “New aspect ratios. Image generation and editing accept 21:9 (cinematic widescreen) and 5:2 (wide banners).”
- [claimed-docs] “Requests to the slug will be served by grok-imagine-image-2.0 with quality set to low, with no change to the request or response shape”
knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them
weight 2 · round to GrokDocs confirm Copilot has a 'Vision' capability to analyze images and photos ([copilot-docs-30]), directly supporting the story, but this is a single first-party mention with no elaboration on screenshot-specific use cases or accuracy, and no independent/hands-on evidence corroborates real-world interpretation quality. Missing for 10: detailed documentation on screenshot vs photo handling, accuracy benchmarks, and independent/community verification of correct image interpretation.
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
Docs confirm image understanding is a first-class capability: models accept image input and 'consider the image context when generating the response' (grok-docs-25), plus related image editing docs show the model 'understands the image content' (grok-docs-29). No independent hands-on report specifically tests screenshot/photo interpretation accuracy. missing for 10: independent/community corroboration of accuracy on real screenshots or photos, detail on multi-image or OCR-style interpretation limits.
- [claimed-docs] “Some models allow images in the input. The model will consider the image context when generating the response.”
- [claimed-docs] “Edit an existing image by providing a source image along with your prompt. The model understands the image content and applies your requeste…”
- [claimed-docs] “Use up to five source images for a single image edit.”
Voice
knowledge-workerHave a natural, real-time voice conversation with the assistant
weight 2 · round drawnMicrosoft's transparency docs explicitly describe Copilot Voice mode: users send natural-language voice prompts and receive audio responses, with citations shown in conversation transcripts, confirming real-time spoken interaction. Missing for 10: independent/hands-on corroboration of voice mode's real-time quality, latency, or interruption handling, and no community evidence specifically validates or disputes the voice experience.
- [claimed-docs] “If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.”
- [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
xAI documents hands-free voice conversations directly in Grok ('Talk to Grok hands-free with voice') and separately documents real-time streaming speech-to-text with VAD tuning, indicating a live voice-conversation feature exists. However, missing for 10: independent/hands-on corroboration of voice conversation naturalness or latency, and no detail on turn-taking/interruption handling beyond the VAD parameter.
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [claimed-docs] “Speech to Text now accepts a vad_threshold parameter (streaming query param and batch multipart field) to tune the voice-activity gate”
- [community] “I am excited for the voice mode promised in 'a week' or so. ChatGPT Advanced Voice has been a big disappointment for me... If Grok 3 voice m…”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userDo everything through the API that I can do in the UI
weight 2 · round to GrokMicrosoft Copilotnone0/10No evidence of a public API exposing Copilot's UI capabilities (chat, connectors, Word/Excel/PowerPoint copilots) programmatically; probes for OpenAPI/docs endpoints returned 404s, and all evidence describes UI/chat-only functionality. Missing for 10: any documented API/SDK, endpoint parity documentation, or third-party confirmation of programmatic access to Copilot features.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
The xAI API exposes core Grok model capabilities (text, images, video, tools, structured outputs, multi-agent research, connectors) documented alongside an OpenAPI spec, so much of the UI functionality is API-accessible. However, UI-only features like Grok Bot persistent cloud computer, team workspace/SSO/billing management, and built-in OAuth connectors (Gmail, Calendar, Teams, Salesforce) appear tied to the consumer/business app rather than exposed as general API endpoints, and there's no evidence of full parity. Missing for 10: confirmation that workspace/team management, SSO, billing, and native connector orchestration are API-accessible rather than UI-exclusive, plus independent corroboration of full feature parity.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
- [claimed-docs] “Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
ai-native userExport all of my data in open formats and leave
weight 3 · round drawnMicrosoft Copilotnone0/10No evidence of a data export/portability feature or open-format export mechanism; docs only mention deleting conversation history, not exporting it, and probes for machine-readable docs/APIs 404. There is nothing showing users can export chats, memory, or generated content in open formats to leave the platform.
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
ai-native userRead the product's source under an open license
weight 2 · round drawnMicrosoft Copilotnone0/10Microsoft Copilot is closed-source proprietary software; no evidence indicates any open-license source availability, and probes for docs/API artifacts returned 404s. This is an applicable axis (a product could conceivably be open-sourced) but no evidence supports it, so verdict is none rather than na.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Groknone0/10The evidence pack contains only proprietary API/product documentation and community commentary; there is no mention of any open-source license, public source repository, or open-weights release for Grok. As a mainstream capability question applicable to AI products, absence of evidence yields 'none' rather than 'na'.
ai-native userSelf-host the core product
weight 3 · round drawnMicrosoft Copilotnone0/10Microsoft Copilot is a cloud-hosted SaaS product with no evidence of any self-hosted or on-premises deployment option; all documentation describes it as a hosted service (Copilot.com, Microsoft 365 cloud integration, Edge browser actions) with no self-hosting mechanism mentioned.
Groknone0/10Grok is a closed, proprietary API/cloud service; no evidence anywhere in the pack of open-sourced weights or a self-hostable core model/product, only hosted APIs, connectors, and SaaS features. Absence of any self-hosting capability for an applicable axis (models can in principle be released for self-hosting, as some competitors do) yields none rather than na.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [claimed-docs] “Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userChoose where my data is stored (region/residency)
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence in the pack mentions data residency, regional storage controls, or any user-facing setting to choose where data is stored; the docs cover features, connectors, and privacy opt-outs but not geographic data residency choices.
Groknone0/10No evidence in the pack mentions data residency, region selection, or storage location choices for Grok; docs only confirm data is stored on xAI's servers without any residency options (grok-docs-21). Missing for 10: any mention of regional data storage options, residency controls, or compliance certifications tied to geography.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
ai-native userPrevent my data from being used to train AI models
weight 3 · round to Microsoft CopilotMicrosoft's privacy FAQ explicitly states users can opt out of having conversation activity used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38), giving a documented mechanism to prevent training use. However, community reports (copilot-comm-6, copilot-comm-1) show real confusion about scope — a user working in Word had no clear indication whether their document content was being fed to training, and commenters note the opt-out/behavior differs between standalone Copilot chat and 365-integrated Copilot, undermining confidence that the control is comprehensive or transparent across all surfaces. missing for 10: independent verification that opt-out actually blocks training across all integrated products (Word/Excel/Outlook), clearer UI-level opt-out controls inside Office apps, and confirmation the toggle covers enterprise/connector data sources.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “Train our generative AI models to create a better experience for you and others.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
Groknone0/10The evidence pack documents data retention (prompts and responses stored on xAI's servers, grok-docs-21) and vague 'enterprise-grade privacy protections' for team workspaces (grok-docs-13), but nowhere mentions an opt-out toggle, training-data exclusion setting, or policy statement about excluding user conversations from model training. This axis clearly applies to a consumer/enterprise AI chat product, so absence of evidence yields 'none' rather than 'na'.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
- [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
ai-native userControl data retention and deletion
weight 2 · round to Microsoft CopilotDocs confirm users can delete individual conversations or entire history and opt out of conversation data being used for model training, giving basic retention/deletion control for the standalone Copilot chat experience (copilot-docs-35, copilot-docs-38). However, community evidence notes this applies only to the standalone Copilot app/site, not to Copilot embedded in Office apps like Word, where a user reported uncertainty about whether their document was being auto-pushed for training with no visible deletion controls (copilot-comm-1, copilot-comm-6). Missing for 10: enterprise/Office-integrated retention controls, clarity on data retention duration before deletion, and independent verification that deletion actually removes data from training pipelines.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
Groknone0/10Docs confirm that inputs, reasoning, and responses are stored on xAI's servers (grok-docs-21) and mention vague 'enterprise-grade privacy protections' for team workspaces (grok-docs-13), but there is no documented mechanism for users to view, control, or delete their stored data/conversation history. Missing for 10: explicit data retention settings, a user-facing deletion/export tool, and any policy detailing retention periods or opt-out controls.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
ai-native userOpt out of telemetry and usage tracking
weight 2 · round to Microsoft CopilotMicrosoft Copilotdisputedcontradicted5/10Microsoft's own privacy FAQ states users can opt out of having conversation activity used for model training and can delete individual or entire conversation history (copilot-docs-35, copilot-docs-38), which is a real opt-out mechanism for the standalone Copilot chat. However, community reports directly contradict this for Copilot as embedded in Office apps: a Word for Mac user reports 'no way of turning it off' and 'no opt-out mechanism' (copilot-comm-3), and another user reports uncertainty over whether their document was being auto-pushed to Copilot for training with no visible control (copilot-comm-6) — and copilot-comm-1 clarifies the training opt-out only applies to the standalone chat app, not the Office-integrated Copilot surfaces. Missing for 10: a unified, product-wide opt-out control covering all Copilot surfaces (Office, Edge, Windows), independent verification that the training opt-out actually stops data use, and clarity on telemetry beyond training data.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
- [community] “Hate that if you use Word for Mac, you now have Copilot next to your cursor with no way of turning it off. I just want to use Word... Now th…”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
Groknone0/10The evidence pack confirms xAI stores prompts, reasoning, and responses on its servers (grok-docs-21) but contains no documentation of any telemetry/usage-tracking opt-out setting, privacy toggle, or data-collection preference control for individual or ai-native users.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
Research answers — stories about research answers in this arenaResearch answers
Stories about research answers in this arena
Research
knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report
weight 3 · round to GrokCopilot's 'Researcher' agent is documented as designed to 'find, synthesize, and understand information faster' and Copilot's web-grounded answers include hyperlinked citations, which maps to the deep-research/cited-report story, but there is no detail on autonomous multi-source search depth, report format, or any hands-on/independent validation of report quality. Missing for 10: documentation of the autonomous multi-step search process, description of report output structure, and independent corroboration of research depth/accuracy.
- [claimed-docs] “Find, synthesize, and understand information faster with Researcher.”
- [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
Grok's docs describe a dedicated 'Realtime Multi-agent Research' capability that orchestrates multiple AI agents to perform deep, multi-step research tasks, matching the core of the story [grok-docs-26]. However, the docs don't explicitly describe the output format (a cited report with sources) and there is no independent/hands-on corroboration of this specific feature in the evidence pack. Missing for 10: explicit documentation of citation/report formatting in the research output, and independent user validation that the feature works as described.
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
knowledge-workerGet answers grounded in current web results with citations back to the sources
weight 2 · round to Microsoft CopilotDocs explicitly state Copilot grounds responses in high-ranking web content and provides hyperlinked citations after generated responses, directly matching the story; this is corroborated by broader documentation on research/answer features (Researcher, ask questions and get answers fast). Missing for 10: independent hands-on verification of citation accuracy/quality and no community evidence specifically testing web-grounded citation behavior.
- [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
- [claimed-docs] “Ask questions and get answers fast.”
- [claimed-docs] “Find, synthesize, and understand information faster with Researcher.”
Evidence shows Grok has a 'Realtime Multi-agent Research' capability for deep, multi-step research tasks and community notes suggest it can discuss current events from live X/web data, implying some grounding, but nothing in the pack explicitly documents inline citations or source links back to web results in Grok's answers. missing for 10: explicit documentation of citation formatting/source links, first-party description of real-time web search grounding, and independent verification that citations are reliably attached to responses.
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [community] “I am excited for the voice mode promised in 'a week' or so. ChatGPT Advanced Voice has been a big disappointment for me... If Grok 3 voice m…”
Trust controls — stories about trust controls in this arenaTrust controls
Stories about trust controls in this arena
Admin
team-adminManage members, permissions, and data policies for my organization's workspace
weight 2 · round to GrokMicrosoft Copilotnone0/10The evidence pack covers only individual/consumer Copilot features (writing, spreadsheets, browsing, memory, privacy opt-outs for personal conversations) with no mention of team/workspace admin controls such as member management, role-based permissions, or organizational data policies. Missing for 10: admin console documentation, member/role management, org-wide data governance policies, and any evidence of a team-admin experience.
Docs show a business/team workspace admin story: inviting members via email (grok-docs-18), SSO integration with IdP (grok-docs-17), workspace switching with business-plan-protected conversations (grok-docs-39), license-gated sharing (grok-docs-14), and 'enterprise-grade privacy protections' (grok-docs-13). This covers member invitation, authentication/SSO, and some data-policy framing for admins. Missing for 10: detailed role/permission granularity (e.g., admin vs member roles, per-connector access control), explicit data retention/DLP policy configuration UI, and any independent/community corroboration of the admin console working as documented.
- [claimed-docs] “Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
- [claimed-docs] “Invite new team members to join your Grok Business workspace with a simple email invitation process.”
- [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
- [claimed-docs] “Share conversations only with team members who have active licenses.”
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
Data controls
knowledge-workerExport my complete chat history and account data
weight 1 · round drawnMicrosoft Copilotnone0/10Evidence shows users can delete individual conversations or entire history (copilot-docs-38) and opt out of training use (copilot-docs-35), but there is no mention of an export/download feature for complete chat history or account data as required by the story.
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [claimed-docs] “opt out of use of your conversation activity for model training”
Groknone0/10No evidence in the pack mentions a data export or account-data download feature for Grok; docs cover connectors, models, billing, SSO, and workspace features but never a 'export my chat history/data' capability. This is a fair trust-controls axis for a consumer chat product, so absence of evidence yields 'none' rather than 'na'.
knowledge-workerControl whether my conversations are used to train models
weight 3 · round to Microsoft CopilotMicrosoft's own docs confirm a control exists: users can opt out of conversation activity being used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38). However, community evidence indicates confusion about scope—one commenter notes the opt-out applies to standalone Copilot chat/app, not to Copilot embedded in Office apps like Word (copilot-comm-1), and another user reports genuine uncertainty whether their Word document was being used for training with no clear indication (copilot-comm-6). Missing for 10: clear unified documentation covering training-data opt-out scope across all Copilot surfaces (Office-integrated vs standalone), and independent verification that the opt-out setting functions as described.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “Train our generative AI models to create a better experience for you and others.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
Groknone0/10Docs mention 'enterprise-grade privacy protections' for team workspaces and that prompts are stored on xAI servers, but there is no documented setting or toggle letting a knowledge-worker control whether their conversations are used to train models. Community commentary raises general distrust but does not confirm or deny a specific training opt-out control.
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [community] “Musk already has too much power, won't trust him with my AI conversations.”
Not comparable on these axes
ai-native userRun the product headlessly / in CI for automation
weight 2 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is a consumer/office chat assistant product, not a developer tool or API/CLI designed for headless automation or CI pipelines; there's no evidence of any API, CLI, or SDK for scripted/headless invocation. This axis is a category mismatch for this product type.
The xAI API (REST, OpenAPI spec confirmed via probe, streaming, structured outputs, quickstart script) provides a clear headless programmatic interface suitable for automation/CI, and community mentions a 'terminal' mode for Grok Build. However there is no explicit CI/CD documentation, GitHub Actions example, or non-interactive automation guide. missing for 10: dedicated CI/CD integration docs, GitHub Actions or pipeline examples, explicit 'headless mode' documentation.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Streaming outputs is **supported by all models with text output capability**”
- [claimed-docs] “Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
ai-native userConnect an agent via an official MCP server
weight 3 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is itself an AI assistant/agent; the evidence only shows it acting as a client connecting to other services (OneDrive, Gmail, etc.) rather than exposing itself as an MCP server for other agents. Per the agent-role exception, this axis does not apply unless there's evidence of Copilot running as an MCP server, which is absent here.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
Grokn/aGrok is itself an agent/assistant (chat + Grok Build coding agent), and the MCP-related evidence (grok-docs-2,3,19,38) describes Grok acting as an MCP *client* connecting outbound to a user's custom MCP server — not Grok exposing itself as an MCP server for other agents to connect to. Per the rules, client-side MCP connectivity does not make this server-role axis applicable, and there is no evidence of a first-party 'Grok as MCP server' endpoint.
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
ai-native userExplore an interactive API reference with runnable examples
weight 2 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is a consumer/productivity AI assistant, not a developer API/SDK product, so the concept of an interactive API reference with runnable examples is a category error for this axis.
xAI publishes machine-readable docs (llms.txt, openapi.json) and a quickstart with example prompts/code, showing a structured API reference exists, but there is no evidence of an interactive 'try it now' console or in-browser runnable examples typical of tools like Swagger UI or Postman-style explorers. Missing for 10: interactive in-browser code execution/sandbox, live request/response try-it widget, independent confirmation of an interactive reference UI.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
ai-native userTest against a sandbox environment without touching production data
weight 1 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is a consumer/productivity AI assistant, not a developer platform with sandbox/test environments distinct from production data; no evidence pack content addresses sandbox testing concepts at all, and this axis is a category error for this product type.
Groknone0/10No evidence of a sandbox/staging environment or test mode that isolates from production data; docs cover connectors, tunneling for custom tools, and general product features but nothing about a dedicated sandbox for testing without touching production data. missing for 10: sandbox/test environment documentation, data isolation guarantees, staging API keys or environments.