ChatGPT vs Grok
free-tier · subscription-flat · subscription-per-seat · enterprise-custom
·free-tier · subscription-flat · enterprise-custom
ChatGPT wins · 31–7 (11 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round to GrokChatGPT's Browser and MCP features let a user direct the agent to fetch and use third-party documentation or websites (e.g. Context7 for developer docs, browsing arbitrary URLs), which would technically allow pointing it at an llms.txt or agent-oriented doc page. The evidence pack also shows ChatGPT's own docs site publishes an llms.txt (probe-1), indicating familiarity with the convention, but there is no explicit documented feature or example of a user instructing ChatGPT to consume an llms.txt file specifically. Missing for 10: explicit product support/example for llms.txt ingestion, confirmation that browsing normalizes/parses such files as agent-context rather than generic web content, independent hands-on verification.
- [probe] “PROBE llms.txt: HTTP 200 at https://learn.chatgpt.com/llms.txt # Codex > Build with the Codex CLI, IDE extension, and cloud automation to s…”
- [claimed-docs] “Browser lets ChatGPT open websites, gather current information, and take action while you stay in control.”
- [claimed-docs] “Use it to give ChatGPT or Codex access to third-party documentation, or to let it interact with developer tools like your browser or Figma.”
- [claimed-docs] “Model Context Protocol (MCP) connects models to tools and context. Use it to give ChatGPT or Codex access to third-party documentation”
- [claimed-docs] “to add Context7 (a free MCP server for developer documentation)”
The docs site serves a discoverable llms.txt (HTTP 200, describing itself as official xAI developer documentation) and every doc page is also available in plain markdown form, which is exactly the agent-oriented docs pattern the story asks for. Missing for 10: independent/community confirmation that agents actually consume this llms.txt successfully in practice.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
- [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
ai-native userRun the product headlessly / in CI for automation
weight 2 · round to ChatGPTChatGPT's Codex offers a CLI and SDK explicitly documented for headless/CI use ('Use the Codex SDK to automate coding tasks, including jobs in CI'), plus CLI flags (--search, /fast) and a bulk-scan command (npx @openai/codex-security bulk-scan) that support non-interactive automation workflows. missing for 10: independent/hands-on confirmation of actual CI pipeline runs, and more detail on authentication/headless setup specifics for CI environments.
- [claimed-docs] “Use the Codex SDK to automate coding tasks, including jobs in CI.”
- [claimed-docs] “Inspect code, make changes, run commands, and automate repeatable work without leaving your terminal.”
- [claimed-docs] “Use its command-line interface (CLI) to scan repositories you own or have permission to assess, review findings over time”
- [claimed-docs] “Use `npx @openai/codex-security bulk-scan` to review repositories in one campaign.”
- [claimed-docs] “Use `/fast on`, `/fast off`, or `/fast status` in the CLI to change or inspect the current setting.”
- [claimed-docs] “In the CLI, pass `--search` to fetch live results for one run”
The xAI API (REST, OpenAPI spec confirmed via probe, streaming, structured outputs, quickstart script) provides a clear headless programmatic interface suitable for automation/CI, and community mentions a 'terminal' mode for Grok Build. However there is no explicit CI/CD documentation, GitHub Actions example, or non-interactive automation guide. missing for 10: dedicated CI/CD integration docs, GitHub Actions or pipeline examples, explicit 'headless mode' documentation.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Streaming outputs is **supported by all models with text output capability**”
- [claimed-docs] “Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · round to ChatGPTChatGPT has first-party documentation for MCP support, explicitly describing configuring MCP servers (e.g., Context7) so ChatGPT/Codex can access third-party tools like documentation, browser, or Figma, with config stored in config.toml and scoping options for trusted projects, plus cross-client portability once configured. missing for 10: independent/hands-on community corroboration of MCP server usage specifically (community evidence covers plugins/browsing but not MCP directly).
- [claimed-docs] “let it interact with developer tools like your browser or Figma”
- [claimed-docs] “Once you configure your MCP servers, you can switch among those clients without redoing setup.”
- [claimed-docs] “Use it to give ChatGPT or Codex access to third-party documentation, or to let it interact with developer tools like your browser or Figma.”
- [claimed-docs] “to add Context7 (a free MCP server for developer documentation)”
- [claimed-docs] “you can also scope MCP servers to a project with `.codex/config.toml` (trusted projects only)”
- [claimed-docs] “Codex stores MCP configuration in `config.toml`”
- [claimed-docs] “Model Context Protocol (MCP) connects models to tools and context. Use it to give ChatGPT or Codex access to third-party documentation”
xAI docs explicitly describe adding custom MCP connectors and tunneling a local MCP server so Grok can reach it and use its tools, alongside built-in OAuth connectors for other tools (grok-docs-2, grok-docs-3, grok-docs-38, grok-docs-19). Missing for 10: independent/hands-on confirmation that custom MCP tool-calling works reliably in practice, and more detail on protocol/version compatibility.
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
- [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
ai-native userUse an official CLI
weight 2 · round to ChatGPTChatGPT ships an official Codex CLI with documented commands (--search, --cd, /memories, /fast, MCP config via config.toml, codex-security bulk-scan), and the llms.txt probe confirms 'Codex CLI' as a first-party interface for building and automating dev workflows, satisfying the AI-native official CLI story. Missing for 10: independent/hands-on community verification of the CLI itself, since community evidence only covers the general ChatGPT web product, not Codex CLI usage.
- [claimed-docs] “In Codex CLI, use /memories in an interactive session to control whether the current chat can use existing local memories or become an input…”
- [claimed-docs] “Run codex from the directory you want Codex to work in, or pass --cd (-C) to set it explicitly.”
- [claimed-docs] “In the CLI, pass `--search` to fetch live results for one run”
- [claimed-docs] “pass `--search` to fetch live results for one run”
- [claimed-docs] “Use the Codex SDK to automate coding tasks, including jobs in CI.”
- [claimed-docs] “Inspect code, make changes, run commands, and automate repeatable work without leaving your terminal.”
- [claimed-docs] “Codex reads AGENTS.md files before doing any work.”
- [claimed-docs] “Use rules to control which commands Codex can run outside the sandbox.”
- [claimed-docs] “Use `/fast on`, `/fast off`, or `/fast status` in the CLI to change or inspect the current setting.”
- [claimed-docs] “Use its command-line interface (CLI) to scan repositories you own or have permission to assess, review findings over time”
- [claimed-docs] “Use `npx @openai/codex-security bulk-scan` to review repositories in one campaign.”
- [probe] “PROBE llms.txt: HTTP 200 at https://learn.chatgpt.com/llms.txt # Codex > Build with the Codex CLI, IDE extension, and cloud automation to s…”
There's no official CLI documentation for Grok, but a community comment references a terminal-based interface for 'Grok Build' ('terminal is nice but codex desktop app is very useful'), suggesting some CLI-like coding tool exists even though it isn't documented in the official docs pack. missing for 10: official CLI documentation/reference, installation instructions, and command examples confirming a first-party CLI product.
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
ai-native userDrive the product through a documented public API
weight 3 · round to GrokThere is documented evidence of programmatic/scriptable access via the Codex CLI and Codex SDK ('Use the Codex SDK to automate coding tasks, including jobs in CI', CLI flags like --search, --cd, /fast, config.toml), which lets an AI-native user drive parts of the product outside the chat UI. However, a probe for a standard documented public API (openapi.json/swagger) at the docs site returned 404 on all candidate paths, and none of the evidence describes a general, versioned public API for driving ChatGPT itself (as opposed to Codex-specific tooling or MCP client configuration). Missing for 10: an explicit REST/GraphQL API reference for ChatGPT product actions, OpenAPI/swagger spec, and independent corroboration that non-Codex ChatGPT features are API-drivable.
- [claimed-docs] “Use the Codex SDK to automate coding tasks, including jobs in CI.”
- [claimed-docs] “Inspect code, make changes, run commands, and automate repeatable work without leaving your terminal.”
- [claimed-docs] “Use its command-line interface (CLI) to scan repositories you own or have permission to assess, review findings over time”
- [claimed-docs] “Use `npx @openai/codex-security bulk-scan` to review repositories in one campaign.”
- [probe] “PROBE openapi: all candidate paths 404 (https://learn.chatgpt.com/openapi.json, https://learn.chatgpt.com/swagger.json, https://learn.chatgp…”
xAI publishes a full public REST API with documented endpoints for text, image, video, tool use, structured outputs, and an OpenAPI spec confirmed live by probe, plus a quickstart guide, satisfying the AI-native/agentic driving story. missing for 10: independent third-party benchmarking of API reliability/completeness beyond xAI's own docs and anecdotal community chatter about tool-calling quirks.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
- [claimed-docs] “Streaming outputs is **supported by all models with text output capability**”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · round to ChatGPTChatGPT/Codex docs show some least-privilege mechanisms for agent tool access — MCP servers can be scoped to a trusted project via `.codex/config.toml` (chatgpt-docs-55), sandbox command rules can restrict what Codex can run outside the sandbox (chatgpt-docs-95), and workspace admins can control access to browser use, plugins, and network access (chatgpt-docs-88), plus GPT builders can configure scoped third-party API actions (chatgpt-docs-34, chatgpt-docs-44). However there is no evidence of a user-facing mechanism to actually issue/generate a scoped or least-privilege API credential/token specifically for an agent to use. missing for 10: explicit scoped API key/token issuance workflow, granularity/expiry controls on such credentials, and any documentation or independent confirmation that a user can mint a restricted-permission credential for agent use.
- [claimed-docs] “you can also scope MCP servers to a project with `.codex/config.toml` (trusted projects only)”
- [claimed-docs] “Use rules to control which commands Codex can run outside the sandbox.”
- [claimed-docs] “Your workspace administrator can control access to ChatGPT Work, plugins, browser use, and network access.”
- [claimed-docs] “Allow GPT builders to use approved workspace apps or configure actions that interact with permitted third-party APIs.”
- [claimed-docs] “configure actions that interact with permitted third-party APIs”
Groknone0/10The xAI API is a developer product with API keys, so scoped/least-privilege credential issuance is a fair capability to expect, but the evidence pack contains no mention of API key scopes, roles, granular permissions, or least-privilege credential controls — only OAuth-based connector authentication (grok-docs-19) for built-in tools, which is about connecting Grok to external services, not issuing scoped agent credentials.
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
ai-native userBuild against official SDKs
weight 2 · round drawnThe pack contains a single line noting 'Use the Codex SDK to automate coding tasks, including jobs in CI' (chatgpt-docs-91), indicating an official SDK exists for Codex/automation, but there is no linked documentation, API reference, code samples, or independent corroboration of this SDK's use. The openapi probe found no public API spec, reinforcing that developer-facing SDK documentation is thin in this evidence set. missing for 10: dedicated SDK documentation/reference pages, code examples, language support details, independent developer reports of building with the SDK.
- [claimed-docs] “Use the Codex SDK to automate coding tasks, including jobs in CI.”
- [probe] “PROBE openapi: all candidate paths 404 (https://learn.chatgpt.com/openapi.json, https://learn.chatgpt.com/swagger.json, https://learn.chatgp…”
The evidence shows an official xAI developer API with a published OpenAPI spec, quickstart docs, and text-generation/tool-use guides (grok-docs-20, grok-docs-27, grok-probe-3), which implies programmatic access an AI-native builder could use, but none of the evidence explicitly names or documents an official SDK (e.g., Python/JS client library) as opposed to raw REST/OpenAPI usage. Missing for 10: explicit documentation of a first-party SDK package, install instructions, or code samples showing SDK usage, plus any independent/community confirmation of SDK quality or adoption.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
ai-native userSubscribe to events via webhooks
weight 2 · round to ChatGPTChatGPT's Automations/Scheduled Tasks support event-driven triggers ('act on pull request feedback without polling on a fixed cadence') tied to Gmail, Slack, and GitHub events, which functions like a webhook-subscription mechanism, but this is not exposed as a general-purpose webhook subscription API — it's limited to a few pre-integrated services with no documented endpoint/config for arbitrary webhook URLs. Missing for 10: a generic webhook subscription API/config for third-party or custom events, documentation of payload/security handling, and any independent confirmation of reliability.
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “Use an event trigger to triage new email, summarize channel activity, or act on pull request feedback without polling on a fixed cadence.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
Groknone0/10No evidence of any webhook subscription mechanism for Grok events; the docs describe connectors, tools, image/video generation, and inbound MCP tunneling, but nothing about outbound event notifications or webhook endpoints. Missing for 10: any webhook subscription API, event types, or delivery/registration mechanism.
Agentic features
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · round to ChatGPTChatGPT can analyze uploaded/connected data (files, projects, local folders, connected apps like Google Drive/SharePoint/Salesforce) and generate insights, summaries, and suggestions (e.g. 'Search the web, browse websites, compare sources, read files, analyze data, and summarize findings' and 'Create a deck, analyze files, draft a report, build a project plan'), with projects giving persistent context for tailored suggestions. Missing for 10: independent hands-on evidence specifically validating data-insight quality/accuracy (community evidence largely covers unrelated features like web search accuracy issues, not data-analysis insight quality).
- [claimed-docs] “Search the web, browse websites, compare sources, read files, analyze data, and summarize findings.”
- [claimed-docs] “Create a deck, analyze files, draft a report, build a project plan”
- [claimed-docs] “Use a project to organize related chats and give ChatGPT the context it needs.”
- [claimed-docs] “A local project gives chats access to one or more folders on your computer, such as a collection of source files or a codebase.”
- [claimed-docs] “Plugins can connect ChatGPT to the tools and information you use for work, such as Google Drive, SharePoint, Salesforce, or Gong.”
- [claimed-docs] “Turn research and analysis into documents, presentations, spreadsheets, and other finished work.”
Grok's connectors (Gmail/Calendar, Google Drive, Microsoft Teams, Salesforce, custom APIs/MCP) let it read and act on a user's own data inside the chat, and features like Realtime Multi-agent Research suggest Grok can analyze and synthesize that data into insights. However, the evidence is mostly first-party docs describing data access rather than concrete examples of proactive 'insights and suggestions,' and one hands-on report notes Grok has 'real trouble with agentic tool calling,' undercutting confidence in reliable in-context analysis. Missing for 10: independent hands-on demonstration of Grok surfacing unprompted insights/suggestions from connected data, and confirmation that tool-calling reliability issues don't undermine this in practice.
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [claimed-docs] “Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
ai-native userSet up automations that run autonomously in the background
weight 2 · round to ChatGPTChatGPT's Scheduled Tasks/Automations feature explicitly lets users schedule recurring or event-triggered tasks (Gmail, Slack, GitHub events) to run autonomously in the background, with a dashboard to review active, paused, and completed runs. This is well-documented first-party functionality directly matching the story. Missing for 10: independent hands-on verification of background automation reliability and no community corroboration specifically about the automations/scheduled-tasks feature.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
- [claimed-docs] “Use an event trigger to triage new email, summarize channel activity, or act on pull request feedback without polling on a fixed cadence.”
Grok Bot is described as an AI teammate running on a 'persistent cloud computer' and Grok supports multi-agent orchestration for research tasks, hinting at some background/autonomous agent capability, but there is no documentation of scheduling, triggers, or recurring/timed automation setup. Missing for 10: explicit scheduling/trigger mechanism, details on how automations run without user prompting, and independent confirmation of autonomous background execution.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round to ChatGPTChatGPT ships extensive built-in agentic delegation: Work/Codex modes carry tasks through to reviewable results, scheduled/background tasks and event-triggered automations, computer use and browser control, subagent delegation, and voice-initiated task delegation — all first-party features, not third-party add-ons. Missing for 10: independent hands-on verification of these newer agentic features (Work, subagents, Computer Use) beyond vendor docs.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “Turn on Work in the switcher when you want ChatGPT to carry a larger task through to a reviewable result.”
- [claimed-docs] “Run projects in parallel, work with files, use your computer, and keep long-running work moving from one desktop workspace.”
- [claimed-docs] “Unlike Work on the Web, local Work can operate on resources that remain on your computer without requiring you to upload files to a cloud co…”
- [claimed-docs] “In ChatGPT Work, ask ChatGPT to delegate independent work to subagents.”
- [claimed-docs] “ChatGPT Voice can start separate tasks for longer work, check existing tasks, and send follow-up instructions.”
- [claimed-docs] “Browser lets ChatGPT open websites, gather current information, and take action while you stay in control.”
- [claimed-docs] “With Computer Use, ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “enter `/goal` to start Goal mode”
Grokdisputedcontradicted6/10xAI docs describe strong built-in agentic delegation — Grok Bot hands work to 'AI teammates on a persistent cloud computer,' Realtime Multi-agent Research orchestrates multiple agents for research tasks, and connectors let Grok act on email/calendar/Salesforce from chat (grok-docs-15, grok-docs-26, grok-docs-11, grok-docs-16, grok-docs-19). However, hands-on community testing directly contradicts smooth agentic delegation: a user reports Grok 'had real trouble with agentic tool calling - the model felt like it hadn't been trained to think of tool calling as one of its primary modalities' (grok-comm-6), and another notes the lack of a proper GUI for Grok Build limiting usability (grok-comm-7). Missing for 10: independent verification that Grok Bot/multi-agent research reliably completes delegated tasks end-to-end, and resolution of the reported tool-calling weakness.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
ai-native userOperate the product with natural-language commands
weight 2 · round to ChatGPTChatGPT is fundamentally a natural-language interface: users type or speak requests and it carries out tasks (browsing, coding, file edits, image generation, scheduling, computer use, voice) via plain conversational commands, per extensive first-party docs and corroborating community reports of natural-language driven capability (e.g. running Docker/filesystem commands via prompts). Missing for 10: independent hands-on verification specifically of newer agentic features (Work, Goal mode, subagents) beyond vendor docs.
- [claimed-docs] “Browser lets ChatGPT open websites, gather current information, and take action while you stay in control.”
- [claimed-docs] “With Computer Use, ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “ChatGPT Voice lets you talk through ideas and coordinate tasks in Chat, Work, and Codex in the ChatGPT desktop app. Start work, check progre…”
- [claimed-docs] “In the ChatGPT desktop app, enter `/goal` to start Goal mode.”
- [claimed-docs] “In ChatGPT Work, ask ChatGPT to delegate independent work to subagents.”
- [community] “I am beyond astounded. I was able to run a Docker image, utilize the fs inside of the container, and exit the container. Docker system comma…”
- [community] “This is huge, essentially adding what people have been building with LangChain Tools into the core product. The browser and file-upload/inte…”
Grok's docs describe a chat/voice interface where natural-language input drives text generation, image/video creation, and connector actions like creating Salesforce records or searching email 'directly from chat' (grok-docs-11, grok-docs-16, grok-docs-35, grok-docs-40), which is core evidence for NL-command operation. However, hands-on community testing reports real trouble with agentic tool calling, saying the model 'hadn't been trained to think of tool calling as one of its primary modalities' (grok-comm-6), which tempers confidence that NL commands reliably trigger tool/connector actions. Missing for 10: independent benchmarks or user reports specifically confirming reliable NL-to-action execution across the built-in connectors, and no clear resolution of the tool-calling reliability concern.
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
Api quality
ai-native userExplore an interactive API reference with runnable examples
weight 2 · round to GrokChatGPTnone0/10The evidence pack contains no documentation of an interactive API reference or runnable code examples; a direct probe for OpenAPI/swagger specs on the docs site returned 404 across all candidate paths, and no other citation mentions an API reference sandbox or runnable snippets.
- [probe] “PROBE openapi: all candidate paths 404 (https://learn.chatgpt.com/openapi.json, https://learn.chatgpt.com/swagger.json, https://learn.chatgp…”
xAI publishes machine-readable docs (llms.txt, openapi.json) and a quickstart with example prompts/code, showing a structured API reference exists, but there is no evidence of an interactive 'try it now' console or in-browser runnable examples typical of tools like Swagger UI or Postman-style explorers. Missing for 10: interactive in-browser code execution/sandbox, live request/response try-it widget, independent confirmation of an interactive reference UI.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round to GrokChatGPTnone0/10The probe explicitly checked for an OpenAPI/machine-readable spec at all standard locations and found only 404s, with no other evidence pack item showing a downloadable API spec for ChatGPT itself.
- [probe] “PROBE openapi: all candidate paths 404 (https://learn.chatgpt.com/openapi.json, https://learn.chatgpt.com/swagger.json, https://learn.chatgp…”
A direct probe confirms https://docs.x.ai/openapi.json returns HTTP 200 and contains an 'openapi' key, i.e., a downloadable, machine-readable OpenAPI spec for the xAI API, and this is corroborated by extensive first-party API docs describing the full endpoint surface (text, images, video, tools). Missing for 10: independent/community confirmation that developers actually consume this spec (e.g., via SDK codegen) beyond the automated probe.
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at ht…”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
ai-native userTest against a sandbox environment without touching production data
weight 1 · round to ChatGPTCodex documentation indicates commands run inside a sandbox by default, with rules governing what can run 'outside the sandbox' (chatgpt-docs-95), and Codex Security's scanning is scoped to repos you own/have permission to assess (chatgpt-docs-97/98), implying isolated execution rather than direct production access. However, there is no explicit documentation describing a dedicated 'test/staging' environment distinct from production data, no detail on how production systems/data are excluded, and no independent/hands-on confirmation of this isolation. Missing for 10: explicit sandbox-vs-production data separation docs, details on network/data isolation guarantees, and independent verification of the sandbox boundary holding in practice.
- [claimed-docs] “Use rules to control which commands Codex can run outside the sandbox.”
- [claimed-docs] “Use its command-line interface (CLI) to scan repositories you own or have permission to assess, review findings over time”
- [claimed-docs] “Use `npx @openai/codex-security bulk-scan` to review repositories in one campaign.”
Groknone0/10No evidence of a sandbox/staging environment or test mode that isolates from production data; docs cover connectors, tunneling for custom tools, and general product features but nothing about a dedicated sandbox for testing without touching production data. missing for 10: sandbox/test environment documentation, data isolation guarantees, staging API keys or environments.
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · round drawnChatGPTnone0/10No evidence of a versioned API or a documented deprecation policy is present; the OpenAPI probe explicitly returned 404s and none of the docs mention API versioning or deprecation practices.
- [probe] “PROBE openapi: all candidate paths 404 (https://learn.chatgpt.com/openapi.json, https://learn.chatgpt.com/swagger.json, https://learn.chatgp…”
Groknone0/10The evidence shows model version slugs (grok-4.6, grok-4.5) and an OpenAPI spec, but no documentation of a formal deprecation policy, sunset timelines, or versioning guarantees for the API. Release notes describe new features and model updates but never state how/when older model versions are retired.
- [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
- [claimed-docs] “grok-4.6` and `grok-4.5` support the `reasoning_effort` parameter, which controls how much effort the model spends thinking before respondin…”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
Agents tasks — stories about agents tasks in this arenaAgents tasks
Stories about agents tasks in this arena
Agent mode
power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review
weight 3 · round to ChatGPTChatGPT's Tasks/automations feature explicitly supports scheduling and running multi-step work in the background (including event-triggered runs from Gmail/Slack/GitHub), with a review interface for active/completed runs, and 'Work' mode is described as carrying larger tasks through to a reviewable result; Codex further supports background coding tasks and subagent delegation. Missing for 10: independent hands-on verification of background task reliability/quality and no third-party review of the review/approval workflow.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
- [claimed-docs] “Turn on Work in the switcher when you want ChatGPT to carry a larger task through to a reviewable result.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
- [claimed-docs] “In ChatGPT Work, ask ChatGPT to delegate independent work to subagents.”
- [claimed-docs] “Start a Codex task to run the tests and investigate anything that doesn't pass.”
Docs describe 'Grok Bot' as handing 'real work to AI teammates on a persistent cloud computer' and a 'Realtime Multi-agent Research' feature that orchestrates multi-step research autonomously, directly matching the story's core idea of background delegation and review. However, evidence is vendor-doc only with no independent confirmation of the async review workflow (notifications, task state, resuming), and community feedback (grok-comm-6) notes real trouble with agentic tool calling, suggesting reliability caveats. Missing for 10: independent hands-on validation of the background-task lifecycle, detail on how results are surfaced for review, and confirmation tool-calling reliability issues don't undermine multi-step autonomy.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites
weight 3 · round to ChatGPTChatGPT's Browser feature explicitly lets it open websites, gather information, and take action on the user's behalf while staying in control, and can complete multi-step tasks like comparing options or completing actions on a website; this is reinforced by Computer Use (operating GUIs) and Work/Codex browser tab integration for signed-in site tasks. missing for 10: independent hands-on verification of complex multi-step website task completion, and detail on reliability/success rate limits.
- [claimed-docs] “Browser lets ChatGPT open websites, gather current information, and take action while you stay in control.”
- [claimed-docs] “Use it to compare options, complete a multi-step task on a website, or review a page you're building.”
- [claimed-docs] “With Computer Use, ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “ChatGPT can see and operate graphical user interfaces on macOS or Windows”
- [claimed-docs] “Bring an open tab into a ChatGPT Work or Codex chat and work with the website where you're already signed in.”
- [claimed-docs] “Follow the sign-in request and enter your details in the sign-in flow, not in the chat. This doesn't connect your local browser profile.”
- [claimed-docs] “With Site tools (WebMCP), ChatGPT Work and Codex can use actions offered by a website in the desktop app's built-in browser.”
Groknone0/10The evidence shows connectors for APIs, email, calendar, Salesforce, and a vague 'Grok Bot' cloud computer teammate, but nothing documents Grok actually driving a web browser to navigate sites or complete tasks (no browsing/computer-use agent feature is described). Multi-agent research (grok-docs-26) is about research orchestration, not website interaction, so this applicable-but-unevidenced capability is 'none'.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
power-userLet the assistant see and operate applications on my computer to complete work
weight 2 · round to ChatGPTChatGPT's Computer Use feature explicitly lets it see and operate GUIs on macOS/Windows, including testing desktop/mobile app flows, backed by Browser and Work agent capabilities that carry out multi-step tasks on the user's behalf. Documentation is extensive and detailed across multiple first-party sources describing screen operation, browser control, and file/app interaction. Missing for 10: independent hands-on verification of Computer Use reliability in practice.
- [claimed-docs] “With Computer Use, ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “ChatGPT can see and operate graphical user interfaces on macOS or Windows”
- [claimed-docs] “ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “Testing a macOS app, Windows app, iOS simulator flow, or another desktop app that ChatGPT is building.”
- [claimed-docs] “Browser lets ChatGPT open websites, gather current information, and take action while you stay in control.”
- [claimed-docs] “Use it to compare options, complete a multi-step task on a website, or review a page you're building.”
- [claimed-docs] “Run projects in parallel, work with files, use your computer, and keep long-running work moving from one desktop workspace.”
- [claimed-docs] “Unlike Work on the Web, local Work can operate on resources that remain on your computer without requiring you to upload files to a cloud co…”
- [claimed-docs] “Your ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use.”
Groknone0/10Grok offers connectors (Gmail, Drive, Teams, Salesforce, custom MCP) and a 'Grok Bot' that operates on a persistent *cloud* computer, but there is no evidence of Grok seeing or controlling applications running on the user's own local machine/desktop (e.g., screen/GUI control akin to computer-use agents). Missing for 10: any documented local-computer screen/GUI control, first-party or hands-on evidence of operating a user's own desktop apps.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
Tasks
power-userSchedule recurring or one-off tasks that run automatically and come back to me with results
weight 2 · round to ChatGPTChatGPT's Automations/Scheduled Tasks feature explicitly supports scheduling recurring or one-off tasks that run in the background and report back, plus event-triggered tasks from Gmail/Slack/GitHub, with a UI to review active, paused, and completed runs. missing for 10: independent/hands-on community corroboration of scheduled task reliability and no detail on notification/result-delivery mechanics beyond docs.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
- [claimed-docs] “Use an event trigger to triage new email, summarize channel activity, or act on pull request feedback without polling on a fixed cadence.”
Apps devices — stories about apps devices in this arenaApps devices
Stories about apps devices in this arena
Apps
power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen
weight 2 · round to ChatGPTThe evidence confirms an official ChatGPT desktop app (macOS/Windows) that can 'use your computer' and run 'Computer Use' to see and operate GUIs, including screenshot-based screen access, plus desktop-only features like floating Pets controls and multi-browser support. However, there is no documentation of OS-level global keyboard shortcuts (e.g., a system-wide hotkey to invoke the app) or of general 'what's on my screen' querying outside the specific Computer Use/testing use case. Missing for 10: explicit OS-level shortcut/hotkey documentation, general screen-content awareness beyond Computer Use testing scenarios, independent hands-on confirmation of these desktop-specific features.
- [claimed-docs] “Run projects in parallel, work with files, use your computer, and keep long-running work moving from one desktop workspace.”
- [claimed-docs] “Work in Edge, Brave, Opera, or Vivaldi as well as Chrome from the ChatGPT desktop app.”
- [claimed-docs] “With Computer Use, ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “ChatGPT can see and operate graphical user interfaces on macOS or Windows”
- [claimed-docs] “ChatGPT can see and operate graphical user interfaces on macOS or Windows.”
- [claimed-docs] “Your ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use.”
- [claimed-docs] “Type a request or start a voice conversation from the floating Pets controls in the ChatGPT desktop app on macOS and Windows.”
- [claimed-docs] “Testing a macOS app, Windows app, iOS simulator flow, or another desktop app that ChatGPT is building.”
Groknone0/10The evidence pack shows only cross-platform sign-in sync and hands-free voice, but no mention of an official desktop app with OS-level shortcuts or screen-reading/access capability; a community comment even notes the lack of a proper GUI for Grok's coding product ('still waiting for a proper gui for grok build ... codex desktop app is very useful'), suggesting no such desktop tool exists.
- [claimed-docs] “Sign in once and your conversations, settings, and subscription stay in sync across every platform.”
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [community] “still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
knowledge-workerUse full-featured official mobile apps for iOS and Android
weight 2 · round to ChatGPTThe iOS App Store listing (chatgpt-docs-20/21/41/52/58/59) documents rich mobile features—voice mode, photo upload, image generation, stickers—confirming a full-featured iOS app, and doc references (chatgpt-docs-67) explicitly mention continuing tasks 'in ChatGPT Work on the web, iOS, or Android,' indicating Android parity. Missing for 10: no dedicated Android app store evidence pack, no independent hands-on reviews of the mobile apps' feature completeness or performance.
- [claimed-docs] “Photo upload—Snap or upload a picture to transcribe a handwritten recipe or get info about a landmark.”
- [claimed-docs] “Advanced Voice Mode–Tap the soundwave icon to have a real-time convo on the go.”
- [claimed-docs] “Advanced Voice Mode–Tap the soundwave icon to have a real-time convo on the go. Settle a dinner table debate, or practice a new language.”
- [claimed-docs] “Snap or upload a picture to transcribe a handwritten recipe or get info about a landmark.”
- [claimed-docs] “Image generation–Generate original images from a description, or transform existing ones with a few simple words.”
- [claimed-docs] “Choose an image and style, remix with emojis, and make personalized stickers that are ready to share in your group chat.”
- [claimed-docs] “continue a task that needs a website account in ChatGPT Work on the web, iOS, or Android”
Docs mention voice mode ('Talk to Grok hands-free with voice') and cross-platform sync of conversations/settings/subscriptions, implying mobile app support, but there is no explicit confirmation of dedicated full-featured iOS and Android apps, no app-store links, and no community/hands-on feedback about mobile app quality or feature parity with desktop/web. Missing for 10: explicit iOS/Android app documentation, feature-parity details, and independent user reviews of the mobile apps themselves.
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [claimed-docs] “Sign in once and your conversations, settings, and subscription stay in sync across every platform.”
Custom bots
power-userBuild and share custom assistants with their own instructions and knowledge
weight 2 · round to ChatGPTDocs confirm a 'GPT builder' concept for creating custom GPTs with configurable actions/connected apps and a dedicated 'gpts-and-sharing' doc implying sharing, but no evidence details custom instructions or uploading a knowledge base, and no independent/hands-on corroboration of the sharing flow. Missing for 10: explicit mention of setting custom instructions, uploading knowledge files, and community/hands-on validation of building and sharing a custom GPT.
- [claimed-docs] “Allow GPT builders to use approved workspace apps or configure actions that interact with permitted third-party APIs.”
- [claimed-docs] “configure actions that interact with permitted third-party APIs”
- [claimed-docs] “GPT builders can use either connected apps or custom actions, but not both in the same GPT.”
Groknone0/10The evidence pack covers connectors, tool integrations, MCP, image/video generation, and enterprise features, but there is no mention of a feature to create and share custom assistants/personas with their own instructions and knowledge base (akin to OpenAI's GPTs or Claude Projects).
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round to ChatGPTChatGPT/Codex docs show concrete bulk-style automation: 'bulk-scan' scanning many repositories in one campaign (chatgpt-docs-98), a CLI for scanning multiple repos over time (chatgpt-docs-97), running multiple projects in parallel (chatgpt-docs-32), and delegating work to subagents (chatgpt-docs-103), plus background scheduled tasks with multiple runs (chatgpt-docs-37). This covers meaningful bulk/parallel automation but is concentrated in coding/security contexts rather than general-purpose bulk operations across arbitrary item sets, and there's no independent/hands-on corroboration of these bulk claims. Missing for 10: evidence of bulk operations on non-code items (e.g., bulk document/data processing), and independent verification that bulk-scan/subagent delegation works reliably at scale.
- [claimed-docs] “Use `npx @openai/codex-security bulk-scan` to review repositories in one campaign.”
- [claimed-docs] “Use its command-line interface (CLI) to scan repositories you own or have permission to assess, review findings over time”
- [claimed-docs] “Run projects in parallel, work with files, use your computer, and keep long-running work moving from one desktop workspace.”
- [claimed-docs] “In ChatGPT Work, ask ChatGPT to delegate independent work to subagents.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
The docs mention batch generation of multiple images and support for up to 5 source images in a single edit, which is a narrow form of bulk operation, but there's no evidence of general-purpose bulk operations (e.g., bulk file processing, bulk record updates, batch text API) across many items or arbitrary data types. Missing for 10: a true batch/bulk API for text or file processing, bulk actions on connector data (e.g., mass email/calendar updates), and independent confirmation that these batch features work reliably at scale.
- [claimed-docs] “Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ra…”
- [claimed-docs] “Image editing now accepts up to 5 source images per request (was 3).”
- [claimed-docs] “Use up to five source images for a single image edit.”
ai-native userDefine rules that trigger actions automatically on events
weight 3 · round to ChatGPTChatGPT's automations/scheduled tasks feature explicitly supports event-driven triggers (Gmail, Slack, GitHub) instead of just fixed schedules, letting users define rules that fire actions on external events, and lets them review active/paused/completed runs. Missing for 10: independent or hands-on verification that these event triggers work reliably in practice, and detail on how flexible/general the rule definitions can be beyond the three named integrations.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “Use an event trigger to triage new email, summarize channel activity, or act on pull request feedback without polling on a fixed cadence.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
Groknone0/10Grok's docs describe connectors, tool integrations, and a persistent 'Grok Bot' cloud agent, but nothing describes user-defined rules that trigger actions automatically on external events (e.g., webhooks, triggers, if-this-then-that automations, or scheduled event listeners). The axis is plausible for an AI-native product with tool/connector access, so this is 'none' rather than 'na'.
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
ai-native userSchedule recurring jobs or workflows
weight 2 · round to ChatGPTChatGPT's Scheduled Tasks/Automations feature explicitly supports recurring background jobs ('Schedule recurring tasks to run in the background,' with review of active/paused/completed runs) and even event-based triggers (Gmail, Slack, GitHub) as an alternative to fixed cadence. This directly matches the story of scheduling recurring jobs/workflows with first-party docs. Missing for 10: independent/hands-on community corroboration of the scheduling feature specifically (evidence pack community items don't address automations/scheduling) and more detail on reliability/limits in practice.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
- [claimed-docs] “Use an event trigger to triage new email, summarize channel activity, or act on pull request feedback without polling on a fixed cadence.”
ai-native userVersion, review, and roll back my automations
weight 1 · round to ChatGPTChatGPT supports scheduled/recurring automations with a review of active/paused/completed task runs (chatgpt-docs-11, chatgpt-docs-37, chatgpt-docs-47), which gives some review and status visibility, but there is no evidence of version history, diffing between automation versions, or a rollback mechanism to revert an automation to a prior state. missing for 10: explicit versioning of automations, diff/comparison between versions, and a documented rollback/revert feature.
- [claimed-docs] “Schedule recurring tasks to run in the background.”
- [claimed-docs] “Schedule recurring tasks to run in the background... Review active, paused, and completed tasks and recent runs in Scheduled.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
Connectors apps — stories about connectors apps in this arenaConnectors apps
Stories about connectors apps in this arena
Connectors
power-userBrowse a directory of third-party apps and connectors and add them to the assistant
weight 2 · round to ChatGPTChatGPT documents a Plugins/connectors ecosystem — installing named plugins (Slack, Codex Security), connecting to third-party tools like Google Drive, SharePoint, Salesforce, and Gong, and GPT builders choosing 'connected apps' or custom actions from an approved list — which together describe browsing and adding third-party integrations to the assistant. Missing for 10: independent/hands-on confirmation of the actual browse-and-add directory UI/UX and its breadth beyond the named examples.
- [claimed-docs] “Install the Slack plugin to summarize channels or draft replies.”
- [claimed-docs] “Install the Codex Security plugin to scan authorized code and confirm plausible vulnerability findings.”
- [claimed-docs] “Plugins can connect ChatGPT to the tools and information you use for work, such as Google Drive, SharePoint, Salesforce, or Gong.”
- [claimed-docs] “Allow GPT builders to use approved workspace apps or configure actions that interact with permitted third-party APIs.”
- [claimed-docs] “GPT builders can use either connected apps or custom actions, but not both in the same GPT.”
- [claimed-docs] “configure actions that interact with permitted third-party APIs”
Docs show Grok exposes a set of built-in, OAuth-authenticated connectors (Salesforce, Gmail, Google Calendar, Google Drive, Microsoft Teams) plus custom/MCP connectors that a user can add to reach external tools (grok-docs-16,19,35,36,37,2,3). This matches the 'add third-party apps/connectors' part of the story, but there's no explicit evidence of a browsable directory/marketplace UI, ratings, or a curated catalog page for discovering connectors. missing for 10: a documented directory/marketplace UI for browsing connectors, independent user confirmation of the browse experience.
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [claimed-docs] “Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers
weight 3 · round to GrokDocs show ChatGPT can connect to Google Drive/SharePoint via plugins and can trigger on Gmail events, giving cloud-drive and email connectivity, and MCP/plugins provide a general connector framework for third-party tools. However, there is no explicit mention of calendar integration, and all evidence is vendor documentation with no independent/hands-on confirmation that these connectors actually surface content in answers. Missing for 10: explicit calendar connector support, independent corroboration of connector functionality, and clearer 'search across all three data sources in one answer' evidence.
- [claimed-docs] “Plugins can connect ChatGPT to the tools and information you use for work, such as Google Drive, SharePoint, Salesforce, or Gong.”
- [claimed-docs] “Install the Slack plugin to summarize channels or draft replies.”
- [claimed-docs] “Scheduled tasks can now start when a supported event occurs in Gmail, Slack, or GitHub.”
- [claimed-docs] “scheduled tasks can run when a supported Gmail, Slack, or GitHub event occurs”
- [claimed-docs] “Model Context Protocol (MCP) connects models to tools and context. Use it to give ChatGPT or Codex access to third-party documentation”
- [claimed-docs] “Use it to give ChatGPT or Codex access to third-party documentation, or to let it interact with developer tools like your browser or Figma.”
Grok docs explicitly describe built-in OAuth connectors for Gmail, Google Calendar, and Google Drive that let it search emails, read files, and manage calendar items right inside chat, plus a broader connectors framework for other SaaS tools. This directly matches the story of connecting cloud drive, email, and calendar for search/use in answers. Missing for 10: independent/hands-on confirmation of these specific connectors working reliably in practice (community evidence largely covers coding/chat quality, not connector behavior).
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
Files analysis — stories about files analysis in this arenaFiles analysis
Stories about files analysis in this arena
Analysis
power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files
weight 3 · round to ChatGPTChatGPT's Code Interpreter/Data Analysis capability (documented via file drafting, spreadsheet/PDF handling, interactive visualizations, and downloadable finished files) lets it write and execute code against uploaded data to produce charts and computed answers, then export results as documents/spreadsheets/PDFs. Docs explicitly describe analyzing files, building interactive visualizations, and downloading completed files, and community evidence corroborates real code/file execution capability (e.g., running code/containers, file interpretation plugins). Missing for 10: no dedicated first-party doc page specifically titled 'Code Interpreter/Data Analysis' in this pack, and no hands-on example showing a specific chart-from-CSV walkthrough.
- [claimed-docs] “Draft and refine documents, presentations, spreadsheets, and PDF files. Review the result, ask for specific changes, and download the comple…”
- [claimed-docs] “make interactive [visualizations], and build or share websites and apps with [Sites]”
- [claimed-docs] “Create a deck, analyze files, draft a report, build a project plan”
- [claimed-docs] “Search the web, browse websites, compare sources, read files, analyze data, and summarize findings.”
- [claimed-docs] “Draft and refine [documents, presentations, spreadsheets, and PDF files]. Review the result, ask for specific changes, and download the comp…”
- [community] “This is huge, essentially adding what people have been building with LangChain Tools into the core product. The browser and file-upload/inte…”
Groknone0/10The evidence describes Grok's coding assistant (Grok Build), connectors for email/calendar/files, image/video generation, and multi-agent research, but nothing documents a code-interpreter style capability where Grok writes and executes code against user-supplied data to produce charts, computed answers, or downloadable output files. Community comments discuss coding quality and agentic tool-calling issues but not this specific data-analysis/file-output workflow.
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [community] “I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model f…”
Artifacts
knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export
weight 2 · round to ChatGPTDocs strongly support creating and iteratively editing documents, presentations, spreadsheets, and PDFs, with review/annotation and export/download workflows (chatgpt-docs-8, chatgpt-docs-30, chatgpt-docs-60, chatgpt-docs-66, chatgpt-docs-68, chatgpt-docs-70), plus a dedicated artifacts/canvas viewer supporting annotations and comments for iterative refinement (chatgpt-docs-7, chatgpt-docs-18, chatgpt-docs-24, chatgpt-docs-101). Missing for 10: independent hands-on corroboration specifically of document/presentation export workflows (community evidence pack focuses on other capabilities like coding/search, not file export).
- [claimed-docs] “Draft and refine documents, presentations, spreadsheets, and PDF files.”
- [claimed-docs] “Draft and refine documents, presentations, spreadsheets, and PDF files. Review the result, ask for specific changes, and download the comple…”
- [claimed-docs] “Draft and refine [documents, presentations, spreadsheets, and PDF files]. Review the result, ask for specific changes, and download the comp…”
- [claimed-docs] “Create a deck, analyze files, draft a report, build a project plan”
- [claimed-docs] “Turn research and analysis into documents, presentations, spreadsheets, and other finished work.”
- [claimed-docs] “Use ChatGPT Work to turn notes, docs, research, or meeting materials into a structured deck.”
- [claimed-docs] “Annotations let you point to a specific part of a file and tell ChatGPT what to change.”
- [claimed-docs] “a document editor can provide tools to find a section or add a comment”
- [claimed-docs] “Use annotations to point at a specific part of a supported preview and request a focused revision.”
Groknone0/10The evidence pack shows Grok connectors for reading/searching Google Drive, Gmail, Calendar, and Salesforce, plus image/video generation and coding via Grok Build, but nothing describes a document/presentation authoring or iterative-editing feature (e.g., a canvas-style doc editor) with export to file formats like Word/PowerPoint/PDF.
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
Files
knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents
weight 3 · round to ChatGPTDocs confirm document/spreadsheet/PDF upload and analysis (draft/refine documents, presentations, spreadsheets, PDFs; 'analyze files'; 'read files, analyze data, and summarize findings'), which directly matches the story. However, evidence is entirely first-party documentation with no independent hands-on validation of accuracy specifically for uploaded file analysis (community evidence covers unrelated web-search accuracy issues, not file analysis). Missing for 10: independent/hands-on verification of analysis accuracy on real uploaded documents/spreadsheets/PDFs, and detail on limits (file size, complex spreadsheet formulas, OCR quality).
- [claimed-docs] “Draft and refine documents, presentations, spreadsheets, and PDF files.”
- [claimed-docs] “Draft and refine documents, presentations, spreadsheets, and PDF files. Review the result, ask for specific changes, and download the comple…”
- [claimed-docs] “Draft and refine [documents, presentations, spreadsheets, and PDF files]. Review the result, ask for specific changes, and download the comp…”
- [claimed-docs] “Create a deck, analyze files, draft a report, build a project plan”
- [claimed-docs] “Search the web, browse websites, compare sources, read files, analyze data, and summarize findings.”
Docs show Grok can ingest images and connect to Google Drive/Gmail to search and read files, and boasts a 500k context window for knowledge work, implying some document handling, but there is no explicit documentation of native PDF or spreadsheet upload/parsing in the core chat UI, nor any accuracy benchmarks or hands-on validation of document analysis. Missing for 10: explicit PDF/spreadsheet upload feature docs, accuracy testing/validation, independent user reports confirming reliable document analysis.
- [claimed-docs] “Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context wi…”
- [claimed-docs] “Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
- [claimed-docs] “Some models allow images in the input. The model will consider the image context when generating the response.”
- [claimed-docs] “The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
Memory context — stories about memory context in this arenaMemory context
Stories about memory context in this arena
Memory
power-userHave the assistant remember relevant context from previous chats and apply it in new conversations
weight 3 · round to ChatGPTChatGPT's Memories feature explicitly carries useful context from earlier chats into future conversations, with dedicated docs on memory controls (personalize.md, customization/memories.md) and even CLI-level controls (/memories) for whether a chat can use or contribute to memories. Missing for 10: independent/hands-on community corroboration of cross-chat memory recall working reliably, and detail on limits/scope of what memories retain.
- [claimed-docs] “Memories let ChatGPT and Codex carry useful context from earlier work into future work.”
- [claimed-docs] “Memories let ChatGPT carry useful context from earlier chats into future work.”
- [claimed-docs] “In Codex CLI, use /memories in an interactive session to control whether the current chat can use existing local memories or become an input…”
- [claimed-docs] “use `/memories` to choose whether a chat can use local memories or contribute to future memories”
Groknone0/10The evidence pack shows conversation storage (grok-docs-21) and cross-device sync of conversations/settings (grok-docs-41), but nothing describing a memory feature that recalls relevant context from past chats and applies it to new, unrelated conversations. No docs or community reports confirm persistent cross-chat memory recall.
power-userSet persistent custom instructions and preferences that shape every response
weight 1 · round to ChatGPTChatGPT supports persistent custom instructions/personalization and Memories that carry context across chats, plus Codex's global AGENTS.md for persistent personal instructions in coding workflows, and fine-grained control via /memories. Missing for 10: independent hands-on verification that custom instructions reliably shape *every* response over long-term use, and no detail on limits/scope conflicts between memories and per-chat overrides.
- [claimed-docs] “Memories let ChatGPT and Codex carry useful context from earlier work into future work.”
- [claimed-docs] “Memories let ChatGPT carry useful context from earlier chats into future work.”
- [claimed-docs] “In Codex, these personal instructions are stored in your global `AGENTS.md` file.”
- [claimed-docs] “use `/memories` to choose whether a chat can use local memories or contribute to future memories”
- [claimed-docs] “In Codex CLI, use /memories in an interactive session to control whether the current chat can use existing local memories or become an input…”
Projects
knowledge-workerOrganize related chats and files into a project or space that shares context and instructions
weight 2 · round to ChatGPTChatGPT's Projects feature explicitly lets users organize related chats, share context/instructions, and even attach local folders/files for shared context, directly matching the story. Memories also reinforce carrying context across chats. Missing for 10: independent/hands-on corroboration of the Projects feature working as described, and detail on instruction-sharing UI beyond docs claims.
- [claimed-docs] “Use a project to organize related chats and give ChatGPT the context it needs.”
- [claimed-docs] “A local project gives chats access to one or more folders on your computer, such as a collection of source files or a codebase.”
- [claimed-docs] “Memories let ChatGPT and Codex carry useful context from earlier work into future work.”
- [claimed-docs] “Memories let ChatGPT carry useful context from earlier chats into future work.”
Groknone0/10The evidence describes team 'workspaces' for licensing, SSO, and sharing conversations among teammates, plus connectors for external tools, but there is no mention of a project/space construct that groups related chats and files together with shared custom instructions or context, unlike dedicated 'Projects' features in other chat products.
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
- [claimed-docs] “Share conversations only with team members who have active licenses.”
- [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
Multimodal — stories about multimodal in this arenaMultimodal
Stories about multimodal in this arena
Images
knowledge-workerGenerate and edit images from natural-language prompts
weight 2 · round drawnChatGPT's docs explicitly cover image generation and editing from natural-language prompts, including editing via Comment/annotations, reference images, and Canvas view for reviewing multiple images, plus mobile app support for generating/transforming images and creating stickers. This directly matches the knowledge-worker story of generating and editing images conversationally. Missing for 10: no independent/hands-on community corroboration specifically for image generation quality or reliability.
- [claimed-docs] “Ask ChatGPT to generate or edit images.”
- [claimed-docs] “use Comment to add precise feedback to one or more images”
- [claimed-docs] “Generate or edit images, make interactive visualizations, and build or share websites and apps with Sites.”
- [claimed-docs] “Ask ChatGPT to generate or edit images. Use image generation for UI assets, banners, backgrounds, illustrations”
- [claimed-docs] “Switch between Focused view to inspect one image and Canvas view to see the images generated in the same chat.”
- [claimed-docs] “In Canvas view, use Comment to add precise feedback to one or more images.”
- [claimed-docs] “Add a reference image when you want ChatGPT to transform an existing asset or use it as visual guidance.”
- [claimed-docs] “Image generation–Generate original images from a description, or transform existing ones with a few simple words.”
- [claimed-docs] “Choose an image and style, remix with emojis, and make personalized stickers that are ready to share in your group chat.”
Grok Imagine and the API both explicitly support text-to-image generation and image editing (including multi-image edits up to 5 sources, aspect ratio control) with docs describing prompt-driven creation and editing directly relevant to knowledge-worker use. Missing for 10: independent hands-on community corroboration specifically of image generation/editing quality (community evidence pack focuses on coding/text/voice, not images).
- [claimed-docs] “Create images and video with Grok Imagine.”
- [claimed-docs] “Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ra…”
- [claimed-docs] “Edit an existing image by providing a source image along with your prompt. The model understands the image content and applies your requeste…”
- [claimed-docs] “Use up to five source images for a single image edit.”
- [claimed-docs] “Image editing now accepts up to 5 source images per request (was 3).”
- [claimed-docs] “New aspect ratios. Image generation and editing accept 21:9 (cinematic widescreen) and 5:2 (wide banners).”
- [claimed-docs] “Requests to the slug will be served by grok-imagine-image-2.0 with quality set to low, with no change to the request or response shape”
knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them
weight 2 · round drawnFirst-party docs confirm ChatGPT accepts photo/screenshot uploads and interprets their content (e.g., transcribing a handwritten recipe or identifying a landmark from a photo), which directly matches the knowledge-worker use case of sharing images for analysis. Missing for 10: independent/hands-on evidence corroborating accuracy of image interpretation, and explicit documentation of screenshot-specific analysis (e.g., UI screenshots) rather than just general photo uploads.
- [claimed-docs] “Photo upload—Snap or upload a picture to transcribe a handwritten recipe or get info about a landmark.”
- [claimed-docs] “Snap or upload a picture to transcribe a handwritten recipe or get info about a landmark.”
- [claimed-docs] “Image generation–Generate original images from a description, or transform existing ones with a few simple words.”
Docs confirm image understanding is a first-class capability: models accept image input and 'consider the image context when generating the response' (grok-docs-25), plus related image editing docs show the model 'understands the image content' (grok-docs-29). No independent hands-on report specifically tests screenshot/photo interpretation accuracy. missing for 10: independent/community corroboration of accuracy on real screenshots or photos, detail on multi-image or OCR-style interpretation limits.
- [claimed-docs] “Some models allow images in the input. The model will consider the image context when generating the response.”
- [claimed-docs] “Edit an existing image by providing a source image along with your prompt. The model understands the image content and applies your requeste…”
- [claimed-docs] “Use up to five source images for a single image edit.”
Voice
knowledge-workerHave a natural, real-time voice conversation with the assistant
weight 2 · round to ChatGPTChatGPT ships Advanced Voice Mode for real-time spoken conversation on mobile ('Tap the soundwave icon to have a real-time convo on the go') and ChatGPT Voice on desktop that lets users talk through ideas, start work, check progress, or change direction without switching to typing. This directly matches the knowledge-worker story of natural, real-time voice conversation. Missing for 10: independent hands-on corroboration of voice quality/latency and any community verification beyond vendor docs.
- [claimed-docs] “Advanced Voice Mode–Tap the soundwave icon to have a real-time convo on the go.”
- [claimed-docs] “Advanced Voice Mode–Tap the soundwave icon to have a real-time convo on the go. Settle a dinner table debate, or practice a new language.”
- [claimed-docs] “ChatGPT Voice lets you talk through ideas and coordinate tasks in Chat, Work, and Codex in the ChatGPT desktop app. Start work, check progre…”
- [claimed-docs] “Start work, check progress, or change direction without switching back to typing.”
- [claimed-docs] “ChatGPT Voice lets you talk through ideas and coordinate tasks in Chat, Work, and Codex in the ChatGPT desktop app.”
- [claimed-docs] “ChatGPT Voice can start separate tasks for longer work, check existing tasks, and send follow-up instructions.”
xAI documents hands-free voice conversations directly in Grok ('Talk to Grok hands-free with voice') and separately documents real-time streaming speech-to-text with VAD tuning, indicating a live voice-conversation feature exists. However, missing for 10: independent/hands-on corroboration of voice conversation naturalness or latency, and no detail on turn-taking/interruption handling beyond the VAD parameter.
- [claimed-docs] “Talk to Grok hands-free with voice.”
- [claimed-docs] “Speech to Text now accepts a vad_threshold parameter (streaming query param and batch multipart field) to tune the voice-activity gate”
- [community] “I am excited for the voice mode promised in 'a week' or so. ChatGPT Advanced Voice has been a big disappointment for me... If Grok 3 voice m…”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userDo everything through the API that I can do in the UI
weight 2 · round to GrokThere is evidence of programmatic access via the Codex CLI/SDK for coding automation and CI jobs, and a security-scan CLI, but nothing shows that the broad set of UI-only capabilities (Canvas/image editing, Computer Use, Voice, Work desktop automations, Sites, MCP-in-chat, memories, scheduled tasks) are exposed through a general ChatGPT API with parity to the UI. A probe for an OpenAPI/swagger spec on the docs site also returned 404s, reinforcing the lack of a documented full API surface. missing for 10: documented API endpoints mirroring Canvas/image tools, Computer Use, Voice, Work automations, Sites, and MCP-in-chat; independent confirmation of API-UI feature parity.
- [claimed-docs] “Use the Codex SDK to automate coding tasks, including jobs in CI.”
- [claimed-docs] “Inspect code, make changes, run commands, and automate repeatable work without leaving your terminal.”
- [claimed-docs] “Use its command-line interface (CLI) to scan repositories you own or have permission to assess, review findings over time”
- [probe] “PROBE openapi: all candidate paths 404 (https://learn.chatgpt.com/openapi.json, https://learn.chatgpt.com/swagger.json, https://learn.chatgp…”
The xAI API exposes core Grok model capabilities (text, images, video, tools, structured outputs, multi-agent research, connectors) documented alongside an OpenAPI spec, so much of the UI functionality is API-accessible. However, UI-only features like Grok Bot persistent cloud computer, team workspace/SSO/billing management, and built-in OAuth connectors (Gmail, Calendar, Teams, Salesforce) appear tied to the consumer/business app rather than exposed as general API endpoints, and there's no evidence of full parity. Missing for 10: confirmation that workspace/team management, SSO, billing, and native connector orchestration are API-accessible rather than UI-exclusive, plus independent corroboration of full feature parity.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
- [claimed-docs] “Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
- [claimed-docs] “Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”
- [probe] “PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
ai-native userExport all of my data in open formats and leave
weight 3 · round drawnChatGPTnone0/10No evidence in the pack of a data export feature producing open/portable formats, nor any mention of account data export or deletion workflow. Evidence only covers general product features (Codex, Work, MCP, image gen, etc.) with nothing about exporting personal chat/data history or leaving the platform with your data intact.
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userChoose where my data is stored (region/residency)
weight 2 · round drawnChatGPTnone0/10No evidence in the pack addresses data residency or regional storage choice for ChatGPT; the evidence only touches general data controls (e.g., Computer Use screenshots) without any region-selection capability.
Groknone0/10No evidence in the pack mentions data residency, region selection, or storage location choices for Grok; docs only confirm data is stored on xAI's servers without any residency options (grok-docs-21). Missing for 10: any mention of regional data storage options, residency controls, or compliance certifications tied to geography.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
ai-native userPrevent my data from being used to train AI models
weight 3 · round drawnChatGPTnone0/10The evidence pack contains no documentation or mention of data-training opt-out controls, privacy settings, or 'improve the model for everyone' toggles; only tangential data-controls mention (chatgpt-docs-89) refers to Computer Use screenshots, not training opt-out generally. Missing for 10: any reference to training-data opt-out settings, business/API data-usage policies, or privacy dashboard controls.
- [claimed-docs] “Your ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use.”
Groknone0/10The evidence pack documents data retention (prompts and responses stored on xAI's servers, grok-docs-21) and vague 'enterprise-grade privacy protections' for team workspaces (grok-docs-13), but nowhere mentions an opt-out toggle, training-data exclusion setting, or policy statement about excluding user conversations from model training. This axis clearly applies to a consumer/enterprise AI chat product, so absence of evidence yields 'none' rather than 'na'.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
- [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
ai-native userControl data retention and deletion
weight 2 · round to ChatGPTThe only relevant evidence is a passing reference that 'ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use,' implying some data-control/retention settings exist, but no documentation details how to view, export, or delete data, set retention periods, or manage memory deletion. Missing for 10: explicit data retention/export/delete documentation, memory deletion controls, and independent confirmation that these controls work as described.
- [claimed-docs] “Your ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use.”
Groknone0/10Docs confirm that inputs, reasoning, and responses are stored on xAI's servers (grok-docs-21) and mention vague 'enterprise-grade privacy protections' for team workspaces (grok-docs-13), but there is no documented mechanism for users to view, control, or delete their stored data/conversation history. Missing for 10: explicit data retention settings, a user-facing deletion/export tool, and any policy detailing retention periods or opt-out controls.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
ai-native userOpt out of telemetry and usage tracking
weight 2 · round drawnChatGPTnone0/10None of the evidence addresses telemetry/usage-tracking opt-out controls for ChatGPT; the docs cover data controls tangentially (e.g., data usage for Computer Use screenshots) but nothing about disabling telemetry or usage analytics.
Groknone0/10The evidence pack confirms xAI stores prompts, reasoning, and responses on its servers (grok-docs-21) but contains no documentation of any telemetry/usage-tracking opt-out setting, privacy toggle, or data-collection preference control for individual or ai-native users.
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
Research answers — stories about research answers in this arenaResearch answers
Stories about research answers in this arena
Research
knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report
weight 3 · round drawnDocs show ChatGPT can search the web, browse multiple sources, compare them, and produce cited results in-chat (docs-86, docs-90), and can turn research into finished documents/reports (docs-66, docs-68, docs-60). However, there is no explicit mention of a dedicated 'Deep Research' autonomous multi-source research mode/run with a structured long-form cited report as its own distinct feature — the evidence only shows general web-search-with-citations and document drafting capabilities. missing for 10: an explicitly named deep-research mode, evidence of autonomous long-running multi-source research runs, and a structured final cited-report output format.
- [claimed-docs] “Search results and citations appear in the chat when ChatGPT uses web search.”
- [claimed-docs] “Search the web, browse websites, compare sources, read files, analyze data, and summarize findings.”
- [claimed-docs] “Create a deck, analyze files, draft a report, build a project plan”
- [claimed-docs] “Turn research and analysis into documents, presentations, spreadsheets, and other finished work.”
- [claimed-docs] “Draft and refine [documents, presentations, spreadsheets, and PDF files]. Review the result, ask for specific changes, and download the comp…”
- [claimed-docs] “In the CLI, pass `--search` to fetch live results for one run”
Grok's docs describe a dedicated 'Realtime Multi-agent Research' capability that orchestrates multiple AI agents to perform deep, multi-step research tasks, matching the core of the story [grok-docs-26]. However, the docs don't explicitly describe the output format (a cited report with sources) and there is no independent/hands-on corroboration of this specific feature in the evidence pack. Missing for 10: explicit documentation of citation/report formatting in the research output, and independent user validation that the feature works as described.
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
knowledge-workerGet answers grounded in current web results with citations back to the sources
weight 2 · round to ChatGPTChatGPT's web search docs explicitly state that search results and citations appear in chat when web search is used, and describe searching, browsing, comparing sources, and summarizing findings — directly matching the story. Community feedback shows mixed satisfaction with search accuracy (e.g., comparisons to Perplexity, a weather inaccuracy) but doesn't concretely show citations failing to appear, so this doesn't rise to a dispute. Missing for 10: independent verification of citation accuracy/consistency across many queries and no first-party detail on citation formatting/source diversity.
- [claimed-docs] “Search results and citations appear in the chat when ChatGPT uses web search.”
- [claimed-docs] “Search the web, browse websites, compare sources, read files, analyze data, and summarize findings.”
- [claimed-docs] “In the CLI, pass `--search` to fetch live results for one run”
- [community] “AKA Bing Search in ChatGPT. So it is not it's own search engine and is still using Bing for its results just like the rest of them.”
- [community] “I gave it a quick spin and my initial impression is much worse than perplexity.”
- [community] “I asked it the current weather in my area and the temperature was off by 23 degrees F.”
Evidence shows Grok has a 'Realtime Multi-agent Research' capability for deep, multi-step research tasks and community notes suggest it can discuss current events from live X/web data, implying some grounding, but nothing in the pack explicitly documents inline citations or source links back to web results in Grok's answers. missing for 10: explicit documentation of citation formatting/source links, first-party description of real-time web search grounding, and independent verification that citations are reliably attached to responses.
- [claimed-docs] “Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step res…”
- [community] “I am excited for the voice mode promised in 'a week' or so. ChatGPT Advanced Voice has been a big disappointment for me... If Grok 3 voice m…”
Trust controls — stories about trust controls in this arenaTrust controls
Stories about trust controls in this arena
Admin
team-adminManage members, permissions, and data policies for my organization's workspace
weight 2 · round to GrokOnly a single explicit doc line notes that a workspace administrator can control access to ChatGPT Work, plugins, browser use, and network access, plus general mentions of GPT builders using 'approved workspace apps' and data controls applying to processed content. There is no evidence of a full admin console covering member invitation/removal, granular role-based permissions, or explicit data retention/training-opt-out policy controls. missing for 10: admin console/member management UI, granular role/permission settings, explicit data-retention and training-opt-out policy controls, independent corroboration of these admin features.
- [claimed-docs] “Your workspace administrator can control access to ChatGPT Work, plugins, browser use, and network access.”
- [claimed-docs] “Allow GPT builders to use approved workspace apps or configure actions that interact with permitted third-party APIs.”
- [claimed-docs] “configure actions that interact with permitted third-party APIs”
- [claimed-docs] “Your ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use.”
Docs show a business/team workspace admin story: inviting members via email (grok-docs-18), SSO integration with IdP (grok-docs-17), workspace switching with business-plan-protected conversations (grok-docs-39), license-gated sharing (grok-docs-14), and 'enterprise-grade privacy protections' (grok-docs-13). This covers member invitation, authentication/SSO, and some data-policy framing for admins. Missing for 10: detailed role/permission granularity (e.g., admin vs member roles, per-connector access control), explicit data retention/DLP policy configuration UI, and any independent/community corroboration of the admin console working as documented.
- [claimed-docs] “Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
- [claimed-docs] “Invite new team members to join your Grok Business workspace with a simple email invitation process.”
- [claimed-docs] “Switch between workspaces to access team-specific features and ensure your conversations are protected under business plan terms.”
- [claimed-docs] “Share conversations only with team members who have active licenses.”
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
Data controls
knowledge-workerExport my complete chat history and account data
weight 1 · round drawnChatGPTnone0/10The evidence pack contains no mention of data export, account data download, or chat history export features anywhere in the docs, community, or probe results; there is only a passing reference to 'data controls' applying to Computer Use content, which does not address exporting complete chat history or account data. Missing for 10: any documentation of an export data feature, its scope (chats, files, settings), format, or process, and any independent corroboration it works.
- [claimed-docs] “Your ChatGPT data controls apply to content processed through ChatGPT, including screenshots taken by Computer Use.”
Groknone0/10No evidence in the pack mentions a data export or account-data download feature for Grok; docs cover connectors, models, billing, SSO, and workspace features but never a 'export my chat history/data' capability. This is a fair trust-controls axis for a consumer chat product, so absence of evidence yields 'none' rather than 'na'.
knowledge-workerControl whether my conversations are used to train models
weight 3 · round drawnChatGPTnone0/10The evidence pack covers ChatGPT's agentic/feature capabilities (Codex, Work, MCP, Computer Use, etc.) but contains no documentation or mention of data controls, training opt-out settings, or 'Improve the model for everyone' toggles that let a user control whether their conversations are used for model training.
Groknone0/10Docs mention 'enterprise-grade privacy protections' for team workspaces and that prompts are stored on xAI servers, but there is no documented setting or toggle letting a knowledge-worker control whether their conversations are used to train models. Community commentary raises general distrust but does not confirm or deny a specific training opt-out control.
- [claimed-docs] “In your team workspace, enjoy enterprise-grade privacy protections... Additionally, unlock the full capabilities of SuperGrok, including hig…”
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [community] “Musk already has too much power, won't trust him with my AI conversations.”
Not comparable on these axes
ai-native userConnect an agent via an official MCP server
weight 3 · not comparableChatGPT/Codex has official first-party documentation for MCP support: users can add official MCP servers (e.g., Context7 for docs, Figma, browser tools) to extend the agent, configuration is stored in config.toml, servers can be scoped per-project, and setup carries across clients without redoing it. This directly evidences 'connecting an agent via an official MCP server.' Missing for 10: independent/hands-on community corroboration of MCP server usage and broader detail on the range of officially supported/verified servers beyond the Context7 example.
- [claimed-docs] “let it interact with developer tools like your browser or Figma”
- [claimed-docs] “Once you configure your MCP servers, you can switch among those clients without redoing setup.”
- [claimed-docs] “Use it to give ChatGPT or Codex access to third-party documentation, or to let it interact with developer tools like your browser or Figma.”
- [claimed-docs] “to add Context7 (a free MCP server for developer documentation)”
- [claimed-docs] “you can also scope MCP servers to a project with `.codex/config.toml` (trusted projects only)”
- [claimed-docs] “Codex stores MCP configuration in `config.toml`”
Grokn/aGrok is itself an agent/assistant (chat + Grok Build coding agent), and the MCP-related evidence (grok-docs-2,3,19,38) describes Grok acting as an MCP *client* connecting outbound to a user's custom MCP server — not Grok exposing itself as an MCP server for other agents to connect to. Per the rules, client-side MCP connectivity does not make this server-role axis applicable, and there is no evidence of a first-party 'Grok as MCP server' endpoint.
- [claimed-docs] “Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
- [claimed-docs] “A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
- [claimed-docs] “Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok c…”
- [claimed-docs] “When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
ai-native userRead the product's source under an open license
weight 2 · not comparableChatGPTn/aChatGPT is a closed-source, proprietary SaaS product; open-sourcing its source code is not a plausible axis for this kind of product (unlike an open-source framework or tool), so this is a category mismatch rather than a missing capability.
Groknone0/10The evidence pack contains only proprietary API/product documentation and community commentary; there is no mention of any open-source license, public source repository, or open-weights release for Grok. As a mainstream capability question applicable to AI products, absence of evidence yields 'none' rather than 'na'.
ai-native userSelf-host the core product
weight 3 · not comparableChatGPTn/aChatGPT is a closed, hosted proprietary product with no evidence of a self-hostable core model or server; self-hosting is not a fair axis for this SaaS product category (it does not ship open weights or an installable core).
Groknone0/10Grok is a closed, proprietary API/cloud service; no evidence anywhere in the pack of open-sourced weights or a self-hostable core model/product, only hosted APIs, connectors, and SaaS features. Absence of any self-hosting capability for an applicable axis (models can in principle be released for self-hosting, as some competitors do) yields none rather than na.
- [claimed-docs] “Generate text, have conversations, use tools, and build AI-powered applications.”
- [claimed-docs] “previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
- [claimed-docs] “Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”