Skip to content
ProductArena

How Grok’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score26/100

Agent-ready 44.7 × 0.30 = 13.41

API quality 32.6 × 0.20 = 6.52

Openness 6.0 × 0.20 = 1.20

Built-in AI 27.3 × 0.15 = 4.09

Automation 6.0 × 0.15 = 0.90

(13.41 + 6.52 + 1.20 + 4.09 + 0.90) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 26.12 ÷ 1.00 = 26.1

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready44.7/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.x.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at https://docs.x.ai — Grok models, REST”
  • [claimed-docs] https://docs.x.ai/developers/release-notes.md“Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context window”
  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”
  • [claimed-docs] https://docs.x.ai/developers/quickstart.md“Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/streaming.md“Streaming outputs is **supported by all models with text output capability**”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/structured-outputs.md“Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
  • [community] https://news.ycombinator.com/item?id=48835111“still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/custom-mcp-tunneling.md“A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/custom-mcp-tunneling.md“When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/custom-mcp-tunneling.md“A tunneling service solves this by exposing your local server through a public URL that Grok can connect to.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/custom-mcp-tunneling.md“When you add a custom MCP connector, Grok's servers need to reach your MCP server over the public internet.”

Use an official CLIweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [community] https://news.ycombinator.com/item?id=48835111“still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”
  • [claimed-docs] https://docs.x.ai/developers/quickstart.md“Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”

Drive the product through a documented public APIweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”
  • [claimed-docs] https://docs.x.ai/developers/quickstart.md“Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/structured-outputs.md“Structured Outputs lets the API return responses in a specific format, for example, a JSON object matching a schema you define”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/streaming.md“Streaming outputs is **supported by all models with text output capability**”
  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
  • [probe] https://docs.x.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at https://docs.x.ai — Grok models, REST”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”

Build against official SDKsweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”
  • [claimed-docs] https://docs.x.ai/developers/quickstart.md“Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
  • [probe] https://docs.x.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at https://docs.x.ai — Grok models, REST”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 80.4 ÷ 180 × 100 = 44.7

API quality32.6/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [probe] https://docs.x.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at https://docs.x.ai — Grok models, REST”
  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
  • [claimed-docs] https://docs.x.ai/developers/quickstart.md“Send a coding prompt to Grok Build (`grok-4.6`) and get a response.”
  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”
  • [probe] https://docs.x.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.x.ai/llms.txt # SpaceXAI API Documentation > Official SpaceXAI (xAI) developer documentation at https://docs.x.ai — Grok models, REST”
  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.x.ai/developers/release-notes.md“Grok 4.6, SpaceXAI's frontier model for coding, agentic tasks, and knowledge work, is now available on the xAI API. It has a 500k context window”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/reasoning.md“grok-4.6` and `grok-4.5` support the `reasoning_effort` parameter, which controls how much effort the model spends thinking before responding.”
  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”

API quality = 22.8 ÷ 70 × 100 = 32.6

Openness6.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [claimed-docs] https://docs.x.ai/grok/overview.md“Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
  • [claimed-docs] https://docs.x.ai/grok/organization.md“Secure and streamline logins by integrating Single Sign-On (SSO) with your preferred Identity Provider (IdP).”
  • [claimed-docs] https://docs.x.ai/grok/faq.md“Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”
  • [probe] https://docs.x.ai/openapi.json“PROBE openapi: HTTP 200 at https://docs.x.ai/openapi.json — contains "openapi" key”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.x.ai/overview.md“Generate text, have conversations, use tools, and build AI-powered applications.”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/generate-text.md“previous input prompts, reasoning content, and model responses are saved and stored on xAI's servers”
  • [claimed-docs] https://docs.x.ai/grok/faq.md“Visit grok.com/?_s=billing while logged in to manage your billing directly from the website (change plan, update payment, or cancel).”

Openness = 6.0 ÷ 100 × 100 = 6.0

Built-in AI27.3/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.x.ai/grok/overview.md“Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/gmail-google-calendar.md“Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
  • [claimed-docs] https://docs.x.ai/grok/connectors/google-drive.md“The Google Drive connector lets Grok search, read, and manage files in your Google Drive.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/microsoft-teams.md“Search across channels and chats, read messages, send new messages, reply to threads, and create chats — all without leaving Grok.”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/multi-agent.md“Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step research tasks.”
  • [community] https://news.ycombinator.com/item?id=48835111“I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model felt like it hadn't been trained to think of tool calling as one of its primary modalities.”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.x.ai/grok/overview.md“Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/multi-agent.md“Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step research tasks.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 6 (quality) × 0.3 (disputed) = 5.4 of 30 max

  • [claimed-docs] https://docs.x.ai/grok/overview.md“Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/text/multi-agent.md“Realtime Multi-agent Research enables Grok to orchestrate multiple AI agents that work together in real time to perform deep, multi-step research tasks.”
  • [claimed-docs] https://docs.x.ai/grok/overview.md“Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/salesforce.md“Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [community] https://news.ycombinator.com/item?id=48835111“I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model felt like it hadn't been trained to think of tool calling as one of its primary modalities.”
  • [community] https://news.ycombinator.com/item?id=48835111“still waiting for a proper gui for grok build - terminal is nice but codex desktop app is very useful”

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.x.ai/grok/overview.md“Connect your tools so Grok can reach your email, files, and calendar right inside a chat.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/salesforce.md“Create new records - Add Leads, Opportunities, Accounts, Cases, or records on custom objects directly from chat.”
  • [claimed-docs] https://docs.x.ai/grok/connectors/gmail-google-calendar.md“Search emails using Gmail search operators (`from:`, `to:`, `subject:`, `newer_than:`, `has:attachment`, etc.).”
  • [claimed-docs] https://docs.x.ai/grok/overview.md“Talk to Grok hands-free with voice.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [community] https://news.ycombinator.com/item?id=48835111“I experimented with Grok 4 for openclaw... It was more verbally fluid than 5.5, but had real trouble with agentic tool calling - the model felt like it hadn't been trained to think of tool calling as one of its primary modalities.”

Built-in AI = 24.6 ÷ 90 × 100 = 27.3

Automation6.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/images/generation.md“Generate images from text prompts with Grok Imagine models. The API supports batch generation of multiple images, and control over aspect ratio, resolution, and quality.”
  • [claimed-docs] https://docs.x.ai/developers/release-notes.md“Image editing now accepts up to 5 source images per request (was 3).”
  • [claimed-docs] https://docs.x.ai/developers/model-capabilities/images/multi-image-editing.md“Use up to five source images for a single image edit.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.x.ai/grok/overview.md“Grok Bot — hand real work to AI teammates on a persistent cloud computer.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Built-in connectors are maintained by xAI and integrate natively with Grok. Each one authenticates via OAuth, so you connect once and Grok can access your data on demand.”
  • [claimed-docs] https://docs.x.ai/grok/connectors.md“Expose any internal API, database, or SaaS tool to Grok. Define your own tools with custom schemas and logic.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 4.8 ÷ 80 × 100 = 6.0