How Microsoft Copilot’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score3/100

Agent-ready 0.0 × 0.30 = 0.00

API quality 0.0 × 0.20 = 0.00

Openness 0.0 × 0.20 = 0.00

Built-in AI 17.7 × 0.15 = 2.65

Automation 4.5 × 0.15 = 0.67

(0.00 + 0.00 + 0.00 + 2.65 + 0.67) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 3.33 ÷ 1.00 = 3.3

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready0.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Connectors allow you to link Copilot to other services so you can easily find, summarize, and act on information from these services.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) * Google Drive * Google Gmail, Calendar, Contacts”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Drive the product through a documented public APIweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Agent-ready = 0.0 ÷ 160 × 100 = 0.0

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

n/a — not applicable to this product: excluded from numerator and denominator

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”
[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”

Test against a sandbox environment without touching production dataweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

API quality = 0.0 ÷ 40 × 100 = 0.0

Openness0.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://support.microsoft.com/llms.txt“PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
[probe] https://support.microsoft.com/en-us/copilot.md“PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
[probe] https://support.microsoft.com/openapi.json“PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://support.microsoft.com/api/openapi.json, https://support.microsoft.com/.well-known/openapi.json)”

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Openness = 0.0 ÷ 100 × 100 = 0.0

Built-in AI17.7/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 0.3 (disputed) = 3.6 of 20 max

[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Turn raw data into clear insights with Copilot in Excel.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Get ahead of what’s important with clear summaries from Copilot in Outlook that help keep you organized and ready for next steps.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Connectors allow you to link Copilot to other services so you can easily find, summarize, and act on information from these services.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) * Google Drive * Google Gmail, Calendar, Contacts”
[claimed-docs] https://support.microsoft.com/en-us/topic/transparency-note-for-microsoft-copilot-c1541cad-8bb4-410a-954c-07225892dbc2“Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
[community] https://news.ycombinator.com/item?id=42831281“I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It couldn't search and replace! It couldn't maintain formatting. What a failure!”
[community] https://news.ycombinator.com/item?id=42831281“In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
[community] https://news.ycombinator.com/item?id=35182827“the way it can fetch data from across documents in 365 is really good”
[community] https://news.ycombinator.com/item?id=46496465“I use AI everyday and never found a use case for Copilot.”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

[claimed-docs] https://support.microsoft.com/en-us/privacy/microsoft-copilot/overview“With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
[claimed-docs] https://support.microsoft.com/en-us/topic/transparency-note-for-microsoft-copilot-c1541cad-8bb4-410a-954c-07225892dbc2“Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/browse-with-copilot“Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or deleting a calendar event.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/copilot-101/what-is-copilot“A copilot can automate repetitive tasks, no coding required.”
[community] https://news.ycombinator.com/item?id=42831281“I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It couldn't search and replace! It couldn't maintain formatting. What a failure!”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 5 (quality) × 0.3 (disputed) = 4.5 of 30 max

[claimed-docs] https://support.microsoft.com/en-us/privacy/microsoft-copilot/overview“With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/copilot-101/what-is-copilot“A copilot can automate repetitive tasks, no coding required.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Find, synthesize, and understand information faster with Researcher.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
[community] https://news.ycombinator.com/item?id=42831281“I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It couldn't search and replace! It couldn't maintain formatting. What a failure!”
[community] https://news.ycombinator.com/item?id=42831281“In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
[community] https://news.ycombinator.com/item?id=35182827“the way it can fetch data from across documents in 365 is really good”

Operate the product with natural-language commandsweight 2

2 (weight) × 5 (quality) × 0.3 (disputed) = 3.0 of 20 max

[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/for-individuals“Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Find my budget spreadsheet” or “Show me the project plan from last month.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Find Word documents about vacation plans” or “Show me all PDFs.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
[community] https://news.ycombinator.com/item?id=42831281“I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It couldn't search and replace! It couldn't maintain formatting. What a failure!”
[community] https://news.ycombinator.com/item?id=42831281“In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
[community] https://news.ycombinator.com/item?id=46496465“I use AI everyday and never found a use case for Copilot.”

Built-in AI = 15.9 ÷ 90 × 100 = 17.7

Automation4.5/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

[claimed-docs] https://support.microsoft.com/en-us/privacy/microsoft-copilot/overview“With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
[claimed-docs] https://www.microsoft.com/en-us/microsoft-copilot/copilot-101/what-is-copilot“A copilot can automate repetitive tasks, no coding required.”
[claimed-docs] https://support.microsoft.com/en-us/microsoft-copilot/connecting-microsoft-copilot-to-other-services“Connectors allow you to link Copilot to other services so you can easily find, summarize, and act on information from these services.”
[community] https://news.ycombinator.com/item?id=42831281“I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It couldn't search and replace! It couldn't maintain formatting. What a failure!”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 3.6 ÷ 80 × 100 = 4.5