Microsoft Copilot vs Martin

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to Martin
   Microsoft Copilot—none0/10

   Probes show no llms.txt, no markdown docs endpoint, and no OpenAPI spec for Microsoft Copilot's support site, and no evidence anywhere in the pack of agent-oriented documentation formats being offered. This axis applies (any product could publish llms.txt or agent-friendly docs) but there is no evidence Copilot does so.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”

   proof ↗⚑ flag

   Martin✓fullprobed9/10

   martin-probe-1 confirms a live llms.txt at docs.trymartin.com/llms.txt returning HTTP 200 with a structured index of docs, and the .md-suffixed doc URLs throughout the evidence pack (e.g. martin-docs-1 through martin-docs-24) show agent-oriented markdown documentation is directly accessible. Missing for 10: no independent/hands-on confirmation that an agent successfully consumed llms.txt to complete a task.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.trymartin.com/llms.txt # Martin ## Docs - [Introduction](https://docs.trymartin.com/introduction.…”
   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”

   proof ↗⚑ flag

2. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round drawn
   Microsoft Copilot—none0/10

   The evidence pack describes Copilot connecting to first-party consumer services (OneDrive, Outlook.com, Google Drive/Gmail) via 'Copilot connectors,' but there is no mention of MCP (Model Context Protocol) server support or an ability for users to plug in arbitrary MCP tool servers. This is an applicable axis for an AI assistant product, but no evidence shows the capability exists.

   • [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
   • [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
   • [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”

   proof ↗⚑ flag

   Martin—none0/10

   Martin's docs describe a fixed set of built-in integrations (calendar, email, Slack, todos, notes) but there is no mention of MCP protocol support or any way for users to plug in arbitrary MCP servers for Martin to use as tools.

   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
   • [claimed-docs] “Have Martin read and send messages in Slack from your account.”
   • [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
   • [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”

   proof ↗⚑ flag

3. ai-native userDrive the product through a documented public API

   weight 3 · round drawn
   Microsoft Copilot—none0/10

   No evidence of a documented public API for programmatically driving Microsoft Copilot; probes for OpenAPI/llms.txt specs all returned 404, and all docs describe end-user chat/UI interactions rather than API access. Missing for 10: any public API documentation, SDK, or endpoint spec that lets developers programmatically invoke Copilot's capabilities.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”

   proof ↗⚑ flag

   Martin—none0/10

   Martin is a personal-assistant product controlled via chat/email/Slack/phone interfaces, but there is no evidence of a documented public API for developers to programmatically drive it — probes for OpenAPI/Swagger specs all returned 404. missing for 10: a documented public API, SDK, or endpoint reference; any developer-facing API authentication or usage docs.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”

   proof ↗⚑ flag

4. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   No evidence describes issuing scoped or least-privilege API credentials for an agent; Copilot's documented connectors involve OAuth-style account sign-in to consumer services, not developer-controlled scoped credential issuance. missing for 10: any mention of API keys, scoped tokens, permission scoping, or credential management for agent access.

   ⚑ flag

   Martin—none0/10

   Martin is a personal assistant that connects to full-access integrations (email, calendar, Slack) but there is no evidence of scoped or least-privilege credential issuance, API key management, or granular permissioning for agent access — no OpenAPI/API docs even exist per probe results.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
   • [claimed-docs] “Once connected, you can tell Martin to read, draft, and reply to emails on your behalf.”
   • [claimed-docs] “Once connected, you can tell Martin to read, send, and reply to Slack messages on your behalf.”

   proof ↗⚑ flag

5. ai-native userBuild against official SDKs

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   The evidence pack covers Microsoft Copilot as a consumer AI assistant with features like connectors, browsing, and app integrations, but contains no mention of official SDKs, developer APIs, or programmatic build tooling for third-party developers; probes for API/OpenAPI specs returned 404s, further indicating no discoverable developer SDK surface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”

   proof ↗⚑ flag

   Martin—none0/10

   Martin's evidence pack covers only end-user integrations (calendar, email, Slack, etc.) and consumer interfaces, with no mention of an SDK, API, or developer library; probes for an OpenAPI/Swagger spec all returned 404s, indicating no public API/SDK surface exists to build against.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to Martin
   Microsoft Copilot!disputedcontradicted5/10

   Microsoft heavily documents AI-generated insights across Word, Excel, PowerPoint, Outlook, Researcher, and Analyst, and describes proactive suggestions and code-run analysis (copilot-docs-2, copilot-docs-6, copilot-docs-16, copilot-docs-33, copilot-docs-31). However, hands-on community reports concretely contradict these claims for core products: a user found Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables' (copilot-comm-4), and Outlook's summarization is described as 'so bad' with a tiny UI button (copilot-comm-5); others report never finding a use case (copilot-comm-9). One community report is positive about cross-document data fetching (copilot-comm-7), so evidence is genuinely mixed rather than uniformly negative. Missing for 10: independent benchmark of insight quality/accuracy, resolution of the Word/Outlook hands-on failures, and clearer distinction of chat vs. Office-integrated Copilot performance.

   • [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
   • [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
   • [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
   • [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
   • [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
   • [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
   • [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
   • [community] “the way it can fetch data from across documents in 365 is really good”
   • [community] “I use AI everyday and never found a use case for Copilot.”

   proof ↗⚑ flag

   Martin~partialclaimed6/10

   Martin generates daily/weekly briefings synthesized from your calendar and inbox data, proactively drafts emails, and triages/labels emails with follow-up suggestions—all forms of AI-generated insights/suggestions surfaced inside the product. However, these are framed as autonomous actions rather than an explicit 'insights' or analytics layer, and there's no dedicated dashboard-style insight generation from broader personal data. Missing for 10: no independent/hands-on evidence corroborating quality of the 'insight' content itself, and no explicit analytics/trend-surfacing feature distinct from task-execution suggestions.

   • [claimed-docs] “Martin can send you daily or weekly briefings via email.”
   • [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
   • [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Martin
   Microsoft Copilot~partialclaimed4/10

   Docs mention agentic-style capabilities (Cowork multi-step task completion, automating repetitive tasks, proactive research suggestions, browser action-taking) suggesting some autonomy, but Browse with Copilot explicitly requires user attention/supervision for many actions and no docs describe scheduled or fully background-running automations without a user session. Missing for 10: explicit scheduling/trigger mechanism, evidence of unattended background execution, and independent confirmation that these automations run without active supervision.

   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
   • [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
   • [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
   • [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
   • [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”

   proof ↗⚑ flag

   Martin✓fullcommunity8/10

   Martin's docs describe multiple always-on background automations—daily/weekly briefings, proactive email drafting, email triage, wake-up calls, cc-to-schedule meeting booking, and custom multi-step shortcuts—all of which run without direct user prompting, and community reports (e.g., using Martin as a persistent background agent for todos) corroborate real autonomous use. Missing for 10: independent verification of scheduling/configuration UI for these background jobs and long-term reliability data beyond one HN comment about failure rates improving.

   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
   • [claimed-docs] “Martin can send you daily or weekly briefings via email.”
   • [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
   • [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
   • [claimed-docs] “Cc Martin on an email to schedule a meeting.”
   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
   • [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Martin
   Microsoft Copilot~partialcommunity6/10

   Microsoft's own docs describe extensive delegation features—Copilot in Word/Excel/PowerPoint/Outlook, Researcher, Analyst, Browse with Copilot performing multi-step browser actions, and Cowork handling 'bigger, multi-step tasks'—clearly positioning Copilot as a built-in assistant that can take on tasks. However, hands-on community reports contradict smooth delegation in practice (e.g., Copilot in Word 'couldn't do anything except append to the end of the document,' couldn't create tables or maintain formatting, and some users report never finding a real use case), indicating real-world task execution is often shallow or unreliable. Missing for 10: independent verification of successful complex multi-step task completion, and resolution of documented editing/execution failures in flagship apps.

   • [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
   • [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
   • [claimed-docs] “Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.”
   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
   • [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
   • [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
   • [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
   • [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
   • [community] “I use AI everyday and never found a use case for Copilot.”

   proof ↗⚑ flag

   Martin✓fullcommunity8/10

   Martin IS the built-in AI assistant, and users delegate tasks to it across calendar, email, Slack, reminders, todos, notes, and multi-step shortcuts via chat, phone, SMS, email, or Slack, with hands-on community accounts confirming real task delegation and reliability improvements. missing for 10: independent quality/reliability benchmarking beyond anecdotal HN comments, and no evidence of failure-mode transparency or task-success metrics.

   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
   • [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
   • [community] “I’m impressed. I’ll probably cancel ChatGPT Pro subscription and switch to this... it’s handling some complicated requests correctly the fir…”
   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
   • [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Martin
   Microsoft Copilot!disputedcontradicted5/10

   Docs extensively describe natural-language operation—prompting Copilot in Word/Excel/PowerPoint, natural-language file/email/calendar search, and browser action commands (copilot-docs-1,2,3,8,14,20-22,26,27). However, hands-on community evidence directly contradicts this for at least one core surface: a user reports Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables! couldn't search and replace! couldn't maintain formatting' (copilot-comm-4), and others found the Outlook summarize feature and overall NL assistant underwhelming or unused (copilot-comm-5, copilot-comm-9). This is a concrete documented failure of the claimed NL command capability, not mere skepticism. Missing for 10: independent third-party benchmarking of NL command reliability across all Office apps, and resolution of the reported Word functional gaps.

   • [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
   • [claimed-docs] “Find my budget spreadsheet” or “Show me the project plan from last month.”
   • [claimed-docs] “Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
   • [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
   • [claimed-docs] “Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
   • [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
   • [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
   • [community] “I use AI everyday and never found a use case for Copilot.”

   proof ↗⚑ flag

   Martin✓fullcommunity8/10

   Martin is explicitly designed around natural-language commands across calendar, email, Slack, reminders, todos, notes, shortcuts, and phone/SMS interfaces, with docs and taglines like 'Text Jon my arrival time' or 'Cc Martin on an email to schedule a meeting' showing conversational control, and community feedback (HN) corroborates real usage of natural-language task delegation. missing for 10: independent hands-on benchmarking of NL command breadth/accuracy beyond anecdotal HN praise, and no formal API/spec confirming NLU robustness.

   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Tell Martin to remind you to do something, and he will ping you when the time comes.”
   • [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
   • [claimed-docs] “Cc Martin on an email to schedule a meeting.”
   • [claimed-docs] “Text Jon my arrival time.”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
   • [community] “I’m impressed. I’ll probably cancel ChatGPT Pro subscription and switch to this... it’s handling some complicated requests correctly the fir…”
   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”

   proof ↗⚑ flag

Api quality

1. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   No evidence of a machine-readable API spec; explicit probes for OpenAPI/swagger endpoints all returned 404, and no docs mention a public API or spec for Microsoft Copilot as an end-user product.

   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”

   proof ↗⚑ flag

   Martin—none0/10

   Martin is a personal assistant product, not a developer API platform, but the axis of publishing a machine-readable API spec still applies as a fair question; the probe explicitly checked all standard OpenAPI/swagger paths and found only 404s, with no evidence of any downloadable spec.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”

   proof ↗⚑ flag

2. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   Microsoft Copilot is presented here as a consumer-facing AI assistant product; there is no evidence of a public versioned API, developer API reference, or documented deprecation policy for it. Probes for API/OpenAPI specs and llms.txt all return 404, confirming absence of such developer-facing documentation.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”

   proof ↗⚑ flag

   Martin—none0/10

   Martin is a personal-assistant product with no evidence of any public API, versioning scheme, or deprecation policy; the openapi probe returned 404 on all candidate paths and no docs mention API versioning. missing for 10: any public API reference, version numbers, changelog, deprecation policy documentation.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”

   proof ↗⚑ flag

Agent mode

1. power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review

   weight 3 · round to Martin
   Microsoft Copilot~partialclaimed5/10

   Copilot's 'Cowork' feature is explicitly described as handling 'bigger, multi-step tasks and deliver completed to-dos,' and 'Browse with Copilot' can perform multi-step actions while pausing for user approval on sensitive steps, which aligns with delegate-and-review workflows. However, these are single thin doc mentions with no independent/hands-on validation of true background/asynchronous operation, and community feedback focuses on other Copilot surfaces (Word, Outlook) being underwhelming rather than confirming Cowork's autonomous task delivery. Missing for 10: hands-on or independent evidence of a background task actually running unattended and returning a completed result, clearer scope/limits of Cowork, and confirmation this isn't just synchronous chat-assisted editing.

   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
   • [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
   • [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
   • [claimed-docs] “You can see each step in real time and take control at any time.”
   • [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”

   proof ↗⚑ flag

   Martin~partialcommunity7/10

   Martin's docs describe multiple background/autonomous capabilities (proactive email drafts, email triage with follow-up actions, cc-to-schedule meeting booking, custom multi-step shortcuts, daily briefings) that match delegating a task for autonomous background work with results delivered back to the user, and community posts corroborate real usage of the cloud-based agent for ongoing tasks (todos) across sessions. However, evidence doesn't clearly show a distinct 'review before finalizing' step for these autonomous actions (e.g., whether drafts are held for approval vs. auto-sent), and independent hands-on validation of the full delegate→work→review loop is thin. Missing for 10: explicit review/approval workflow evidence, and richer independent hands-on accounts of multi-step autonomous task completion.

   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
   • [claimed-docs] “Martin can send you daily or weekly briefings via email.”
   • [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
   • [claimed-docs] “Cc Martin on an email to schedule a meeting.”
   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
   • [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”

   proof ↗⚑ flag

2. power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed6/10

   Microsoft documents a dedicated 'Browse with Copilot' capability that lets Copilot click, type, and navigate tabs in Edge to complete web tasks, with real-time visibility and required user confirmation for sensitive actions like purchases or bookings, plus a 'Cowork' mode for multi-step task completion. However, all supporting evidence is first-party docs with no independent/hands-on confirmation of browser-operation success, and community feedback in the pack focuses on Office-integrated Copilot rather than this browsing agent feature. Missing for 10: independent/hands-on validation of the browse-and-complete-task capability, more detail on reliability/success rate on real websites.

   • [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
   • [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
   • [claimed-docs] “You can see each step in real time and take control at any time.”
   • [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”

   proof ↗⚑ flag

   Martin—none0/10

   Martin's documented capabilities cover calendar, email, Slack, notes, reminders, todos, and search-engine lookups, but nothing in the evidence describes it operating a web browser, navigating websites, or completing multi-step tasks on arbitrary sites on the user's behalf.

   • [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
   • [claimed-docs] “Have Martin read and send messages in Slack from your account.”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”

   proof ↗⚑ flag

3. power-userLet the assistant see and operate applications on my computer to complete work

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot~partialcommunity6/10

   Microsoft documents 'Browse with Copilot' letting the assistant click, type, and navigate tabs directly in Edge, plus 'Cowork' for multi-step task completion and Vision for seeing images/screens, with human-in-the-loop confirmation for sensitive actions. However, this operating capability is scoped mainly to the browser and Office apps rather than general desktop application control, and community reports describe weak real-world execution (e.g., Copilot in Word failing at basic edits, Outlook integration being minimal), undercutting the strength of the claim. Missing for 10: broad OS-level/desktop app automation beyond Edge/Office, and independent hands-on validation that agentic actions reliably complete tasks.

   • [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
   • [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
   • [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
   • [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
   • [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”

   proof ↗⚑ flag

   Martin~partialcommunity5/10

   Martin can act inside specific applications via integrations (calendar, email, Slack, notes, to-dos) rather than through general screen/GUI-level control of arbitrary desktop apps — it operates named services via API-like connections, not a computer-use style visual agent. A desktop app exists (martin-comm-4) but evidence only shows it syncing to-dos, not controlling arbitrary programs. Missing for 10: evidence of generic screen/vision-based computer control, ability to operate arbitrary (non-integrated) applications, and independent hands-on proof of this broader 'operate any app' capability.

   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
   • [claimed-docs] “Have Martin read and send messages in Slack from your account.”
   • [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”

   proof ↗⚑ flag

Tasks

1. power-userSchedule recurring or one-off tasks that run automatically and come back to me with results

   weight 2 · round to Martin
   Microsoft Copilot—none0/10

   The evidence shows Copilot can handle multi-step tasks (Cowork) and automate repetitive work, but there is no mention of scheduling recurring or one-off tasks that run automatically and return results later. Missing for 10: any documentation of a task-scheduling feature, recurrence settings, or proactive notification of completed scheduled runs.

   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
   • [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
   • [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”

   proof ↗⚑ flag

   Martin~partialcommunity6/10

   Martin supports recurring background tasks (daily/weekly briefings, wake-up calls, email triage) and one-off scheduled reminders that ping the user via chosen interface, matching the core of the story. However, there's no unified 'task scheduler' concept with arbitrary custom recurring workflows beyond the specific built-in background tasks listed, and no independent verification of reliability for scheduled/recurring runs. missing for 10: evidence of general-purpose custom recurring task scheduling (not just fixed briefings/wake-up-calls), independent hands-on confirmation of reminder/briefing reliability, and any dashboard/management UI for viewing scheduled tasks.

   • [claimed-docs] “Tell Martin to remind you to do something, and he will ping you when the time comes.”
   • [claimed-docs] “Martin can send you daily or weekly briefings via email.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
   • [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
   • [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
   • [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”

   proof ↗⚑ flag

Apps

1. power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   The evidence pack covers web/Office integrations, browser automation (Edge), and mobile/iOS/Android connectors, but nowhere documents an official standalone desktop app with OS-level keyboard shortcuts or the ability to see/interact with the user's screen content outside a browser. Vision (copilot-docs-30) is limited to photo/image analysis, not live screen capture, and Browse with Copilot (copilot-docs-9, -15, -24) is scoped to actions inside Microsoft Edge, not OS-wide screen access.

   • [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
   • [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
   • [claimed-docs] “You can see each step in real time and take control at any time.”
   • [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”

   proof ↗⚑ flag

   Martin—none0/10

   Community evidence confirms a Martin desktop app exists (martin-comm-4), and docs mention in-app 'shortcuts' for multi-step actions (martin-docs-7), but there is no evidence of OS-level global keyboard shortcuts or any capability for Martin to read/access what's on the user's screen. missing for 10: evidence of OS-level hotkey integration, evidence of screen-reading/context capture, any documentation describing desktop-native system integration beyond a generic app shell.

   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”

   proof ↗⚑ flag

2. knowledge-workerUse full-featured official mobile apps for iOS and Android

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed6/10

   Docs explicitly confirm 'Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)', establishing official iOS/Android apps exist and support core connector/chat features. However, there's no first-party or hands-on evidence detailing mobile-specific feature parity (e.g., Word/Excel/PowerPoint copilots, Vision, voice mode) on the mobile apps, and community feedback focuses only on desktop/Office integration quality, not mobile experience. Missing for 10: mobile-specific feature parity details, hands-on mobile app reviews, and confirmation of full functionality (Vision, Voice, connectors) actually working within the mobile app UI.

   • [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
   • [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
   • [claimed-docs] “If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.”
   • [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”

   proof ↗⚑ flag

   Martin—none0/10

   Martin's docs describe channel-based access (phone, SMS, WhatsApp, email, Slack, desktop) but no evidence of dedicated, full-featured native iOS/Android apps; a community comment explicitly asks 'I would try this if it had Android support! Is that planned?' indicating no Android app exists, and no iOS app is mentioned anywhere.

   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
   • [community] “I would try this if it had Android support! Is that planned?”

   proof ↗⚑ flag

Custom bots

1. power-userBuild and share custom assistants with their own instructions and knowledge

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   No evidence describes creating custom Copilot agents/assistants with custom instructions and knowledge base (like Copilot Studio agents or GPT-builder equivalents) nor sharing them with others; evidence only covers built-in Office integrations, connectors, and memory features. Missing for 10: any mention of an agent/assistant builder, custom instructions, custom knowledge upload, and sharing/publishing mechanism for user-built assistants.

   ⚑ flag

   Martin—none0/10

   Martin is a personal AI assistant with fixed integrations (calendar, email, Slack, todos, notes, reminders) and shortcuts, but there is no evidence of a feature to build a custom assistant with its own distinct instructions/persona and knowledge base, nor any sharing mechanism for such an assistant. missing for 10: custom assistant creation with configurable instructions/persona, custom knowledge base attachment, and sharing/publishing of a built assistant.

   ⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Martin
   Microsoft Copilot~partialcommunity3/10

   Docs mention general automation of 'repetitive tasks' and multi-step task completion via Cowork, but there's no concrete evidence of bulk operations across many items (e.g., batch-editing many files, mass email actions, or large-scale spreadsheet manipulation). Community feedback (copilot-comm-4) reports Copilot in Word failing at basic single-document tasks like search-and-replace, casting doubt on any claim of robust bulk-item processing. missing for 10: explicit bulk/batch operation examples (e.g., mass-processing many files/rows/emails at once), independent hands-on evidence of successful bulk actions, and confirmation that Cowork or Analyst can operate at scale across many items reliably.

   • [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
   • [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
   • [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
   • [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”

   proof ↗⚑ flag

   Martin~partialclaimed4/10

   Martin's docs show a few multi-item behaviors — e.g. forwarding an email with several events and having 'all of them' added to the calendar (martin-docs-23), and automatic email labeling/triage across an inbox (martin-docs-11) — which imply some batch-like processing, but there is no explicit bulk-operations feature (e.g. batch todo updates, mass note edits, multi-item scheduling command) described anywhere in the docs. missing for 10: explicit bulk-action tooling/API for operating on many items at once, first-party documentation of bulk operations, and independent confirmation of bulk-scale reliability.

   • [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to Martin
   Microsoft Copilot—none0/10

   The evidence describes Copilot responding to prompts, browsing, summarizing, and connecting to services, but there is no mention of user-defined rules or triggers that fire actions automatically on events (e.g., 'when email arrives, do X' style automation). No scheduling, event-trigger, or workflow-builder capability is documented.

   ⚑ flag

   Martin~partialclaimed6/10

   Martin ships several automatic, event-triggered behaviors (email triage that auto-labels and follows up, cc-to-schedule meeting creation, forwarded-email calendar parsing, proactive drafts, wake-up calls, briefings) which act like predefined automation rules, and 'custom shortcuts' let users define multi-step action sequences. However, there's no evidence of a general user-defined rule/trigger engine (e.g., 'if email from X arrives then do Y' configurable conditions) — the automations shown are fixed built-in behaviors rather than arbitrary user-authored event rules. Missing for 10: a documented custom rule/condition builder, evidence of arbitrary event-trigger definitions beyond built-in background tasks, and independent confirmation these automations fire reliably in practice.

   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
   • [claimed-docs] “Cc Martin on an email to schedule a meeting.”
   • [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
   • [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
   • [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round to Martin
   Microsoft Copilot—none0/10

   No evidence describes scheduling recurring jobs, timers, or automated recurring workflows in Microsoft Copilot; the pack shows one-off task automation (Cowork, connectors, browse actions) but nothing about recurrence or scheduling.

   ⚑ flag

   Martin~partialclaimed6/10

   Martin ships several built-in recurring background jobs — daily/weekly briefings, daily wake-up calls, and automatic email triage — which are documented recurring workflows, and shortcuts allow custom multi-step actions. However, there's no evidence of a general-purpose, user-defined recurring job scheduler (e.g., custom cadence for arbitrary tasks/workflows beyond the fixed built-in recurring features). Missing for 10: user-configurable custom recurring schedules beyond the fixed briefing/wake-up-call cadence, and independent confirmation these recurring jobs run reliably at scale.

   • [claimed-docs] “Martin can send you daily or weekly briefings via email.”
   • [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
   • [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
   • [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”

   proof ↗⚑ flag

4. ai-native userVersion, review, and roll back my automations

   weight 1 · round drawn
   Microsoft Copilot—none0/10

   No evidence describes any versioning, history, review workflow, or rollback capability for Copilot's automations (e.g., Cowork, connectors, or agent tasks); evidence only covers connecting services, browsing, memory, and privacy controls. Missing for 10: version history UI, diff/review of automation changes, rollback/undo mechanism, any audit trail for automation edits.

   ⚑ flag

   Martin—none0/10

   Martin is a personal assistant agent (email, calendar, reminders, shortcuts) with no evidence of version history, review workflows, or rollback for its automations/shortcuts; docs describe creating shortcuts but nothing about versioning or undoing them. Missing for 10: version history UI, review/approval workflow, rollback mechanism.

   • [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”

   proof ↗⚑ flag

Connectors

1. power-userBrowse a directory of third-party apps and connectors and add them to the assistant

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed4/10

   Docs confirm Copilot supports 'connectors' to a small fixed list of services (OneDrive, Outlook.com, Google Drive, Gmail/Calendar/Contacts) and note these are available on Copilot.com/Mobile, but there is no evidence of a browsable directory/marketplace of third-party apps that power-users can explore and add beyond this short built-in list. missing for 10: evidence of a searchable app/connector marketplace, breadth of third-party (non-Microsoft/Google) integrations, and any independent confirmation of the browsing/add experience.

   • [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
   • [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
   • [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
   • [claimed-docs] “Copilot can connect with the following consumer services: ... Google Drive ... Google Gmail, Calendar, Contacts”
   • [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive... Google Drive... Google Gmail, Calendar, Contacts”

   proof ↗⚑ flag

   Martin—none0/10

   Evidence shows Martin ships a small fixed set of first-party integrations (Calendar, Inbox, Slack) rather than a browsable directory/marketplace of third-party apps and connectors that a power-user can explore and add. No docs, UI, or community mentions describe an app directory or connector marketplace.

   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
   • [claimed-docs] “Have Martin read and send messages in Slack from your account.”

   proof ↗⚑ flag

2. knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot✓fullcommunity8/10

   Microsoft's documentation explicitly describes connecting Copilot to OneDrive, Outlook.com (email/calendar/contacts), Google Drive, and Google Gmail/Calendar/Contacts, with example queries for finding files, emails, and calendar events, indicating the assistant can search and use this data in answers. Community evidence corroborates that cross-document/data fetching works well in some contexts, though other complaints focus on unrelated feature quality issues (e.g., editing limitations) rather than disputing the connector capability itself. Missing for 10: independent hands-on verification specifically of the cloud-drive/email/calendar connector search feature (rather than in-app Office Copilot) and more detail on reliability/completeness of search results.

   • [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
   • [claimed-docs] “Find my budget spreadsheet” or “Show me the project plan from last month.”
   • [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
   • [claimed-docs] “Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
   • [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
   • [claimed-docs] “Show me emails from Sarah about the budget” or “Find my flight confirmation email.”
   • [claimed-docs] “What's on my calendar for tomorrow?” or “When is my next dentist appointment?”
   • [claimed-docs] “Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
   • [claimed-docs] “Check in on your calendar: “What’s on my calendar for tomorrow?” or “When is my next dentist appointment?””
   • [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
   • [community] “the way it can fetch data from across documents in 365 is really good”

   proof ↗⚑ flag

   Martin~partialclaimed5/10

   Martin has well-documented calendar and email (inbox) integrations letting it read, draft, reply, and add events on the user's behalf, plus a general search capability across connected sources. However, no evidence mentions a cloud drive (e.g., Google Drive/Dropbox) connector, so the story's full connector set is only partially covered. missing for 10: cloud drive integration, independent verification that search actually spans all connected sources.

   • [claimed-docs] “Have Martin read, create, and update events in your calendar.”
   • [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
   • [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
   • [claimed-docs] “Once connected, you can tell Martin to add an event to your calendar, and he will add it at the specified time with the specified details.”
   • [claimed-docs] “Once connected, you can tell Martin to read, draft, and reply to emails on your behalf.”
   • [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”

   proof ↗⚑ flag

Files

1. knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot~partialcommunity6/10

   Microsoft's own docs describe multiple file-analysis capabilities—attaching data in Excel, analyzing notes in Word, finding/searching PDFs and Office documents, an 'Analyst' tool for data insight, and code execution for calculations—giving broad first-party coverage of the story. However, hands-on community reports contradict smooth real-world usability (e.g. Word Copilot 'couldn't do anything except append text... couldn't maintain formatting' and Outlook summarization deemed 'so bad'), while another user praises cross-document data-fetching, so the accuracy/quality of analysis is mixed rather than assured. Missing for 10: independent verification of analysis accuracy on complex spreadsheets/PDFs, and resolution of the documented Word-editing/formatting failures.

   • [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
   • [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
   • [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
   • [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
   • [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
   • [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
   • [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
   • [community] “the way it can fetch data from across documents in 365 is really good”

   proof ↗⚑ flag

   Martin—none0/10

   Martin is a personal-assistant product focused on calendar, email, Slack, reminders, notes, and todos; no evidence anywhere in the pack mentions document, spreadsheet, or PDF upload/analysis capabilities. This is a plausible axis for an AI assistant but there's no supporting documentation or community mention of file/document analysis features.

   ⚑ flag

Memory

1. power-userHave the assistant remember relevant context from previous chats and apply it in new conversations

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed6/10

   First-party docs confirm a memory feature: Copilot can store facts users ask it to remember and use that context in future responses, and can proactively surface suggestions based on past queries and memory (copilot-docs-32, copilot-docs-33). However, this is opt-in/explicit fact storage rather than full automatic context carry-over, and there is no independent/hands-on evidence confirming it works reliably across conversations. missing for 10: independent verification of cross-conversation recall, detail on scope/limits of automatic memory use, and confirmation it isn't just facts explicitly asked to be remembered.

   • [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
   • [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”

   proof ↗⚑ flag

   Martin~partialclaimed4/10

   Martin's notes, to-dos, and reminders (martin-docs-6, martin-docs-22, martin-docs-5) provide persistent storage that Martin can read back across interfaces, giving it some ability to carry information forward. However, there is no explicit documentation of the assistant automatically recalling relevant context from prior conversations and applying it in new, unrelated chats — memory here is user-invoked (explicit notes) rather than an automatic contextual-memory feature. Missing for 10: explicit memory/context-recall feature description, evidence of automatic application of past-conversation context in new sessions, independent confirmation of this behavior.

   • [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
   • [claimed-docs] “Call Martin and say "Note down everything we talked about on this call and call it 'Brain Dump'."”
   • [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
   • [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”

   proof ↗⚑ flag

2. power-userSet persistent custom instructions and preferences that shape every response

   weight 1 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed5/10

   Docs confirm a memory feature where Copilot can store facts users ask it to remember and use them to personalize future responses and suggestions, plus controls to view/delete memory (copilot-docs-32, copilot-docs-33, copilot-docs-38). However there is no dedicated 'custom instructions' setting described (unlike explicit persona/tone controls), and no independent/hands-on evidence confirming these stored facts consistently shape *every* response. Missing for 10: explicit custom-instructions UI documentation, hands-on confirmation that memory reliably influences all responses, and community corroboration of the feature's effectiveness.

   • [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
   • [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [claimed-docs] “opt out of use of your conversation activity for model training”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence in the pack describes a persistent custom-instructions or preferences feature that shapes all of Martin's responses; the docs cover integrations, reminders, notes, and background tasks but nothing about setting persona/style preferences persistently.

   ⚑ flag

Images

1. knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed5/10

   Docs confirm Copilot has a 'Vision' capability to analyze images and photos ([copilot-docs-30]), directly supporting the story, but this is a single first-party mention with no elaboration on screenshot-specific use cases or accuracy, and no independent/hands-on evidence corroborates real-world interpretation quality. Missing for 10: detailed documentation on screenshot vs photo handling, accuracy benchmarks, and independent/community verification of correct image interpretation.

   • [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence in the pack mentions image, screenshot, or photo interpretation capabilities; Martin's documented features focus on text-based channels (email, Slack, SMS, calendar, notes, reminders) with no mention of vision/multimodal input handling.

   ⚑ flag

Voice

1. knowledge-workerHave a natural, real-time voice conversation with the assistant

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot✓fullclaimed6/10

   Microsoft's transparency docs explicitly describe Copilot Voice mode: users send natural-language voice prompts and receive audio responses, with citations shown in conversation transcripts, confirming real-time spoken interaction. Missing for 10: independent/hands-on corroboration of voice mode's real-time quality, latency, or interruption handling, and no community evidence specifically validates or disputes the voice experience.

   • [claimed-docs] “If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.”
   • [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”

   proof ↗⚑ flag

   Martin~partialclaimed6/10

   Martin supports real phone-call interactions — users can call Martin to dictate notes, and Martin can call users for wake-up briefings — indicating a live voice channel exists (martin-docs-22, martin-docs-24, martin-docs-12). However, there is no documentation or independent evidence describing the naturalness, latency, or conversational fluidity of these voice interactions, and community feedback focuses on text/action reliability rather than voice quality. Missing for 10: hands-on/independent evidence of real-time conversational voice quality, documentation of voice-specific features like interruption handling or natural turn-taking.

   • [claimed-docs] “Call Martin and say "Note down everything we talked about on this call and call it 'Brain Dump'."”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
   • [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   No evidence of a public API exposing Copilot's UI capabilities (chat, connectors, Word/Excel/PowerPoint copilots) programmatically; probes for OpenAPI/docs endpoints returned 404s, and all evidence describes UI/chat-only functionality. Missing for 10: any documented API/SDK, endpoint parity documentation, or third-party confirmation of programmatic access to Copilot features.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
   • [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
   • [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”

   proof ↗⚑ flag

   Martin—none0/10

   Martin's documented surface is entirely conversational interfaces (email, Slack, phone, SMS, WhatsApp) with no mention of a public/developer API; explicit probes for an OpenAPI/swagger spec at all standard paths returned 404, indicating no programmatic API exists to mirror these UI capabilities.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
   • [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round drawn
   Microsoft Copilot—none0/10

   No evidence of a data export/portability feature or open-format export mechanism; docs only mention deleting conversation history, not exporting it, and probes for machine-readable docs/APIs 404. There is nothing showing users can export chats, memory, or generated content in open formats to leave the platform.

   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [claimed-docs] “opt out of use of your conversation activity for model training”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence anywhere in the pack of a data export feature or open-format data portability; Martin's docs focus on integrations, reminders, and briefings but never mention exporting user data or account deletion/export tools.

   ⚑ flag

3. ai-native userRead the product's source under an open license

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   Microsoft Copilot is closed-source proprietary software; no evidence indicates any open-license source availability, and probes for docs/API artifacts returned 404s. This is an applicable axis (a product could conceivably be open-sourced) but no evidence supports it, so verdict is none rather than na.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence Martin's source code is available under any license; a community comment explicitly calls for Martin to 'make that system open source' as a trust-building step, implying it currently is not.

   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag

4. ai-native userSelf-host the core product

   weight 3 · round drawn
   Microsoft Copilot—none0/10

   Microsoft Copilot is a cloud-hosted SaaS product with no evidence of any self-hosted or on-premises deployment option; all documentation describes it as a hosted service (Copilot.com, Microsoft 365 cloud integration, Edge browser actions) with no self-hosting mechanism mentioned.

   ⚑ flag

   Martin—none0/10

   Martin is offered exclusively as a cloud-based assistant (email, Slack, calendar interfaces, cloud-based agent per martin-comm-4); no evidence of a self-hostable core product, open-source release, or on-prem deployment option. One community comment (martin-comm-3) even calls for open-sourcing the data-handling system, implying it is not currently available.

   • [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   No evidence in the pack mentions data residency, regional storage controls, or any user-facing setting to choose where data is stored; the docs cover features, connectors, and privacy opt-outs but not geographic data residency choices.

   ⚑ flag

   Martin—none0/10

   No evidence anywhere in the pack mentions data residency, region selection, or storage location controls; docs focus entirely on assistant features and integrations. Community comments raise general privacy/security concerns but do not address data residency options. missing for 10: any mention of region selection, data residency policy, or storage location controls.

   • [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot~partialcommunity6/10

   Microsoft's privacy FAQ explicitly states users can opt out of having conversation activity used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38), giving a documented mechanism to prevent training use. However, community reports (copilot-comm-6, copilot-comm-1) show real confusion about scope — a user working in Word had no clear indication whether their document content was being fed to training, and commenters note the opt-out/behavior differs between standalone Copilot chat and 365-integrated Copilot, undermining confidence that the control is comprehensive or transparent across all surfaces. missing for 10: independent verification that opt-out actually blocks training across all integrated products (Word/Excel/Outlook), clearer UI-level opt-out controls inside Office apps, and confirmation the toggle covers enterprise/connector data sources.

   • [claimed-docs] “opt out of use of your conversation activity for model training”
   • [claimed-docs] “Train our generative AI models to create a better experience for you and others.”
   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
   • [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence pack item addresses AI-training data opt-out or data-usage policy; community comments explicitly raise privacy/trust concerns without any documented answer or control from Martin. Missing for 10: any privacy policy statement, opt-out setting, or documented no-training-data commitment.

   • [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot~partialcommunity6/10

   Docs confirm users can delete individual conversations or entire history and opt out of conversation data being used for model training, giving basic retention/deletion control for the standalone Copilot chat experience (copilot-docs-35, copilot-docs-38). However, community evidence notes this applies only to the standalone Copilot app/site, not to Copilot embedded in Office apps like Word, where a user reported uncertainty about whether their document was being auto-pushed for training with no visible deletion controls (copilot-comm-1, copilot-comm-6). Missing for 10: enterprise/Office-integrated retention controls, clarity on data retention duration before deletion, and independent verification that deletion actually removes data from training pipelines.

   • [claimed-docs] “opt out of use of your conversation activity for model training”
   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
   • [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence describes data retention policies, deletion controls, export tools, or privacy settings; community comments even raise unaddressed concerns about lack of transparency around data handling. Missing for 10: any documentation of data retention periods, user-initiated deletion mechanism, or privacy controls.

   • [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot!disputedcontradicted5/10

   Microsoft's own privacy FAQ states users can opt out of having conversation activity used for model training and can delete individual or entire conversation history (copilot-docs-35, copilot-docs-38), which is a real opt-out mechanism for the standalone Copilot chat. However, community reports directly contradict this for Copilot as embedded in Office apps: a Word for Mac user reports 'no way of turning it off' and 'no opt-out mechanism' (copilot-comm-3), and another user reports uncertainty over whether their document was being auto-pushed to Copilot for training with no visible control (copilot-comm-6) — and copilot-comm-1 clarifies the training opt-out only applies to the standalone chat app, not the Office-integrated Copilot surfaces. Missing for 10: a unified, product-wide opt-out control covering all Copilot surfaces (Office, Edge, Windows), independent verification that the training opt-out actually stops data use, and clarity on telemetry beyond training data.

   • [claimed-docs] “opt out of use of your conversation activity for model training”
   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
   • [community] “Hate that if you use Word for Mac, you now have Copilot next to your cursor with no way of turning it off. I just want to use Word... Now th…”
   • [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence of any telemetry opt-out, privacy settings, or data collection controls; community comments even raise unresolved privacy/trust concerns (martin-comm-2, martin-comm-3) with no documented response or opt-out mechanism.

   • [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag

Research

1. knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot~partialclaimed5/10

   Copilot's 'Researcher' agent is documented as designed to 'find, synthesize, and understand information faster' and Copilot's web-grounded answers include hyperlinked citations, which maps to the deep-research/cited-report story, but there is no detail on autonomous multi-source search depth, report format, or any hands-on/independent validation of report quality. Missing for 10: documentation of the autonomous multi-step search process, description of report output structure, and independent corroboration of research depth/accuracy.

   • [claimed-docs] “Find, synthesize, and understand information faster with Researcher.”
   • [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
   • [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”

   proof ↗⚑ flag

   Martin—none0/10

   Martin's docs mention a basic search capability that 'syncs with multiple search engines to find relevant information' (martin-docs-8), but there is no evidence of an autonomous multi-source deep-research mode that returns a structured, cited report — no mention of citation formatting, report generation, or a dedicated 'deep research' feature.

   • [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”

   proof ↗⚑ flag

2. knowledge-workerGet answers grounded in current web results with citations back to the sources

   weight 2 · round to Microsoft Copilot
   Microsoft Copilot✓fullclaimed8/10

   Docs explicitly state Copilot grounds responses in high-ranking web content and provides hyperlinked citations after generated responses, directly matching the story; this is corroborated by broader documentation on research/answer features (Researcher, ask questions and get answers fast). Missing for 10: independent hands-on verification of citation accuracy/quality and no community evidence specifically testing web-grounded citation behavior.

   • [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
   • [claimed-docs] “Ask questions and get answers fast.”
   • [claimed-docs] “Find, synthesize, and understand information faster with Researcher.”

   proof ↗⚑ flag

   Martin~partialclaimed4/10

   Martin claims to sync with multiple search engines to find relevant information (martin-docs-8), suggesting web-grounded answers, but there is no evidence of citation formatting, source linking, or hands-on verification that answers include traceable citations back to web sources. Missing for 10: documentation or examples showing inline citations/source links, independent corroboration of search-grounded answer quality, and detail on which search engines/sources are used.

   • [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”

   proof ↗⚑ flag

Admin

1. team-adminManage members, permissions, and data policies for my organization's workspace

   weight 2 · round drawn
   Microsoft Copilot—none0/10

   The evidence pack covers only individual/consumer Copilot features (writing, spreadsheets, browsing, memory, privacy opt-outs for personal conversations) with no mention of team/workspace admin controls such as member management, role-based permissions, or organizational data policies. Missing for 10: admin console documentation, member/role management, org-wide data governance policies, and any evidence of a team-admin experience.

   ⚑ flag

   Martin—none0/10

   Martin's evidence pack is entirely about individual personal-assistant features (calendar, email, Slack, reminders, to-dos) with no mention of organization workspaces, member management, permission controls, or data-policy settings for teams. missing for 10: any admin console, member/role management, workspace-level permissions, or data governance policy documentation.

   ⚑ flag

Data controls

1. knowledge-workerExport my complete chat history and account data

   weight 1 · round drawn
   Microsoft Copilot—none0/10

   Evidence shows users can delete individual conversations or entire history (copilot-docs-38) and opt out of training use (copilot-docs-35), but there is no mention of an export/download feature for complete chat history or account data as required by the story.

   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [claimed-docs] “opt out of use of your conversation activity for model training”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence in the pack mentions data export, chat history download, or account data portability features; community comments even raise privacy concerns without any mention of export tools. Missing for 10: any documentation or feature reference to exporting chat history or account data, data portability API, or GDPR-style export mechanism.

   ⚑ flag

2. knowledge-workerControl whether my conversations are used to train models

   weight 3 · round to Microsoft Copilot
   Microsoft Copilot~partialcommunity6/10

   Microsoft's own docs confirm a control exists: users can opt out of conversation activity being used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38). However, community evidence indicates confusion about scope—one commenter notes the opt-out applies to standalone Copilot chat/app, not to Copilot embedded in Office apps like Word (copilot-comm-1), and another user reports genuine uncertainty whether their Word document was being used for training with no clear indication (copilot-comm-6). Missing for 10: clear unified documentation covering training-data opt-out scope across all Copilot surfaces (Office-integrated vs standalone), and independent verification that the opt-out setting functions as described.

   • [claimed-docs] “opt out of use of your conversation activity for model training”
   • [claimed-docs] “Train our generative AI models to create a better experience for you and others.”
   • [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
   • [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
   • [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”

   proof ↗⚑ flag

   Martin—none0/10

   No evidence in the pack mentions any setting, policy, or statement about whether user conversations/data are used for model training; community comments explicitly raise privacy/trust concerns without any documented opt-out or training-control mechanism (martin-comm-2, martin-comm-3).

   • [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
   • [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”

   proof ↗⚑ flag