Microsoft Copilot vs Poke
Microsoft Copilot wins · 17–14 (15 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round to PokeMicrosoft Copilotnone0/10Probes show no llms.txt, no markdown docs endpoint, and no OpenAPI spec for Microsoft Copilot's support site, and no evidence anywhere in the pack of agent-oriented documentation formats being offered. This axis applies (any product could publish llms.txt or agent-friendly docs) but there is no evidence Copilot does so.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
A live llms.txt file is confirmed via direct probe (HTTP 200) with actual agent-oriented content describing Poke, and Poke also maintains structured docs pages that agents/tools can be pointed at. missing for 10: no docs.md or openapi.json fallback (both 404), and no independent report of an agent successfully consuming llms.txt end-to-end.
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · round to PokeMicrosoft Copilotnone0/10The evidence pack describes Copilot connecting to first-party consumer services (OneDrive, Outlook.com, Google Drive/Gmail) via 'Copilot connectors,' but there is no mention of MCP (Model Context Protocol) server support or an ability for users to plug in arbitrary MCP tool servers. This is an applicable axis for an AI assistant product, but no evidence shows the capability exists.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
Poke's docs explicitly describe MCP server support, with CLI commands to tunnel local MCP servers and add remote ones ('poke mcp add'), plus a recipe/marketplace ecosystem for sharing MCP-based tools. This is first-party documented and corroborated by a probe confirming the docs page exists, though there's no independent hands-on report of the MCP integration actually working. Missing for 10: independent/hands-on verification of MCP tool usage in practice, and more detail on tool invocation reliability.
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [claimed-docs] “npx poke@latest tunnel http://localhost:3000/mcp -n "Local Dev MCP"”
- [claimed-docs] “you earn revenue from MCP usage by users who install your recipe”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [probe] “official MCP server documented at https://poke.com/docs/mcp-servers”
ai-native userUse an official CLI
weight 2 · round to PokeMicrosoft Copilotnone0/10No evidence of an official CLI for Microsoft Copilot; all evidence covers chat, browser, and Office app integrations, with probes confirming no machine-readable API/CLI artifacts.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Poke ships an official CLI invoked via `npx poke@latest` with subcommands like `login`, `tunnel`, and `mcp add`, confirming a real CLI exists for developer/MCP workflows. However, the documented CLI scope is narrow (mainly MCP server registration/tunneling and login) rather than a general-purpose CLI for broader AI-native automation tasks. Missing for 10: evidence of a fuller command set (e.g. messaging, recipe management, account/config commands) and any independent/hands-on verification of the CLI's reliability.
- [claimed-docs] “npx poke@latest tunnel http://localhost:3000/mcp -n "Local Dev MCP"”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
ai-native userDrive the product through a documented public API
weight 3 · round to PokeMicrosoft Copilotnone0/10No evidence of a documented public API for programmatically driving Microsoft Copilot; probes for OpenAPI/llms.txt specs all returned 404, and all docs describe end-user chat/UI interactions rather than API access. Missing for 10: any public API documentation, SDK, or endpoint spec that lets developers programmatically invoke Copilot's capabilities.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Poke documents a public API for sending messages programmatically and integrating with external triggers (CI/CD, monitoring tools), plus CLI/MCP tooling for extending functionality, showing genuine programmatic access. However, no OpenAPI/Swagger spec or formal API reference was found (404s on standard discovery paths), so the API's documentation depth and completeness are unclear. Missing for 10: a full API reference/spec (OpenAPI schema), authentication details, rate limits, and independent developer corroboration of building against the API.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence describes issuing scoped or least-privilege API credentials for an agent; Copilot's documented connectors involve OAuth-style account sign-in to consumer services, not developer-controlled scoped credential issuance. missing for 10: any mention of API keys, scoped tokens, permission scoping, or credential management for agent access.
Pokenone0/10Evidence shows Poke supports API access, integrations, and MCP servers, but there's no mention of scoped or least-privilege API credential/key issuance for agents — no API key management, permission scoping, or token-based access control documentation. The prompt-injection incident (poke-comm-1) raises security concerns but is unrelated to credential scoping specifically.
ai-native userBuild against official SDKs
weight 2 · round to PokeMicrosoft Copilotnone0/10The evidence pack covers Microsoft Copilot as a consumer AI assistant with features like connectors, browsing, and app integrations, but contains no mention of official SDKs, developer APIs, or programmatic build tooling for third-party developers; probes for API/OpenAPI specs returned 404s, further indicating no discoverable developer SDK surface.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Poke exposes a documented API for sending messages programmatically and an official CLI (`npx poke@latest`) for managing MCP servers and recipes, which developers can build against, but there is no evidence of dedicated official SDK packages (e.g., Python/JS client libraries) — probes for OpenAPI/swagger specs and docs.md all returned 404, suggesting no formal SDK artifacts beyond the CLI/API docs. missing for 10: language-specific SDK packages, published OpenAPI/schema spec, independent developer corroboration of SDK usage.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
ai-native userSubscribe to events via webhooks
weight 2 · round to PokeMicrosoft Copilotnone0/10No evidence anywhere in the pack of Copilot offering webhook subscriptions or any event-driven notification API for developers; probes for API/OpenAPI specs returned 404s, and docs only describe chat/connector features, not webhook subscription mechanisms.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Poke's API docs mention that external services like GitHub, CI/CD, or monitoring tools can trigger Poke via webhook-style calls, and the API can send messages programmatically, showing some webhook-adjacent integration. However, there's no explicit documentation of Poke exposing an outbound webhook subscription system for AI-native users to subscribe to Poke's own events. missing for 10: explicit outbound webhook/event subscription API, event types list, subscription management docs, independent confirmation of webhook reliability.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
Agentic features
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · round to PokeMicrosoft Copilotdisputedcontradicted5/10Microsoft heavily documents AI-generated insights across Word, Excel, PowerPoint, Outlook, Researcher, and Analyst, and describes proactive suggestions and code-run analysis (copilot-docs-2, copilot-docs-6, copilot-docs-16, copilot-docs-33, copilot-docs-31). However, hands-on community reports concretely contradict these claims for core products: a user found Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables' (copilot-comm-4), and Outlook's summarization is described as 'so bad' with a tiny UI button (copilot-comm-5); others report never finding a use case (copilot-comm-9). One community report is positive about cross-document data fetching (copilot-comm-7), so evidence is genuinely mixed rather than uniformly negative. Missing for 10: independent benchmark of insight quality/accuracy, resolution of the Word/Outlook hands-on failures, and clearer distinction of chat vs. Office-integrated Copilot performance.
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
- [community] “the way it can fetch data from across documents in 365 is really good”
- [community] “I use AI everyday and never found a use case for Copilot.”
Poke can extract and visualize data from shared images/spreadsheets into tables and charts, and integrations let it access and act on connected app data conversationally, which implies some data-driven insight generation. However, there's no explicit documentation of proactive AI-generated insights, trend analysis, or suggestions surfaced from a user's own accumulated data/history. missing for 10: dedicated insights/suggestions feature documentation, evidence of proactive analysis of user data patterns, independent/hands-on confirmation of this capability.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
ai-native userSet up automations that run autonomously in the background
weight 2 · round to PokeDocs mention agentic-style capabilities (Cowork multi-step task completion, automating repetitive tasks, proactive research suggestions, browser action-taking) suggesting some autonomy, but Browse with Copilot explicitly requires user attention/supervision for many actions and no docs describe scheduled or fully background-running automations without a user session. Missing for 10: explicit scheduling/trigger mechanism, evidence of unattended background execution, and independent confirmation that these automations run without active supervision.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
Poke's docs show building blocks for automation—an API that external tools (CI/CD, monitoring) can call to trigger Poke, and a 'recipes' system that can be created and published—plus positioning as a 'proactive AI assistant.' However there is no explicit documentation of scheduled/autonomous background jobs running without an external trigger or user prompt. missing for 10: documented scheduling/cron-like triggers, evidence of recipes running unattended in the background, independent confirmation of autonomous execution.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “Publishing a recipe: marks it Published, generates a referral/share link, makes it eligible for payouts”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round to PokeMicrosoft's own docs describe extensive delegation features—Copilot in Word/Excel/PowerPoint/Outlook, Researcher, Analyst, Browse with Copilot performing multi-step browser actions, and Cowork handling 'bigger, multi-step tasks'—clearly positioning Copilot as a built-in assistant that can take on tasks. However, hands-on community reports contradict smooth delegation in practice (e.g., Copilot in Word 'couldn't do anything except append to the end of the document,' couldn't create tables or maintain formatting, and some users report never finding a real use case), indicating real-world task execution is often shallow or unreliable. Missing for 10: independent verification of successful complex multi-step task completion, and resolution of documented editing/execution failures in flagship apps.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.”
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
- [community] “I use AI everyday and never found a use case for Copilot.”
Poke IS the built-in AI assistant itself — users delegate tasks via natural conversation, integrations, MCP tools, and even real-human task execution (reservations, calls, deploying websites), all documented in first-party docs. Missing for 10: independent hands-on validation of task delegation beyond the security prompt-injection incident, which is off-topic here.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [claimed-docs] “Poke can also create and deploy websites for you at yourname.poke.com.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
ai-native userOperate the product with natural-language commands
weight 2 · round to PokeMicrosoft Copilotdisputedcontradicted5/10Docs extensively describe natural-language operation—prompting Copilot in Word/Excel/PowerPoint, natural-language file/email/calendar search, and browser action commands (copilot-docs-1,2,3,8,14,20-22,26,27). However, hands-on community evidence directly contradicts this for at least one core surface: a user reports Copilot in Word 'couldn't do anything except append to the end of the document... couldn't create tables! couldn't search and replace! couldn't maintain formatting' (copilot-comm-4), and others found the Outlook summarize feature and overall NL assistant underwhelming or unused (copilot-comm-5, copilot-comm-9). This is a concrete documented failure of the claimed NL command capability, not mere skepticism. Missing for 10: independent third-party benchmarking of NL command reliability across all Office apps, and resolution of the reported Word functional gaps.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Find my budget spreadsheet” or “Show me the project plan from last month.”
- [claimed-docs] “Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
- [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
- [claimed-docs] “Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
- [community] “I use AI everyday and never found a use case for Copilot.”
Poke's entire interface is natural-language texting across WhatsApp/Apple Messages/Telegram, and its docs explicitly state integrations let it 'access information and perform actions across apps and services through natural conversation' (poke-docs-7/19), corroborated by the llms.txt description of Poke texting like a human (poke-probe-1). Missing for 10: independent hands-on user reviews confirming natural-language command reliability beyond vendor docs, and no detail on limits/edge cases of NL command parsing.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Api quality
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence of a machine-readable API spec; explicit probes for OpenAPI/swagger endpoints all returned 404, and no docs mention a public API or spec for Microsoft Copilot as an end-user product.
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
Pokenone0/10Direct probes for OpenAPI/swagger spec files all returned 404, and no documentation references a downloadable machine-readable API spec; only an llms.txt file exists, which is not an API spec.
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · round drawnMicrosoft Copilotnone0/10Microsoft Copilot is presented here as a consumer-facing AI assistant product; there is no evidence of a public versioned API, developer API reference, or documented deprecation policy for it. Probes for API/OpenAPI specs and llms.txt all return 404, confirming absence of such developer-facing documentation.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Pokenone0/10There is no evidence of API versioning scheme, changelog for breaking changes, or a documented deprecation policy; probes show no OpenAPI spec available (404s), and docs only describe basic API usage without versioning or deprecation commitments.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
Agents tasks — stories about agents tasks in this arenaAgents tasks
Stories about agents tasks in this arena
Agent mode
power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review
weight 3 · round drawnCopilot's 'Cowork' feature is explicitly described as handling 'bigger, multi-step tasks and deliver completed to-dos,' and 'Browse with Copilot' can perform multi-step actions while pausing for user approval on sensitive steps, which aligns with delegate-and-review workflows. However, these are single thin doc mentions with no independent/hands-on validation of true background/asynchronous operation, and community feedback focuses on other Copilot surfaces (Word, Outlook) being underwhelming rather than confirming Cowork's autonomous task delivery. Missing for 10: hands-on or independent evidence of a background task actually running unattended and returning a completed result, clearer scope/limits of Cowork, and confirmation this isn't just synchronous chat-assisted editing.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “You can see each step in real time and take control at any time.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
Poke's docs show it can be triggered by external events (GitHub, CI/CD) and can even delegate real-world tasks to humans (reservations, calls) and act across integrated apps 'through natural conversation,' plus the llms.txt describes it as a 'proactive AI assistant.' However, there is no explicit documentation of a structured multi-step task queue, autonomous background execution status, or a dedicated review/approval step for complex delegated tasks. Missing for 10: explicit multi-step task orchestration docs, background task status/progress tracking, and a defined 'review results' UX beyond ad-hoc chat replies.
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites
weight 3 · round to Microsoft CopilotMicrosoft documents a dedicated 'Browse with Copilot' capability that lets Copilot click, type, and navigate tabs in Edge to complete web tasks, with real-time visibility and required user confirmation for sensitive actions like purchases or bookings, plus a 'Cowork' mode for multi-step task completion. However, all supporting evidence is first-party docs with no independent/hands-on confirmation of browser-operation success, and community feedback in the pack focuses on Office-integrated Copilot rather than this browsing agent feature. Missing for 10: independent/hands-on validation of the browse-and-complete-task capability, more detail on reliability/success rate on real websites.
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “You can see each step in real time and take control at any time.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
Pokenone0/10Poke's docs describe integrations, MCP tool connections, and even outsourcing tasks to humans, but there is no evidence Poke itself drives a web browser to navigate sites or complete web-based research/tasks autonomously. missing for 10: any mention of browser automation, web navigation, or headless browsing capability.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
power-userLet the assistant see and operate applications on my computer to complete work
weight 2 · round to Microsoft CopilotMicrosoft documents 'Browse with Copilot' letting the assistant click, type, and navigate tabs directly in Edge, plus 'Cowork' for multi-step task completion and Vision for seeing images/screens, with human-in-the-loop confirmation for sensitive actions. However, this operating capability is scoped mainly to the browser and Office apps rather than general desktop application control, and community reports describe weak real-world execution (e.g., Copilot in Word failing at basic edits, Outlook integration being minimal), undercutting the strength of the claim. Missing for 10: broad OS-level/desktop app automation beyond Edge/Office, and independent hands-on validation that agentic actions reliably complete tasks.
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Copilot will ask for your attention and supervision for certain actions, such as buying an item, booking a reservation, sending an email, or…”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
Pokenone0/10Poke's evidence shows it connects to cloud services/integrations and MCP tool servers (poke-docs-7, poke-docs-19, poke-docs-3) but there is no evidence of it seeing a user's screen or directly operating local desktop applications — its automation is limited to API/webhook-based integrations and remote 'recipes,' not computer-use style control of a user's machine.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
Tasks
power-userSchedule recurring or one-off tasks that run automatically and come back to me with results
weight 2 · round drawnMicrosoft Copilotnone0/10The evidence shows Copilot can handle multi-step tasks (Cowork) and automate repetitive work, but there is no mention of scheduling recurring or one-off tasks that run automatically and return results later. Missing for 10: any documentation of a task-scheduling feature, recurrence settings, or proactive notification of completed scheduled runs.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
Pokenone0/10The evidence pack shows Poke's API/integrations for triggering messages from external events (CI/CD, monitoring) and MCP tool extensions, but nothing documents a user-facing scheduler for recurring or one-off tasks that return results later. Missing for 10: any explicit scheduling/reminder feature, recurrence configuration, or hands-on proof of a task running and reporting back autonomously.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
Apps devices — stories about apps devices in this arenaApps devices
Stories about apps devices in this arena
Apps
knowledge-workerUse full-featured official mobile apps for iOS and Android
weight 2 · round to Microsoft CopilotDocs explicitly confirm 'Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)', establishing official iOS/Android apps exist and support core connector/chat features. However, there's no first-party or hands-on evidence detailing mobile-specific feature parity (e.g., Word/Excel/PowerPoint copilots, Vision, voice mode) on the mobile apps, and community feedback focuses only on desktop/Office integration quality, not mobile experience. Missing for 10: mobile-specific feature parity details, hands-on mobile app reviews, and confirmation of full functionality (Vision, Voice, connectors) actually working within the mobile app UI.
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.”
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
Pokenone0/10Evidence shows Poke operates through existing messaging channels (Apple Messages, WhatsApp, Telegram) rather than shipping its own official iOS/Android app; no documentation or probe evidence mentions a dedicated Poke mobile app.
- [claimed-docs] “Poke is now available on Apple Messages as the first and only AI product to be verified on the platform.”
- [claimed-docs] “Poke now works with Telegram as an alternative to WhatsApp while it is temporarily unavailable (except in Italy and Brazil).”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Custom bots
power-userBuild and share custom assistants with their own instructions and knowledge
weight 2 · round to PokeMicrosoft Copilotnone0/10No evidence describes creating custom Copilot agents/assistants with custom instructions and knowledge base (like Copilot Studio agents or GPT-builder equivalents) nor sharing them with others; evidence only covers built-in Office integrations, connectors, and memory features. Missing for 10: any mention of an agent/assistant builder, custom instructions, custom knowledge upload, and sharing/publishing mechanism for user-built assistants.
Poke supports 'recipes' that can be created, published, shared via referral link, and monetized, plus MCP servers/integrations that extend its knowledge and behavior — this maps loosely to custom assistants with instructions/knowledge. However, there's no explicit documentation of defining a persistent 'assistant persona' with custom instructions in the way tools like GPTs allow; recipes appear more tool/automation-centric than persona-centric. missing for 10: explicit support for custom system-prompt/persona instructions per assistant, evidence of knowledge-base attachment beyond MCP tool integration, independent user validation of sharing custom assistants.
- [claimed-docs] “you earn revenue from MCP usage by users who install your recipe”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “Publishing a recipe: marks it Published, generates a referral/share link, makes it eligible for payouts”
- [claimed-docs] “Go to poke.com/recipes to browse all first-party and approved third-party recipes.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round to Microsoft CopilotDocs mention general automation of 'repetitive tasks' and multi-step task completion via Cowork, but there's no concrete evidence of bulk operations across many items (e.g., batch-editing many files, mass email actions, or large-scale spreadsheet manipulation). Community feedback (copilot-comm-4) reports Copilot in Word failing at basic single-document tasks like search-and-replace, casting doubt on any claim of robust bulk-item processing. missing for 10: explicit bulk/batch operation examples (e.g., mass-processing many files/rows/emails at once), independent hands-on evidence of successful bulk actions, and confirmation that Cowork or Analyst can operate at scale across many items reliably.
- [claimed-docs] “With Cowork, Copilot can also help with bigger, multi-step tasks and deliver completed to-dos.”
- [claimed-docs] “Hand off repetitive work so you can focus on what matters.”
- [claimed-docs] “A copilot can automate repetitive tasks, no coding required.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
ai-native userDefine rules that trigger actions automatically on events
weight 3 · round to PokeMicrosoft Copilotnone0/10The evidence describes Copilot responding to prompts, browsing, summarizing, and connecting to services, but there is no mention of user-defined rules or triggers that fire actions automatically on events (e.g., 'when email arrives, do X' style automation). No scheduling, event-trigger, or workflow-builder capability is documented.
Poke supports external triggers via its API (services like GitHub/CI/CD can trigger Poke) and integrations that let it act across apps, which enables event-driven automation, but there's no documented user-facing rules engine (e.g., 'if X happens, do Y' conditional automation builder) — triggers rely on third-party services calling the API rather than Poke itself defining declarative rules. missing for 10: a native rule/condition definition UI or DSL, evidence of multi-step conditional logic, and independent confirmation of reliability of triggered automations.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
ai-native userSchedule recurring jobs or workflows
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence describes scheduling recurring jobs, timers, or automated recurring workflows in Microsoft Copilot; the pack shows one-off task automation (Cowork, connectors, browse actions) but nothing about recurrence or scheduling.
Pokenone0/10No evidence describes a scheduling or recurring-job/workflow feature; docs cover API messaging, integrations, MCP servers, and recipes but nothing about setting up recurring or time-based automations. The 'proactive assistant' description in the probe snippet is too vague to confirm recurring job scheduling. missing for 10: any documentation of cron-like scheduling, recurring triggers, or persistent workflow automation.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
ai-native userVersion, review, and roll back my automations
weight 1 · round drawnMicrosoft Copilotnone0/10No evidence describes any versioning, history, review workflow, or rollback capability for Copilot's automations (e.g., Cowork, connectors, or agent tasks); evidence only covers connecting services, browsing, memory, and privacy controls. Missing for 10: version history UI, diff/review of automation changes, rollback/undo mechanism, any audit trail for automation edits.
Connectors apps — stories about connectors apps in this arenaConnectors apps
Stories about connectors apps in this arena
Connectors
power-userBrowse a directory of third-party apps and connectors and add them to the assistant
weight 2 · round to PokeDocs confirm Copilot supports 'connectors' to a small fixed list of services (OneDrive, Outlook.com, Google Drive, Gmail/Calendar/Contacts) and note these are available on Copilot.com/Mobile, but there is no evidence of a browsable directory/marketplace of third-party apps that power-users can explore and add beyond this short built-in list. missing for 10: evidence of a searchable app/connector marketplace, breadth of third-party (non-Microsoft/Google) integrations, and any independent confirmation of the browsing/add experience.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
- [claimed-docs] “Copilot can connect with the following consumer services: ... Google Drive ... Google Gmail, Calendar, Contacts”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive... Google Drive... Google Gmail, Calendar, Contacts”
Poke docs describe poke.com/recipes as a directory of first-party and approved third-party recipes/integrations that users can browse and add, plus a separate Integrations page for connecting apps/services. This matches the power-user story of browsing and adding connectors. missing for 10: independent/hands-on evidence of the directory's breadth or UX, and no confirmation of search/filtering or ratings within the directory.
- [claimed-docs] “Go to poke.com/recipes to browse all first-party and approved third-party recipes.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Webflow - Design and deploy websites visually”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers
weight 3 · round to Microsoft CopilotMicrosoft's documentation explicitly describes connecting Copilot to OneDrive, Outlook.com (email/calendar/contacts), Google Drive, and Google Gmail/Calendar/Contacts, with example queries for finding files, emails, and calendar events, indicating the assistant can search and use this data in answers. Community evidence corroborates that cross-document/data fetching works well in some contexts, though other complaints focus on unrelated feature quality issues (e.g., editing limitations) rather than disputing the connector capability itself. Missing for 10: independent hands-on verification specifically of the cloud-drive/email/calendar connector search feature (rather than in-app Office Copilot) and more detail on reliability/completeness of search results.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Find my budget spreadsheet” or “Show me the project plan from last month.”
- [claimed-docs] “Copilot can connect with the following consumer services: Microsoft OneDrive, Microsoft Outlook.com (email, calendar, and contacts), Google …”
- [claimed-docs] “Find files quickly: "Find my budget spreadsheet" or "Show me the project plan from last month."”
- [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
- [claimed-docs] “Show me emails from Sarah about the budget” or “Find my flight confirmation email.”
- [claimed-docs] “What's on my calendar for tomorrow?” or “When is my next dentist appointment?”
- [claimed-docs] “Find emails: “Show me emails from Sarah about the budget” or “Find my flight confirmation email.””
- [claimed-docs] “Check in on your calendar: “What’s on my calendar for tomorrow?” or “When is my next dentist appointment?””
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
- [community] “the way it can fetch data from across documents in 365 is really good”
Poke's docs describe a general 'Integrations' system that lets users connect apps/services (with Webflow given as the only named example) and mention an email-address feature, but no evidence names concrete cloud-drive (e.g., Google Drive), email (Gmail/Outlook), or calendar connectors, nor demonstrates search/use of such data in answers. Missing for 10: named cloud-drive integration, named email inbox integration, named calendar integration, and evidence of search/retrieval across them.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Webflow - Design and deploy websites visually”
- [claimed-docs] “You can now set up a @poke.com address to use with your primary email account in Poke.”
Files analysis — stories about files analysis in this arenaFiles analysis
Stories about files analysis in this arena
Analysis
power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files
weight 3 · round to Microsoft CopilotDocs explicitly state Copilot can 'run code to complete complex calculations and generate graphs' and the 'Analyst' feature 'analyzes data with ease,' plus Excel/Word integrations for working with attached data—covering charts and computed answers. However, there is no explicit documentation of producing downloadable files as an output of this code-execution flow, and no hands-on/community evidence corroborates this specific capability working well (community comments focus on other Office Copilot shortcomings, not code-execution). Missing for 10: explicit downloadable-file output evidence, independent/hands-on confirmation of the code-execution feature itself.
- [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
- [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
Poke's docs show it can create tables and charts from described data or shared images (poke-docs-21), but there's no evidence of an underlying code-execution environment, computed numeric answers, or generation of downloadable files. missing for 10: evidence of actual code execution/sandbox, computed-answer capability, downloadable file output.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Artifacts
knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export
weight 2 · round to Microsoft CopilotMicrosoft Copilotdisputedcontradicted4/10Microsoft's own docs claim Copilot in Word/Excel/PowerPoint can create and iteratively refine documents, spreadsheets, and presentations via chat (copilot-docs-1,2,3,16), which would let users export finished files. However, a hands-on community report directly contradicts this for Word, stating Copilot 'couldn't do anything except append to the end of the document,' couldn't create tables, search/replace, or maintain formatting (copilot-comm-4), and another user calls Outlook's summarize feature 'so bad' (copilot-comm-5). This is a concrete documented capability failure, not mere skepticism. Missing for 10: independent corroboration of successful iterative multi-turn editing, PowerPoint/Excel hands-on validation, and confirmation of clean export/formatting fidelity.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from prompt to presentation with Copilot in PowerPoint. Outline the flow, describe visuals, and generate.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “In MacOS Outlook they have a quarter inch sized bar in the main UI with just a button to summarize. It is so bad.”
Pokenone0/10Evidence shows Poke can create websites and generate tables/charts from data, but there is no evidence of creating or iteratively editing documents/presentations that can be exported (e.g. Word, PDF, PowerPoint files). Missing for 10: document creation/editing evidence, presentation creation, export functionality for standard file formats.
- [claimed-docs] “Poke can also create and deploy websites for you at yourname.poke.com.”
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Files
knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents
weight 3 · round to Microsoft CopilotMicrosoft's own docs describe multiple file-analysis capabilities—attaching data in Excel, analyzing notes in Word, finding/searching PDFs and Office documents, an 'Analyst' tool for data insight, and code execution for calculations—giving broad first-party coverage of the story. However, hands-on community reports contradict smooth real-world usability (e.g. Word Copilot 'couldn't do anything except append text... couldn't maintain formatting' and Outlook summarization deemed 'so bad'), while another user praises cross-document data-fetching, so the accuracy/quality of analysis is mixed rather than assured. Missing for 10: independent verification of analysis accuracy on complex spreadsheets/PDFs, and resolution of the documented Word-editing/formatting failures.
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel.”
- [claimed-docs] “Go from raw numbers to real insight—use Analyst to help analyze data with ease.”
- [claimed-docs] “Turn raw data into clear insights with Copilot in Excel. Detail your task, attach data, and tweak via chat.”
- [claimed-docs] “Find Word documents about vacation plans” or “Show me all PDFs.”
- [claimed-docs] “Copilot can also run code to complete complex calculations and generate graphs.”
- [community] “I subscribed for a trial month... Oh boy! It couldn't do anything except append to the end of the document. It couldn't create tables! It co…”
- [community] “the way it can fetch data from across documents in 365 is really good”
The only relevant evidence is that Poke can 'extract and visualize' data from shared images of spreadsheets to create tables/charts, which is a narrow slice of the story. There is no documentation of direct document or PDF upload, parsing, or accurate content analysis for knowledge-worker use cases. Missing for 10: explicit PDF/document upload support, evidence of accuracy on structured/text-heavy files, and any hands-on validation of analysis quality.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Memory context — stories about memory context in this arenaMemory context
Stories about memory context in this arena
Memory
power-userHave the assistant remember relevant context from previous chats and apply it in new conversations
weight 3 · round to Microsoft CopilotFirst-party docs confirm a memory feature: Copilot can store facts users ask it to remember and use that context in future responses, and can proactively surface suggestions based on past queries and memory (copilot-docs-32, copilot-docs-33). However, this is opt-in/explicit fact storage rather than full automatic context carry-over, and there is no independent/hands-on evidence confirming it works reliably across conversations. missing for 10: independent verification of cross-conversation recall, detail on scope/limits of automatic memory use, and confirmation it isn't just facts explicitly asked to be remembered.
- [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
Docs mention Poke's Memory as a concept tied to account merging (poke-docs-20), implying persistent memory exists across the assistant, but there's no detailed documentation of how memory is captured, retained, or applied across separate conversations, nor independent confirmation of its effectiveness. Missing for 10: dedicated memory documentation explaining retention/retrieval mechanics, examples of cross-chat context recall, and independent/hands-on verification that it works reliably.
- [claimed-docs] “This keeps Poke's Memory, Recipes, and Integrations from the selected account, and your messaging channels ... will be connected to it.”
power-userSet persistent custom instructions and preferences that shape every response
weight 1 · round to Microsoft CopilotDocs confirm a memory feature where Copilot can store facts users ask it to remember and use them to personalize future responses and suggestions, plus controls to view/delete memory (copilot-docs-32, copilot-docs-33, copilot-docs-38). However there is no dedicated 'custom instructions' setting described (unlike explicit persona/tone controls), and no independent/hands-on evidence confirming these stored facts consistently shape *every* response. Missing for 10: explicit custom-instructions UI documentation, hands-on confirmation that memory reliably influences all responses, and community corroboration of the feature's effectiveness.
- [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [claimed-docs] “opt out of use of your conversation activity for model training”
The docs mention a 'Memory' feature tied to a user's account (carried over when merging accounts), implying some persistent context storage, but there is no documentation of a dedicated custom-instructions/preferences setting that explicitly shapes every response. Missing for 10: explicit UI/API for setting persistent custom instructions, examples of how such preferences influence responses, and independent confirmation of this behavior.
- [claimed-docs] “This keeps Poke's Memory, Recipes, and Integrations from the selected account, and your messaging channels ... will be connected to it.”
Projects
knowledge-workerOrganize related chats and files into a project or space that shares context and instructions
weight 2 · round drawnMicrosoft Copilotnone0/10The evidence pack shows Copilot memory (storing facts), connectors to files/email/calendar, and per-app integrations, but nowhere describes a 'project' or 'space' concept that lets a user group related chats and files together with shared instructions/context, unlike competitors' project/space features. Community feedback focuses on integration quality issues, not on organizational/workspace features. Missing for 10: any documented 'project', 'space', 'workspace', or chat-grouping feature with shared custom instructions and file scoping.
- [claimed-docs] “Copilot can store specific facts users request it to remember, allowing it to generate more relevant responses and suggestions based on that…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
Multimodal — stories about multimodal in this arenaMultimodal
Stories about multimodal in this arena
Images
knowledge-workerGenerate and edit images from natural-language prompts
weight 2 · round drawnMicrosoft Copilotnone0/10The evidence pack only shows Copilot's 'Vision' feature for analyzing and understanding images (copilot-docs-30), not generating or editing images from text prompts; no docs, community, or probe evidence mentions an image-generation or image-editing capability (e.g., a Designer/DALL·E-style feature).
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them
weight 2 · round drawnDocs confirm Copilot has a 'Vision' capability to analyze images and photos ([copilot-docs-30]), directly supporting the story, but this is a single first-party mention with no elaboration on screenshot-specific use cases or accuracy, and no independent/hands-on evidence corroborates real-world interpretation quality. Missing for 10: detailed documentation on screenshot vs photo handling, accuracy benchmarks, and independent/community verification of correct image interpretation.
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
Poke's release notes explicitly state it can 'share images of existing data (like spreadsheets) for Poke to extract and visualize,' showing some image-interpretation capability, but this is limited to structured data extraction rather than general photo/screenshot understanding across varied content. Missing for 10: evidence of accurate interpretation of arbitrary photos/screenshots (e.g., UI screenshots, handwritten notes, general scenes), independent hands-on verification of accuracy, and any first-party documentation describing general vision/OCR capability beyond the spreadsheet example.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Voice
knowledge-workerHave a natural, real-time voice conversation with the assistant
weight 2 · round to Microsoft CopilotMicrosoft's transparency docs explicitly describe Copilot Voice mode: users send natural-language voice prompts and receive audio responses, with citations shown in conversation transcripts, confirming real-time spoken interaction. Missing for 10: independent/hands-on corroboration of voice mode's real-time quality, latency, or interruption handling, and no community evidence specifically validates or disputes the voice experience.
- [claimed-docs] “If users send prompts in natural language voice within the Copilot Voice mode, they will receive audio responses.”
- [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userDo everything through the API that I can do in the UI
weight 2 · round to PokeMicrosoft Copilotnone0/10No evidence of a public API exposing Copilot's UI capabilities (chat, connectors, Word/Excel/PowerPoint copilots) programmatically; probes for OpenAPI/docs endpoints returned 404s, and all evidence describes UI/chat-only functionality. Missing for 10: any documented API/SDK, endpoint parity documentation, or third-party confirmation of programmatic access to Copilot features.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
- [claimed-docs] “Prompt Copilot with the task, add and upload notes, then refine in the chat—all with Copilot in Word.”
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
Poke exposes a documented API for sending messages programmatically and triggering it from external systems (poke-docs-1, poke-docs-2), plus an MCP server/tunnel mechanism for extending tools (poke-docs-3/4/16). However, there's no evidence of API parity for major UI capabilities like managing integrations, recipes, human-task requests, website deployment, or memory/account management, and no public OpenAPI/spec was found (poke-probe-2, poke-probe-3 both 404). missing for 10: API coverage for integrations/recipes/human-tasks/website-deploy features, published OpenAPI spec, independent confirmation of API-UI parity.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [claimed-docs] “npx poke@latest tunnel http://localhost:3000/mcp -n "Local Dev MCP"”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
ai-native userExport all of my data in open formats and leave
weight 3 · round drawnMicrosoft Copilotnone0/10No evidence of a data export/portability feature or open-format export mechanism; docs only mention deleting conversation history, not exporting it, and probes for machine-readable docs/APIs 404. There is nothing showing users can export chats, memory, or generated content in open formats to leave the platform.
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
Pokenone0/10No evidence of any data export feature or open-format data portability in Poke's docs; the pack covers messaging API, MCP servers, integrations, and account merging but nothing about exporting user data (memory, conversation history, recipes) in open formats or account closure/data takeout.
ai-native userRead the product's source under an open license
weight 2 · round drawnMicrosoft Copilotnone0/10Microsoft Copilot is closed-source proprietary software; no evidence indicates any open-license source availability, and probes for docs/API artifacts returned 404s. This is an applicable axis (a product could conceivably be open-sourced) but no evidence supports it, so verdict is none rather than na.
- [probe] “PROBE llms.txt: HTTP 404 at https://support.microsoft.com/llms.txt”
- [probe] “PROBE docs-md: HTTP 404 at https://support.microsoft.com/en-us/copilot.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://support.microsoft.com/openapi.json, https://support.microsoft.com/swagger.json, https://supp…”
ai-native userSelf-host the core product
weight 3 · round drawnMicrosoft Copilotnone0/10Microsoft Copilot is a cloud-hosted SaaS product with no evidence of any self-hosted or on-premises deployment option; all documentation describes it as a hosted service (Copilot.com, Microsoft 365 cloud integration, Edge browser actions) with no self-hosting mechanism mentioned.
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userChoose where my data is stored (region/residency)
weight 2 · round drawnMicrosoft Copilotnone0/10No evidence in the pack mentions data residency, regional storage controls, or any user-facing setting to choose where data is stored; the docs cover features, connectors, and privacy opt-outs but not geographic data residency choices.
ai-native userPrevent my data from being used to train AI models
weight 3 · round to Microsoft CopilotMicrosoft's privacy FAQ explicitly states users can opt out of having conversation activity used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38), giving a documented mechanism to prevent training use. However, community reports (copilot-comm-6, copilot-comm-1) show real confusion about scope — a user working in Word had no clear indication whether their document content was being fed to training, and commenters note the opt-out/behavior differs between standalone Copilot chat and 365-integrated Copilot, undermining confidence that the control is comprehensive or transparent across all surfaces. missing for 10: independent verification that opt-out actually blocks training across all integrated products (Word/Excel/Outlook), clearer UI-level opt-out controls inside Office apps, and confirmation the toggle covers enterprise/connector data sources.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “Train our generative AI models to create a better experience for you and others.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
ai-native userControl data retention and deletion
weight 2 · round to Microsoft CopilotDocs confirm users can delete individual conversations or entire history and opt out of conversation data being used for model training, giving basic retention/deletion control for the standalone Copilot chat experience (copilot-docs-35, copilot-docs-38). However, community evidence notes this applies only to the standalone Copilot app/site, not to Copilot embedded in Office apps like Word, where a user reported uncertainty about whether their document was being auto-pushed for training with no visible deletion controls (copilot-comm-1, copilot-comm-6). Missing for 10: enterprise/Office-integrated retention controls, clarity on data retention duration before deletion, and independent verification that deletion actually removes data from training pipelines.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
ai-native userOpt out of telemetry and usage tracking
weight 2 · round to Microsoft CopilotMicrosoft Copilotdisputedcontradicted5/10Microsoft's own privacy FAQ states users can opt out of having conversation activity used for model training and can delete individual or entire conversation history (copilot-docs-35, copilot-docs-38), which is a real opt-out mechanism for the standalone Copilot chat. However, community reports directly contradict this for Copilot as embedded in Office apps: a Word for Mac user reports 'no way of turning it off' and 'no opt-out mechanism' (copilot-comm-3), and another user reports uncertainty over whether their document was being auto-pushed to Copilot for training with no visible control (copilot-comm-6) — and copilot-comm-1 clarifies the training opt-out only applies to the standalone chat app, not the Office-integrated Copilot surfaces. Missing for 10: a unified, product-wide opt-out control covering all Copilot surfaces (Office, Edge, Windows), independent verification that the training opt-out actually stops data use, and clarity on telemetry beyond training data.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
- [community] “Hate that if you use Word for Mac, you now have Copilot next to your cursor with no way of turning it off. I just want to use Word... Now th…”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
Research answers — stories about research answers in this arenaResearch answers
Stories about research answers in this arena
Research
knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report
weight 3 · round to Microsoft CopilotCopilot's 'Researcher' agent is documented as designed to 'find, synthesize, and understand information faster' and Copilot's web-grounded answers include hyperlinked citations, which maps to the deep-research/cited-report story, but there is no detail on autonomous multi-source search depth, report format, or any hands-on/independent validation of report quality. Missing for 10: documentation of the autonomous multi-step search process, description of report output structure, and independent corroboration of research depth/accuracy.
- [claimed-docs] “Find, synthesize, and understand information faster with Researcher.”
- [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
- [claimed-docs] “Copilot may proactively generate personalized research suggestions for users based on things like past research queries and Copilot memory.”
Pokenone0/10Poke's evidence pack covers messaging integrations, MCP tool extensibility, recipes, and various assistant features, but nothing describes an autonomous multi-source deep research capability that returns a cited report. No mention of web search breadth, citation generation, or research-report output.
knowledge-workerGet answers grounded in current web results with citations back to the sources
weight 2 · round to Microsoft CopilotDocs explicitly state Copilot grounds responses in high-ranking web content and provides hyperlinked citations after generated responses, directly matching the story; this is corroborated by broader documentation on research/answer features (Researcher, ask questions and get answers fast). Missing for 10: independent hands-on verification of citation accuracy/quality and no community evidence specifically testing web-grounded citation behavior.
- [claimed-docs] “This means that Copilot centers its response on high-ranking content from the web and provides hyperlinked citations following generated tex…”
- [claimed-docs] “Ask questions and get answers fast.”
- [claimed-docs] “Find, synthesize, and understand information faster with Researcher.”
Trust controls — stories about trust controls in this arenaTrust controls
Stories about trust controls in this arena
Data controls
knowledge-workerExport my complete chat history and account data
weight 1 · round drawnMicrosoft Copilotnone0/10Evidence shows users can delete individual conversations or entire history (copilot-docs-38) and opt out of training use (copilot-docs-35), but there is no mention of an export/download feature for complete chat history or account data as required by the story.
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [claimed-docs] “opt out of use of your conversation activity for model training”
knowledge-workerControl whether my conversations are used to train models
weight 3 · round to Microsoft CopilotMicrosoft's own docs confirm a control exists: users can opt out of conversation activity being used for model training and can delete conversation history (copilot-docs-35, copilot-docs-36, copilot-docs-38). However, community evidence indicates confusion about scope—one commenter notes the opt-out applies to standalone Copilot chat/app, not to Copilot embedded in Office apps like Word (copilot-comm-1), and another user reports genuine uncertainty whether their Word document was being used for training with no clear indication (copilot-comm-6). Missing for 10: clear unified documentation covering training-data opt-out scope across all Copilot surfaces (Office-integrated vs standalone), and independent verification that the opt-out setting functions as described.
- [claimed-docs] “opt out of use of your conversation activity for model training”
- [claimed-docs] “Train our generative AI models to create a better experience for you and others.”
- [claimed-docs] “you can delete individual conversations or your entire conversation history at any time”
- [community] “To be clear this is only for the standalone Copilot chat or app and website; not for the 'Copilot' services integrated into Office 365 etc.”
- [community] “When CoPilot showed up in my Word, I was writing a pitch doc... It made me realize I didn't know whether this doc was getting auto-pushed to…”
Pokenone0/10No evidence pack item addresses model-training data usage or opt-out controls for conversation data; documentation covers integrations, MCP, pricing, and release notes but nothing about training data policy. Missing for 10: any privacy/data-training policy page, opt-out toggle, or enterprise data-use agreement.
Not comparable on these axes
ai-native userRun the product headlessly / in CI for automation
weight 2 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is a consumer/office chat assistant product, not a developer tool or API/CLI designed for headless automation or CI pipelines; there's no evidence of any API, CLI, or SDK for scripted/headless invocation. This axis is a category mismatch for this product type.
Poke's docs explicitly state its API can be called from scripts, CI/CD pipelines, and monitoring tools to trigger messages programmatically, which supports headless/automation use (poke-docs-1, poke-docs-2). However, there's no evidence of a full headless run mode (e.g., batch execution, structured output for CI parsing) and probes show no OpenAPI/swagger spec is exposed, suggesting the API's automation surface is thin and undocumented beyond message-sending. Missing for 10: independent/hands-on CI integration examples, a public OpenAPI schema, and evidence of structured/machine-readable responses needed for reliable CI pipelines.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
ai-native userConnect an agent via an official MCP server
weight 3 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is itself an AI assistant/agent; the evidence only shows it acting as a client connecting to other services (OneDrive, Gmail, etc.) rather than exposing itself as an MCP server for other agents. Per the agent-role exception, this axis does not apply unless there's evidence of Copilot running as an MCP server, which is absent here.
- [claimed-docs] “Copilot can connect with the following consumer services: * Microsoft OneDrive * Microsoft Outlook.com (email, calendar, and contacts) …”
- [claimed-docs] “Copilot connectors are currently available on Copilot.com and on Copilot Mobile (iOS and Android)”
Poken/aPoke is itself an AI agent product; all MCP evidence (poke-docs-3,4,16) shows Poke acting as an MCP *client*—connecting to or tunneling external MCP servers to extend its own capabilities—not Poke exposing an official MCP server endpoint for other agents to connect to. Per the agent-role rule, this client-side capability does not make the 'official MCP server' axis applicable.
ai-native userExplore an interactive API reference with runnable examples
weight 2 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is a consumer/productivity AI assistant, not a developer API/SDK product, so the concept of an interactive API reference with runnable examples is a category error for this axis.
Pokenone0/10No evidence of an interactive API reference or runnable examples; probes for OpenAPI/Swagger specs and docs.md all returned 404, and only basic prose docs about the messaging API exist.
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
ai-native userTest against a sandbox environment without touching production data
weight 1 · not comparableMicrosoft Copilotn/aMicrosoft Copilot is a consumer/productivity AI assistant, not a developer platform with sandbox/test environments distinct from production data; no evidence pack content addresses sandbox testing concepts at all, and this axis is a category error for this product type.
power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen
weight 2 · not comparableMicrosoft Copilotnone0/10The evidence pack covers web/Office integrations, browser automation (Edge), and mobile/iOS/Android connectors, but nowhere documents an official standalone desktop app with OS-level keyboard shortcuts or the ability to see/interact with the user's screen content outside a browser. Vision (copilot-docs-30) is limited to photo/image analysis, not live screen capture, and Browse with Copilot (copilot-docs-9, -15, -24) is scoped to actions inside Microsoft Edge, not OS-wide screen access.
- [claimed-docs] “Browse with Copilot lets Copilot perform actions directly in your Microsoft Edge browser, such as clicking, typing, and navigating tabs.”
- [claimed-docs] “You can see each step in real time and take control at any time. All actions run locally in your browser, ensuring full visibility and contr…”
- [claimed-docs] “You can see each step in real time and take control at any time.”
- [claimed-docs] “See and understand. Use Vision to analyze images, get insights from photos, and search visually.”
team-adminManage members, permissions, and data policies for my organization's workspace
weight 2 · not comparableMicrosoft Copilotnone0/10The evidence pack covers only individual/consumer Copilot features (writing, spreadsheets, browsing, memory, privacy opt-outs for personal conversations) with no mention of team/workspace admin controls such as member management, role-based permissions, or organizational data policies. Missing for 10: admin console documentation, member/role management, org-wide data governance policies, and any evidence of a team-admin experience.
Poken/aPoke is a consumer personal AI assistant (individual account, messaging channels, integrations, recipes) with no evidence of organizational/team workspace concepts like member management, role-based permissions, or org-wide data policies. This is a category mismatch rather than a missing feature.