Poke vs Martin
Martin wins · 10–12 (19 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round to MartinA live llms.txt file is confirmed via direct probe (HTTP 200) with actual agent-oriented content describing Poke, and Poke also maintains structured docs pages that agents/tools can be pointed at. missing for 10: no docs.md or openapi.json fallback (both 404), and no independent report of an agent successfully consuming llms.txt end-to-end.
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
martin-probe-1 confirms a live llms.txt at docs.trymartin.com/llms.txt returning HTTP 200 with a structured index of docs, and the .md-suffixed doc URLs throughout the evidence pack (e.g. martin-docs-1 through martin-docs-24) show agent-oriented markdown documentation is directly accessible. Missing for 10: no independent/hands-on confirmation that an agent successfully consumed llms.txt to complete a task.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.trymartin.com/llms.txt # Martin ## Docs - [Introduction](https://docs.trymartin.com/introduction.…”
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · round to PokePoke's docs explicitly describe MCP server support, with CLI commands to tunnel local MCP servers and add remote ones ('poke mcp add'), plus a recipe/marketplace ecosystem for sharing MCP-based tools. This is first-party documented and corroborated by a probe confirming the docs page exists, though there's no independent hands-on report of the MCP integration actually working. Missing for 10: independent/hands-on verification of MCP tool usage in practice, and more detail on tool invocation reliability.
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [claimed-docs] “npx poke@latest tunnel http://localhost:3000/mcp -n "Local Dev MCP"”
- [claimed-docs] “you earn revenue from MCP usage by users who install your recipe”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [probe] “official MCP server documented at https://poke.com/docs/mcp-servers”
Martinnone0/10Martin's docs describe a fixed set of built-in integrations (calendar, email, Slack, todos, notes) but there is no mention of MCP protocol support or any way for users to plug in arbitrary MCP servers for Martin to use as tools.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
ai-native userDrive the product through a documented public API
weight 3 · round to PokePoke documents a public API for sending messages programmatically and integrating with external triggers (CI/CD, monitoring tools), plus CLI/MCP tooling for extending functionality, showing genuine programmatic access. However, no OpenAPI/Swagger spec or formal API reference was found (404s on standard discovery paths), so the API's documentation depth and completeness are unclear. Missing for 10: a full API reference/spec (OpenAPI schema), authentication details, rate limits, and independent developer corroboration of building against the API.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
Martinnone0/10Martin is a personal-assistant product controlled via chat/email/Slack/phone interfaces, but there is no evidence of a documented public API for developers to programmatically drive it — probes for OpenAPI/Swagger specs all returned 404. missing for 10: a documented public API, SDK, or endpoint reference; any developer-facing API authentication or usage docs.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · round drawnPokenone0/10Evidence shows Poke supports API access, integrations, and MCP servers, but there's no mention of scoped or least-privilege API credential/key issuance for agents — no API key management, permission scoping, or token-based access control documentation. The prompt-injection incident (poke-comm-1) raises security concerns but is unrelated to credential scoping specifically.
Martinnone0/10Martin is a personal assistant that connects to full-access integrations (email, calendar, Slack) but there is no evidence of scoped or least-privilege credential issuance, API key management, or granular permissioning for agent access — no OpenAPI/API docs even exist per probe results.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
- [claimed-docs] “Once connected, you can tell Martin to read, draft, and reply to emails on your behalf.”
- [claimed-docs] “Once connected, you can tell Martin to read, send, and reply to Slack messages on your behalf.”
ai-native userBuild against official SDKs
weight 2 · round to PokePoke exposes a documented API for sending messages programmatically and an official CLI (`npx poke@latest`) for managing MCP servers and recipes, which developers can build against, but there is no evidence of dedicated official SDK packages (e.g., Python/JS client libraries) — probes for OpenAPI/swagger specs and docs.md all returned 404, suggesting no formal SDK artifacts beyond the CLI/API docs. missing for 10: language-specific SDK packages, published OpenAPI/schema spec, independent developer corroboration of SDK usage.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
Martinnone0/10Martin's evidence pack covers only end-user integrations (calendar, email, Slack, etc.) and consumer interfaces, with no mention of an SDK, API, or developer library; probes for an OpenAPI/Swagger spec all returned 404s, indicating no public API/SDK surface exists to build against.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
Agentic features
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · round to MartinPoke can extract and visualize data from shared images/spreadsheets into tables and charts, and integrations let it access and act on connected app data conversationally, which implies some data-driven insight generation. However, there's no explicit documentation of proactive AI-generated insights, trend analysis, or suggestions surfaced from a user's own accumulated data/history. missing for 10: dedicated insights/suggestions feature documentation, evidence of proactive analysis of user data patterns, independent/hands-on confirmation of this capability.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
Martin generates daily/weekly briefings synthesized from your calendar and inbox data, proactively drafts emails, and triages/labels emails with follow-up suggestions—all forms of AI-generated insights/suggestions surfaced inside the product. However, these are framed as autonomous actions rather than an explicit 'insights' or analytics layer, and there's no dedicated dashboard-style insight generation from broader personal data. Missing for 10: no independent/hands-on evidence corroborating quality of the 'insight' content itself, and no explicit analytics/trend-surfacing feature distinct from task-execution suggestions.
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
ai-native userSet up automations that run autonomously in the background
weight 2 · round to MartinPoke's docs show building blocks for automation—an API that external tools (CI/CD, monitoring) can call to trigger Poke, and a 'recipes' system that can be created and published—plus positioning as a 'proactive AI assistant.' However there is no explicit documentation of scheduled/autonomous background jobs running without an external trigger or user prompt. missing for 10: documented scheduling/cron-like triggers, evidence of recipes running unattended in the background, independent confirmation of autonomous execution.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “Publishing a recipe: marks it Published, generates a referral/share link, makes it eligible for payouts”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Martin's docs describe multiple always-on background automations—daily/weekly briefings, proactive email drafting, email triage, wake-up calls, cc-to-schedule meeting booking, and custom multi-step shortcuts—all of which run without direct user prompting, and community reports (e.g., using Martin as a persistent background agent for todos) corroborate real autonomous use. Missing for 10: independent verification of scheduling/configuration UI for these background jobs and long-term reliability data beyond one HN comment about failure rates improving.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round drawnPoke IS the built-in AI assistant itself — users delegate tasks via natural conversation, integrations, MCP tools, and even real-human task execution (reservations, calls, deploying websites), all documented in first-party docs. Missing for 10: independent hands-on validation of task delegation beyond the security prompt-injection incident, which is off-topic here.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [claimed-docs] “Poke can also create and deploy websites for you at yourname.poke.com.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Martin IS the built-in AI assistant, and users delegate tasks to it across calendar, email, Slack, reminders, todos, notes, and multi-step shortcuts via chat, phone, SMS, email, or Slack, with hands-on community accounts confirming real task delegation and reliability improvements. missing for 10: independent quality/reliability benchmarking beyond anecdotal HN comments, and no evidence of failure-mode transparency or task-success metrics.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [community] “I’m impressed. I’ll probably cancel ChatGPT Pro subscription and switch to this... it’s handling some complicated requests correctly the fir…”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
ai-native userOperate the product with natural-language commands
weight 2 · round drawnPoke's entire interface is natural-language texting across WhatsApp/Apple Messages/Telegram, and its docs explicitly state integrations let it 'access information and perform actions across apps and services through natural conversation' (poke-docs-7/19), corroborated by the llms.txt description of Poke texting like a human (poke-probe-1). Missing for 10: independent hands-on user reviews confirming natural-language command reliability beyond vendor docs, and no detail on limits/edge cases of NL command parsing.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Martin is explicitly designed around natural-language commands across calendar, email, Slack, reminders, todos, notes, shortcuts, and phone/SMS interfaces, with docs and taglines like 'Text Jon my arrival time' or 'Cc Martin on an email to schedule a meeting' showing conversational control, and community feedback (HN) corroborates real usage of natural-language task delegation. missing for 10: independent hands-on benchmarking of NL command breadth/accuracy beyond anecdotal HN praise, and no formal API/spec confirming NLU robustness.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you when the time comes.”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [claimed-docs] “Text Jon my arrival time.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [community] “I’m impressed. I’ll probably cancel ChatGPT Pro subscription and switch to this... it’s handling some complicated requests correctly the fir…”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
Api quality
ai-native userExplore an interactive API reference with runnable examples
weight 2 · round drawnPokenone0/10No evidence of an interactive API reference or runnable examples; probes for OpenAPI/Swagger specs and docs.md all returned 404, and only basic prose docs about the messaging API exist.
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
Martinnone0/10Martin is a personal assistant product with docs pages but no evidence of any interactive API reference or runnable examples; probes explicitly show no OpenAPI/swagger spec found at any candidate path. missing for 10: interactive API reference UI, runnable code examples, OpenAPI spec availability.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round drawnPokenone0/10Direct probes for OpenAPI/swagger spec files all returned 404, and no documentation references a downloadable machine-readable API spec; only an llms.txt file exists, which is not an API spec.
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Martinnone0/10Martin is a personal assistant product, not a developer API platform, but the axis of publishing a machine-readable API spec still applies as a fair question; the probe explicitly checked all standard OpenAPI/swagger paths and found only 404s, with no evidence of any downloadable spec.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · round drawnPokenone0/10There is no evidence of API versioning scheme, changelog for breaking changes, or a documented deprecation policy; probes show no OpenAPI spec available (404s), and docs only describe basic API usage without versioning or deprecation commitments.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
Martinnone0/10Martin is a personal-assistant product with no evidence of any public API, versioning scheme, or deprecation policy; the openapi probe returned 404 on all candidate paths and no docs mention API versioning. missing for 10: any public API reference, version numbers, changelog, deprecation policy documentation.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
Agents tasks — stories about agents tasks in this arenaAgents tasks
Stories about agents tasks in this arena
Agent mode
power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review
weight 3 · round to MartinPoke's docs show it can be triggered by external events (GitHub, CI/CD) and can even delegate real-world tasks to humans (reservations, calls) and act across integrated apps 'through natural conversation,' plus the llms.txt describes it as a 'proactive AI assistant.' However, there is no explicit documentation of a structured multi-step task queue, autonomous background execution status, or a dedicated review/approval step for complex delegated tasks. Missing for 10: explicit multi-step task orchestration docs, background task status/progress tracking, and a defined 'review results' UX beyond ad-hoc chat replies.
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Martin's docs describe multiple background/autonomous capabilities (proactive email drafts, email triage with follow-up actions, cc-to-schedule meeting booking, custom multi-step shortcuts, daily briefings) that match delegating a task for autonomous background work with results delivered back to the user, and community posts corroborate real usage of the cloud-based agent for ongoing tasks (todos) across sessions. However, evidence doesn't clearly show a distinct 'review before finalizing' step for these autonomous actions (e.g., whether drafts are held for approval vs. auto-sent), and independent hands-on validation of the full delegate→work→review loop is thin. Missing for 10: explicit review/approval workflow evidence, and richer independent hands-on accounts of multi-step autonomous task completion.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites
weight 3 · round drawnPokenone0/10Poke's docs describe integrations, MCP tool connections, and even outsourcing tasks to humans, but there is no evidence Poke itself drives a web browser to navigate sites or complete web-based research/tasks autonomously. missing for 10: any mention of browser automation, web navigation, or headless browsing capability.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Poke can now bring in real people to take on tasks with a human touch - restaurant reservations, phone calls, placing orders, booking rides,…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
Martinnone0/10Martin's documented capabilities cover calendar, email, Slack, notes, reminders, todos, and search-engine lookups, but nothing in the evidence describes it operating a web browser, navigating websites, or completing multi-step tasks on arbitrary sites on the user's behalf.
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
power-userLet the assistant see and operate applications on my computer to complete work
weight 2 · round to MartinPokenone0/10Poke's evidence shows it connects to cloud services/integrations and MCP tool servers (poke-docs-7, poke-docs-19, poke-docs-3) but there is no evidence of it seeing a user's screen or directly operating local desktop applications — its automation is limited to API/webhook-based integrations and remote 'recipes,' not computer-use style control of a user's machine.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
Martin can act inside specific applications via integrations (calendar, email, Slack, notes, to-dos) rather than through general screen/GUI-level control of arbitrary desktop apps — it operates named services via API-like connections, not a computer-use style visual agent. A desktop app exists (martin-comm-4) but evidence only shows it syncing to-dos, not controlling arbitrary programs. Missing for 10: evidence of generic screen/vision-based computer control, ability to operate arbitrary (non-integrated) applications, and independent hands-on proof of this broader 'operate any app' capability.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
Tasks
power-userSchedule recurring or one-off tasks that run automatically and come back to me with results
weight 2 · round to MartinPokenone0/10The evidence pack shows Poke's API/integrations for triggering messages from external events (CI/CD, monitoring) and MCP tool extensions, but nothing documents a user-facing scheduler for recurring or one-off tasks that return results later. Missing for 10: any explicit scheduling/reminder feature, recurrence configuration, or hands-on proof of a task running and reporting back autonomously.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
Martin supports recurring background tasks (daily/weekly briefings, wake-up calls, email triage) and one-off scheduled reminders that ping the user via chosen interface, matching the core of the story. However, there's no unified 'task scheduler' concept with arbitrary custom recurring workflows beyond the specific built-in background tasks listed, and no independent verification of reliability for scheduled/recurring runs. missing for 10: evidence of general-purpose custom recurring task scheduling (not just fixed briefings/wake-up-calls), independent hands-on confirmation of reminder/briefing reliability, and any dashboard/management UI for viewing scheduled tasks.
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you when the time comes.”
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
Apps devices — stories about apps devices in this arenaApps devices
Stories about apps devices in this arena
Apps
knowledge-workerUse full-featured official mobile apps for iOS and Android
weight 2 · round drawnPokenone0/10Evidence shows Poke operates through existing messaging channels (Apple Messages, WhatsApp, Telegram) rather than shipping its own official iOS/Android app; no documentation or probe evidence mentions a dedicated Poke mobile app.
- [claimed-docs] “Poke is now available on Apple Messages as the first and only AI product to be verified on the platform.”
- [claimed-docs] “Poke now works with Telegram as an alternative to WhatsApp while it is temporarily unavailable (except in Italy and Brazil).”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Martinnone0/10Martin's docs describe channel-based access (phone, SMS, WhatsApp, email, Slack, desktop) but no evidence of dedicated, full-featured native iOS/Android apps; a community comment explicitly asks 'I would try this if it had Android support! Is that planned?' indicating no Android app exists, and no iOS app is mentioned anywhere.
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “I would try this if it had Android support! Is that planned?”
Custom bots
power-userBuild and share custom assistants with their own instructions and knowledge
weight 2 · round to PokePoke supports 'recipes' that can be created, published, shared via referral link, and monetized, plus MCP servers/integrations that extend its knowledge and behavior — this maps loosely to custom assistants with instructions/knowledge. However, there's no explicit documentation of defining a persistent 'assistant persona' with custom instructions in the way tools like GPTs allow; recipes appear more tool/automation-centric than persona-centric. missing for 10: explicit support for custom system-prompt/persona instructions per assistant, evidence of knowledge-base attachment beyond MCP tool integration, independent user validation of sharing custom assistants.
- [claimed-docs] “you earn revenue from MCP usage by users who install your recipe”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “Publishing a recipe: marks it Published, generates a referral/share link, makes it eligible for payouts”
- [claimed-docs] “Go to poke.com/recipes to browse all first-party and approved third-party recipes.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
Martinnone0/10Martin is a personal AI assistant with fixed integrations (calendar, email, Slack, todos, notes, reminders) and shortcuts, but there is no evidence of a feature to build a custom assistant with its own distinct instructions/persona and knowledge base, nor any sharing mechanism for such an assistant. missing for 10: custom assistant creation with configurable instructions/persona, custom knowledge base attachment, and sharing/publishing of a built assistant.
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round to MartinPokenone0/10Evidence shows Poke can message, integrate apps, and run recipes/MCP tools, but nothing describes performing bulk operations across many items at once (e.g., batch processing, multi-item automation loops); this remains unevidenced.
Martin's docs show a few multi-item behaviors — e.g. forwarding an email with several events and having 'all of them' added to the calendar (martin-docs-23), and automatic email labeling/triage across an inbox (martin-docs-11) — which imply some batch-like processing, but there is no explicit bulk-operations feature (e.g. batch todo updates, mass note edits, multi-item scheduling command) described anywhere in the docs. missing for 10: explicit bulk-action tooling/API for operating on many items at once, first-party documentation of bulk operations, and independent confirmation of bulk-scale reliability.
- [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
ai-native userDefine rules that trigger actions automatically on events
weight 3 · round to MartinPoke supports external triggers via its API (services like GitHub/CI/CD can trigger Poke) and integrations that let it act across apps, which enables event-driven automation, but there's no documented user-facing rules engine (e.g., 'if X happens, do Y' conditional automation builder) — triggers rely on third-party services calling the API rather than Poke itself defining declarative rules. missing for 10: a native rule/condition definition UI or DSL, evidence of multi-step conditional logic, and independent confirmation of reliability of triggered automations.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
Martin ships several automatic, event-triggered behaviors (email triage that auto-labels and follows up, cc-to-schedule meeting creation, forwarded-email calendar parsing, proactive drafts, wake-up calls, briefings) which act like predefined automation rules, and 'custom shortcuts' let users define multi-step action sequences. However, there's no evidence of a general user-defined rule/trigger engine (e.g., 'if email from X arrives then do Y' configurable conditions) — the automations shown are fixed built-in behaviors rather than arbitrary user-authored event rules. Missing for 10: a documented custom rule/condition builder, evidence of arbitrary event-trigger definitions beyond built-in background tasks, and independent confirmation these automations fire reliably in practice.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
ai-native userSchedule recurring jobs or workflows
weight 2 · round to MartinPokenone0/10No evidence describes a scheduling or recurring-job/workflow feature; docs cover API messaging, integrations, MCP servers, and recipes but nothing about setting up recurring or time-based automations. The 'proactive assistant' description in the probe snippet is too vague to confirm recurring job scheduling. missing for 10: any documentation of cron-like scheduling, recurring triggers, or persistent workflow automation.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [probe] “PROBE llms.txt: HTTP 200 at https://poke.com/llms.txt # Poke > Poke is the proactive AI assistant on Apple Messages, WhatsApp, Telegram, an…”
Martin ships several built-in recurring background jobs — daily/weekly briefings, daily wake-up calls, and automatic email triage — which are documented recurring workflows, and shortcuts allow custom multi-step actions. However, there's no evidence of a general-purpose, user-defined recurring job scheduler (e.g., custom cadence for arbitrary tasks/workflows beyond the fixed built-in recurring features). Missing for 10: user-configurable custom recurring schedules beyond the fixed briefing/wake-up-call cadence, and independent confirmation these recurring jobs run reliably at scale.
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
ai-native userVersion, review, and roll back my automations
weight 1 · round drawnPokenone0/10No evidence describes versioning, review workflows, or rollback capability for Poke's automations/recipes; docs mention creating, publishing, and monetizing recipes but nothing about version history or reverting changes.
Martinnone0/10Martin is a personal assistant agent (email, calendar, reminders, shortcuts) with no evidence of version history, review workflows, or rollback for its automations/shortcuts; docs describe creating shortcuts but nothing about versioning or undoing them. Missing for 10: version history UI, review/approval workflow, rollback mechanism.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
Connectors apps — stories about connectors apps in this arenaConnectors apps
Stories about connectors apps in this arena
Connectors
power-userBrowse a directory of third-party apps and connectors and add them to the assistant
weight 2 · round to PokePoke docs describe poke.com/recipes as a directory of first-party and approved third-party recipes/integrations that users can browse and add, plus a separate Integrations page for connecting apps/services. This matches the power-user story of browsing and adding connectors. missing for 10: independent/hands-on evidence of the directory's breadth or UX, and no confirmation of search/filtering or ratings within the directory.
- [claimed-docs] “Go to poke.com/recipes to browse all first-party and approved third-party recipes.”
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Webflow - Design and deploy websites visually”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
Martinnone0/10Evidence shows Martin ships a small fixed set of first-party integrations (Calendar, Inbox, Slack) rather than a browsable directory/marketplace of third-party apps and connectors that a power-user can explore and add. No docs, UI, or community mentions describe an app directory or connector marketplace.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers
weight 3 · round to MartinPoke's docs describe a general 'Integrations' system that lets users connect apps/services (with Webflow given as the only named example) and mention an email-address feature, but no evidence names concrete cloud-drive (e.g., Google Drive), email (Gmail/Outlook), or calendar connectors, nor demonstrates search/use of such data in answers. Missing for 10: named cloud-drive integration, named email inbox integration, named calendar integration, and evidence of search/retrieval across them.
- [claimed-docs] “Integrations let you connect your favorite apps and services to Poke. Once connected, Poke can access information and perform actions across…”
- [claimed-docs] “Once connected, Poke can access information and perform actions across apps and services through natural conversation.”
- [claimed-docs] “Webflow - Design and deploy websites visually”
- [claimed-docs] “You can now set up a @poke.com address to use with your primary email account in Poke.”
Martin has well-documented calendar and email (inbox) integrations letting it read, draft, reply, and add events on the user's behalf, plus a general search capability across connected sources. However, no evidence mentions a cloud drive (e.g., Google Drive/Dropbox) connector, so the story's full connector set is only partially covered. missing for 10: cloud drive integration, independent verification that search actually spans all connected sources.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
- [claimed-docs] “Once connected, you can tell Martin to add an event to your calendar, and he will add it at the specified time with the specified details.”
- [claimed-docs] “Once connected, you can tell Martin to read, draft, and reply to emails on your behalf.”
- [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
Files analysis — stories about files analysis in this arenaFiles analysis
Stories about files analysis in this arena
Files
knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents
weight 3 · round to PokeThe only relevant evidence is that Poke can 'extract and visualize' data from shared images of spreadsheets to create tables/charts, which is a narrow slice of the story. There is no documentation of direct document or PDF upload, parsing, or accurate content analysis for knowledge-worker use cases. Missing for 10: explicit PDF/document upload support, evidence of accuracy on structured/text-heavy files, and any hands-on validation of analysis quality.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Martinnone0/10Martin is a personal-assistant product focused on calendar, email, Slack, reminders, notes, and todos; no evidence anywhere in the pack mentions document, spreadsheet, or PDF upload/analysis capabilities. This is a plausible axis for an AI assistant but there's no supporting documentation or community mention of file/document analysis features.
Memory context — stories about memory context in this arenaMemory context
Stories about memory context in this arena
Memory
power-userHave the assistant remember relevant context from previous chats and apply it in new conversations
weight 3 · round to PokeDocs mention Poke's Memory as a concept tied to account merging (poke-docs-20), implying persistent memory exists across the assistant, but there's no detailed documentation of how memory is captured, retained, or applied across separate conversations, nor independent confirmation of its effectiveness. Missing for 10: dedicated memory documentation explaining retention/retrieval mechanics, examples of cross-chat context recall, and independent/hands-on verification that it works reliably.
- [claimed-docs] “This keeps Poke's Memory, Recipes, and Integrations from the selected account, and your messaging channels ... will be connected to it.”
Martin's notes, to-dos, and reminders (martin-docs-6, martin-docs-22, martin-docs-5) provide persistent storage that Martin can read back across interfaces, giving it some ability to carry information forward. However, there is no explicit documentation of the assistant automatically recalling relevant context from prior conversations and applying it in new, unrelated chats — memory here is user-invoked (explicit notes) rather than an automatic contextual-memory feature. Missing for 10: explicit memory/context-recall feature description, evidence of automatic application of past-conversation context in new sessions, independent confirmation of this behavior.
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
- [claimed-docs] “Call Martin and say "Note down everything we talked about on this call and call it 'Brain Dump'."”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
power-userSet persistent custom instructions and preferences that shape every response
weight 1 · round to PokeThe docs mention a 'Memory' feature tied to a user's account (carried over when merging accounts), implying some persistent context storage, but there is no documentation of a dedicated custom-instructions/preferences setting that explicitly shapes every response. Missing for 10: explicit UI/API for setting persistent custom instructions, examples of how such preferences influence responses, and independent confirmation of this behavior.
- [claimed-docs] “This keeps Poke's Memory, Recipes, and Integrations from the selected account, and your messaging channels ... will be connected to it.”
Multimodal — stories about multimodal in this arenaMultimodal
Stories about multimodal in this arena
Images
knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them
weight 2 · round to PokePoke's release notes explicitly state it can 'share images of existing data (like spreadsheets) for Poke to extract and visualize,' showing some image-interpretation capability, but this is limited to structured data extraction rather than general photo/screenshot understanding across varied content. Missing for 10: evidence of accurate interpretation of arbitrary photos/screenshots (e.g., UI screenshots, handwritten notes, general scenes), independent hands-on verification of accuracy, and any first-party documentation describing general vision/OCR capability beyond the spreadsheet example.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Voice
knowledge-workerHave a natural, real-time voice conversation with the assistant
weight 2 · round to MartinPokenone0/10Poke is described as a text-based assistant across messaging platforms (WhatsApp, Telegram, Apple Messages) with no evidence of real-time voice call or voice conversation capability; all documented interactions are text/message-based.
Martin supports real phone-call interactions — users can call Martin to dictate notes, and Martin can call users for wake-up briefings — indicating a live voice channel exists (martin-docs-22, martin-docs-24, martin-docs-12). However, there is no documentation or independent evidence describing the naturalness, latency, or conversational fluidity of these voice interactions, and community feedback focuses on text/action reliability rather than voice quality. Missing for 10: hands-on/independent evidence of real-time conversational voice quality, documentation of voice-specific features like interruption handling or natural turn-taking.
- [claimed-docs] “Call Martin and say "Note down everything we talked about on this call and call it 'Brain Dump'."”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userDo everything through the API that I can do in the UI
weight 2 · round to PokePoke exposes a documented API for sending messages programmatically and triggering it from external systems (poke-docs-1, poke-docs-2), plus an MCP server/tunnel mechanism for extending tools (poke-docs-3/4/16). However, there's no evidence of API parity for major UI capabilities like managing integrations, recipes, human-task requests, website deployment, or memory/account management, and no public OpenAPI/spec was found (poke-probe-2, poke-probe-3 both 404). missing for 10: API coverage for integrations/recipes/human-tasks/website-deploy features, published OpenAPI spec, independent confirmation of API-UI parity.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
- [claimed-docs] “npx poke@latest tunnel http://localhost:3000/mcp -n "Local Dev MCP"”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [probe] “PROBE docs-md: HTTP 404 at https://poke.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
Martinnone0/10Martin's documented surface is entirely conversational interfaces (email, Slack, phone, SMS, WhatsApp) with no mention of a public/developer API; explicit probes for an OpenAPI/swagger spec at all standard paths returned 404, indicating no programmatic API exists to mirror these UI capabilities.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
ai-native userExport all of my data in open formats and leave
weight 3 · round drawnPokenone0/10No evidence of any data export feature or open-format data portability in Poke's docs; the pack covers messaging API, MCP servers, integrations, and account merging but nothing about exporting user data (memory, conversation history, recipes) in open formats or account closure/data takeout.
ai-native userRead the product's source under an open license
weight 2 · round drawnPokenone0/10No evidence Poke's source code is published under any open license; Poke is presented as a closed SaaS product with docs, APIs, and integrations but no repository or licensing information is mentioned anywhere in the evidence pack.
Martinnone0/10No evidence Martin's source code is available under any license; a community comment explicitly calls for Martin to 'make that system open source' as a trust-building step, implying it currently is not.
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userSelf-host the core product
weight 3 · round drawnPokenone0/10Poke is a hosted SaaS assistant with no evidence of any self-hostable core product, open-source release, or on-prem deployment option; all docs describe a cloud service accessed via API/integrations/MCP.
Martinnone0/10Martin is offered exclusively as a cloud-based assistant (email, Slack, calendar interfaces, cloud-based agent per martin-comm-4); no evidence of a self-hostable core product, open-source release, or on-prem deployment option. One community comment (martin-comm-3) even calls for open-sourcing the data-handling system, implying it is not currently available.
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userChoose where my data is stored (region/residency)
weight 2 · round drawnPokenone0/10No evidence anywhere in the pack mentions data residency, region selection, or storage location controls; Poke's docs cover integrations, MCP, messaging channels, and pricing but nothing about where user data is stored or any regional choice.
Martinnone0/10No evidence anywhere in the pack mentions data residency, region selection, or storage location controls; docs focus entirely on assistant features and integrations. Community comments raise general privacy/security concerns but do not address data residency options. missing for 10: any mention of region selection, data residency policy, or storage location controls.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userPrevent my data from being used to train AI models
weight 3 · round drawnPokenone0/10No evidence in the pack addresses data-training opt-out or privacy controls regarding AI model training; the docs focus on messaging, integrations, MCP, and recipes with no mention of data usage policies or opt-out settings.
Martinnone0/10No evidence pack item addresses AI-training data opt-out or data-usage policy; community comments explicitly raise privacy/trust concerns without any documented answer or control from Martin. Missing for 10: any privacy policy statement, opt-out setting, or documented no-training-data commitment.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userControl data retention and deletion
weight 2 · round drawnPokenone0/10No evidence pack item addresses data retention policies, deletion controls, or export/delete-my-data mechanisms; docs cover memory merging and integrations but not retention/deletion controls, and the prompt-injection report is unrelated to this axis.
Martinnone0/10No evidence describes data retention policies, deletion controls, export tools, or privacy settings; community comments even raise unaddressed concerns about lack of transparency around data handling. Missing for 10: any documentation of data retention periods, user-initiated deletion mechanism, or privacy controls.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userOpt out of telemetry and usage tracking
weight 2 · round drawnPokenone0/10No evidence pack item discusses telemetry, analytics opt-out, or usage-tracking controls for Poke users; docs cover API, MCP, integrations, pricing, and release notes but never privacy/telemetry settings.
Martinnone0/10No evidence of any telemetry opt-out, privacy settings, or data collection controls; community comments even raise unresolved privacy/trust concerns (martin-comm-2, martin-comm-3) with no documented response or opt-out mechanism.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
Research answers — stories about research answers in this arenaResearch answers
Stories about research answers in this arena
Research
knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report
weight 3 · round drawnPokenone0/10Poke's evidence pack covers messaging integrations, MCP tool extensibility, recipes, and various assistant features, but nothing describes an autonomous multi-source deep research capability that returns a cited report. No mention of web search breadth, citation generation, or research-report output.
Martinnone0/10Martin's docs mention a basic search capability that 'syncs with multiple search engines to find relevant information' (martin-docs-8), but there is no evidence of an autonomous multi-source deep-research mode that returns a structured, cited report — no mention of citation formatting, report generation, or a dedicated 'deep research' feature.
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
knowledge-workerGet answers grounded in current web results with citations back to the sources
weight 2 · round to MartinPokenone0/10No evidence describes Poke performing web search, retrieval-augmented answers, or providing citations back to sources; docs focus on messaging, integrations, MCP tooling, and account features, not grounded research answers.
Martin claims to sync with multiple search engines to find relevant information (martin-docs-8), suggesting web-grounded answers, but there is no evidence of citation formatting, source linking, or hands-on verification that answers include traceable citations back to web sources. Missing for 10: documentation or examples showing inline citations/source links, independent corroboration of search-grounded answer quality, and detail on which search engines/sources are used.
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
Trust controls — stories about trust controls in this arenaTrust controls
Stories about trust controls in this arena
Data controls
knowledge-workerExport my complete chat history and account data
weight 1 · round drawnPokenone0/10No evidence in the pack mentions any data export, chat history download, or account data portability feature; documentation covers integrations, MCP, recipes, and messaging channels but nothing about exporting user data.
Martinnone0/10No evidence in the pack mentions data export, chat history download, or account data portability features; community comments even raise privacy concerns without any mention of export tools. Missing for 10: any documentation or feature reference to exporting chat history or account data, data portability API, or GDPR-style export mechanism.
knowledge-workerControl whether my conversations are used to train models
weight 3 · round drawnPokenone0/10No evidence pack item addresses model-training data usage or opt-out controls for conversation data; documentation covers integrations, MCP, pricing, and release notes but nothing about training data policy. Missing for 10: any privacy/data-training policy page, opt-out toggle, or enterprise data-use agreement.
Martinnone0/10No evidence in the pack mentions any setting, policy, or statement about whether user conversations/data are used for model training; community comments explicitly raise privacy/trust concerns without any documented opt-out or training-control mechanism (martin-comm-2, martin-comm-3).
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
Not comparable on these axes
ai-native userRun the product headlessly / in CI for automation
weight 2 · not comparablePoke's docs explicitly state its API can be called from scripts, CI/CD pipelines, and monitoring tools to trigger messages programmatically, which supports headless/automation use (poke-docs-1, poke-docs-2). However, there's no evidence of a full headless run mode (e.g., batch execution, structured output for CI parsing) and probes show no OpenAPI/swagger spec is exposed, suggesting the API's automation surface is thin and undocumented beyond message-sending. Missing for 10: independent/hands-on CI integration examples, a public OpenAPI schema, and evidence of structured/machine-readable responses needed for reliable CI pipelines.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
- [probe] “PROBE openapi: all candidate paths 404 (https://poke.com/openapi.json, https://poke.com/swagger.json, https://poke.com/api/openapi.json, htt…”
Martinn/aMartin is a personal AI assistant for consumer communication channels (email, Slack, phone, SMS), not a developer tool or agent framework meant to be run headlessly in CI pipelines; there's no API, CLI, or programmatic invocation model evidenced, and CI automation is not a fair category expectation for this kind of product.
ai-native userConnect an agent via an official MCP server
weight 3 · not comparablePoken/aPoke is itself an AI agent product; all MCP evidence (poke-docs-3,4,16) shows Poke acting as an MCP *client*—connecting to or tunneling external MCP servers to extend its own capabilities—not Poke exposing an official MCP server endpoint for other agents to connect to. Per the agent-role rule, this client-side capability does not make the 'official MCP server' axis applicable.
ai-native userUse an official CLI
weight 2 · not comparablePoke ships an official CLI invoked via `npx poke@latest` with subcommands like `login`, `tunnel`, and `mcp add`, confirming a real CLI exists for developer/MCP workflows. However, the documented CLI scope is narrow (mainly MCP server registration/tunneling and login) rather than a general-purpose CLI for broader AI-native automation tasks. Missing for 10: evidence of a fuller command set (e.g. messaging, recipe management, account/config commands) and any independent/hands-on verification of the CLI's reliability.
- [claimed-docs] “npx poke@latest tunnel http://localhost:3000/mcp -n "Local Dev MCP"”
- [claimed-docs] “npx poke@latest login”
- [claimed-docs] “npx poke@latest mcp add https://mcp.example.com/sse -n "My Server"”
- [claimed-docs] “Poke supports Model Context Protocol (MCP) servers, allowing you to extend Poke with custom tools and data sources.”
ai-native userSubscribe to events via webhooks
weight 2 · not comparablePoke's API docs mention that external services like GitHub, CI/CD, or monitoring tools can trigger Poke via webhook-style calls, and the API can send messages programmatically, showing some webhook-adjacent integration. However, there's no explicit documentation of Poke exposing an outbound webhook subscription system for AI-native users to subscribe to Poke's own events. missing for 10: explicit outbound webhook/event subscription API, event types list, subscription management docs, independent confirmation of webhook reliability.
- [claimed-docs] “The Poke API allows you to send messages programmatically from your applications, scripts, and automation tools.”
- [claimed-docs] “Services like GitHub, CI/CD pipelines, or monitoring tools can trigger Poke when something happens.”
ai-native userTest against a sandbox environment without touching production data
weight 1 · not comparablePokenone0/10No evidence pack mentions any sandbox environment, test/staging mode, or way to isolate testing from production data; Poke's docs focus on integrations, MCP servers, and messaging features with no mention of sandboxing.
Martinn/aMartin is a personal AI assistant that operates directly on a user's real calendar, inbox, Slack, etc.; there is no concept of a sandbox/test environment separate from production data in its evidence or product category. This axis fits developer-facing platforms/APIs, not a consumer assistant like Martin.
power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen
weight 2 · not comparablePoken/aPoke is a messaging-based AI assistant (WhatsApp/Telegram/Apple Messages/API/MCP integrations), not a desktop application with OS-level shortcuts or screen access; this axis is a category error for its product type.
Martinnone0/10Community evidence confirms a Martin desktop app exists (martin-comm-4), and docs mention in-app 'shortcuts' for multi-step actions (martin-docs-7), but there is no evidence of OS-level global keyboard shortcuts or any capability for Martin to read/access what's on the user's screen. missing for 10: evidence of OS-level hotkey integration, evidence of screen-reading/context capture, any documentation describing desktop-native system integration beyond a generic app shell.
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files
weight 3 · not comparablePoke's docs show it can create tables and charts from described data or shared images (poke-docs-21), but there's no evidence of an underlying code-execution environment, computed numeric answers, or generation of downloadable files. missing for 10: evidence of actual code execution/sandbox, computed-answer capability, downloadable file output.
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Martinn/aMartin is a personal-assistant agent for email, calendar, messaging, reminders and notes; there is no evidence of a code execution/data analysis capability for producing charts, computed answers, or downloadable files, which is outside its product category as a personal-life-admin assistant.
knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export
weight 2 · not comparablePokenone0/10Evidence shows Poke can create websites and generate tables/charts from data, but there is no evidence of creating or iteratively editing documents/presentations that can be exported (e.g. Word, PDF, PowerPoint files). Missing for 10: document creation/editing evidence, presentation creation, export functionality for standard file formats.
- [claimed-docs] “Poke can also create and deploy websites for you at yourname.poke.com.”
- [claimed-docs] “Poke can now create tables and charts to help you visualize data. Describe what you want to see, or share images of existing data (like spre…”
Martinn/aMartin is a personal-assistant product focused on email, calendar, Slack, notes, todos, and reminders — not a document/presentation creation or file-editing tool. No evidence in the pack mentions creating or iteratively editing documents, presentations, or exportable files, so this axis is a category mismatch for Martin's product type.
knowledge-workerOrganize related chats and files into a project or space that shares context and instructions
weight 2 · not comparablePokenone0/10Poke's docs describe messaging, integrations, MCP servers, and recipes, but there is no mention of organizing chats/files into projects or spaces with shared context/instructions, which is a distinct memory-organization feature not evidenced here.
Martinn/aMartin is a personal-assistant agent operating over email, calendar, Slack, notes, and to-dos for an individual user — it has no concept of 'projects' or 'spaces' grouping chats and files with shared instructions, which is a workspace/organization construct outside its product category.
knowledge-workerGenerate and edit images from natural-language prompts
weight 2 · not comparablePokenone0/10Evidence shows Poke can create tables/charts from data and extract data from images (poke-docs-21), and can create websites, but there is no mention of generating or editing images from natural-language prompts anywhere in the docs or release notes.
team-adminManage members, permissions, and data policies for my organization's workspace
weight 2 · not comparablePoken/aPoke is a consumer personal AI assistant (individual account, messaging channels, integrations, recipes) with no evidence of organizational/team workspace concepts like member management, role-based permissions, or org-wide data policies. This is a category mismatch rather than a missing feature.
Martinnone0/10Martin's evidence pack is entirely about individual personal-assistant features (calendar, email, Slack, reminders, to-dos) with no mention of organization workspaces, member management, permission controls, or data-policy settings for teams. missing for 10: any admin console, member/role management, workspace-level permissions, or data governance policy documentation.