Perplexity vs Martin
Martin wins · 11–13 (19 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round drawnPerplexity's docs site directly serves an llms.txt file (HTTP 200) plus per-page .md variants that explicitly point agents to the llms.txt index for full documentation, confirming a genuine agent-oriented docs surface; this is corroborated by an OpenAPI spec, official MCP server, and CLI docs also structured for agent consumption. Missing for 10: independent third-party confirmation that agents actually consume this llms.txt successfully in practice.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.perplexity.ai/llms.txt # Perplexity > Perplexity API documentation for building with the Agent API…”
- [probe] “PROBE docs-md: HTTP 200 at https://docs.perplexity.ai/docs/getting-started/overview.md > ## Documentation Index > Fetch the complete documen…”
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
- [claimed-docs] “The pplx CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and co…”
martin-probe-1 confirms a live llms.txt at docs.trymartin.com/llms.txt returning HTTP 200 with a structured index of docs, and the .md-suffixed doc URLs throughout the evidence pack (e.g. martin-docs-1 through martin-docs-24) show agent-oriented markdown documentation is directly accessible. Missing for 10: no independent/hands-on confirmation that an agent successfully consumed llms.txt to complete a task.
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.trymartin.com/llms.txt # Martin ## Docs - [Introduction](https://docs.trymartin.com/introduction.…”
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · round drawnPerplexitynone0/10All MCP evidence describes Perplexity acting as an MCP *server* (Computer MCP server, Perplexity MCP Server) that other AI assistants can connect to, not Perplexity itself consuming external MCP servers as a client to gain new tools. There is no documentation of a settings/config surface where a user adds arbitrary third-party MCP servers for Perplexity to call.
- [claimed-docs] “Through the Model Context Protocol, your MCP client can delegate complex, multi-step work to Computer and receive structured results.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [claimed-docs] “The Perplexity MCP Server enables AI assistants to access Perplexity's powerful search and reasoning capabilities directly within their work…”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
Martinnone0/10Martin's docs describe a fixed set of built-in integrations (calendar, email, Slack, todos, notes) but there is no mention of MCP protocol support or any way for users to plug in arbitrary MCP servers for Martin to use as tools.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
ai-native userDrive the product through a documented public API
weight 3 · round to PerplexityPerplexity publishes a documented public API (Agent API, Search API, embeddings) with an OpenAPI spec, supports structured output, model fallback, sandbox tool use, and profiles, plus a CLI and MCP integrations for programmatic/agentic access, confirmed by both docs and live probes returning valid OpenAPI/docs endpoints. Missing for 10: independent third-party developer corroboration of API reliability/robustness in production use.
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
- [claimed-docs] “Structured output makes the model return JSON that conforms to a schema you define, so you can deserialize it directly.”
- [claimed-docs] “Model fallback enables specifying multiple models in a `models` array. The API tries each model in order until one succeeds, providing autom…”
- [claimed-docs] “A profile is a reusable, versioned configuration that you save and manage.”
- [claimed-docs] “The pplx CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and co…”
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.perplexity.ai/llms.txt # Perplexity > Perplexity API documentation for building with the Agent API…”
- [probe] “official CLI documented at https://docs.perplexity.ai/docs/cli/overview”
Martinnone0/10Martin is a personal-assistant product controlled via chat/email/Slack/phone interfaces, but there is no evidence of a documented public API for developers to programmatically drive it — probes for OpenAPI/Swagger specs all returned 404. missing for 10: a documented public API, SDK, or endpoint reference; any developer-facing API authentication or usage docs.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · round drawnPerplexitynone0/10The evidence pack covers API endpoints, MCP servers, CLI, and browser/app features, but contains no mention of API key scoping, granular permissions, or least-privilege credential issuance for agents. This is a fair capability to expect from an API platform, so absence of evidence means 'none' rather than 'na'.
Martinnone0/10Martin is a personal assistant that connects to full-access integrations (email, calendar, Slack) but there is no evidence of scoped or least-privilege credential issuance, API key management, or granular permissioning for agent access — no OpenAPI/API docs even exist per probe results.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
- [claimed-docs] “Once connected, you can tell Martin to read, draft, and reply to emails on your behalf.”
- [claimed-docs] “Once connected, you can tell Martin to read, send, and reply to Slack messages on your behalf.”
ai-native userBuild against official SDKs
weight 2 · round to PerplexityPerplexity documents a REST-based Agent API with an OpenAI-compatible endpoint and publishes an openapi.json spec, which supports SDK-style integration, but there is no explicit evidence of first-party official SDK libraries (e.g., a Perplexity Python/Node/Go client package) in the pack. missing for 10: explicit official SDK packages/libraries, language-specific SDK docs, independent developer corroboration of SDK usage.
- [claimed-docs] “Unified access to open-weight models hosted by Perplexity through one OpenAI-compatible endpoint.”
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
Martinnone0/10Martin's evidence pack covers only end-user integrations (calendar, email, Slack, etc.) and consumer interfaces, with no mention of an SDK, API, or developer library; probes for an OpenAPI/Swagger spec all returned 404s, indicating no public API/SDK surface exists to build against.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
Agentic features
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · round to MartinPerplexity's Assistant (drafting emails, scheduling, booking) and the browser extension's 'Contextual Understanding' (answers tied to current page/domain) and 'Your Library' (curation of past discoveries) show the product surfacing suggestions tied to a user's own activity/context, but there's no explicit feature for uploading or connecting personal datasets (docs, CRM, files) and generating proactive analytical insights from them — the core product is web search/answers, not user-data analytics. missing for 10: dedicated personal-data ingestion/analysis capability, proactive insight-generation dashboards, independent evidence these 'insights' features work well in practice (community reports flag research features stalling and answer quality issues).
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Your Library: More than search history, it's a curation of your discoveries.”
- [claimed-docs] “Contextual Understanding: Get answers relevant to your current page or even specific to your current domain.”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin generates daily/weekly briefings synthesized from your calendar and inbox data, proactively drafts emails, and triages/labels emails with follow-up suggestions—all forms of AI-generated insights/suggestions surfaced inside the product. However, these are framed as autonomous actions rather than an explicit 'insights' or analytics layer, and there's no dedicated dashboard-style insight generation from broader personal data. Missing for 10: no independent/hands-on evidence corroborating quality of the 'insight' content itself, and no explicit analytics/trend-surfacing feature distinct from task-execution suggestions.
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
ai-native userSet up automations that run autonomously in the background
weight 2 · round to MartinPerplexitynone0/10The evidence describes on-demand features (Assistant drafting emails/booking, Computer/MCP multi-step delegation, Agent API) that execute when invoked, but nothing documents scheduled, recurring, or persistent background automations that run autonomously without a user actively initiating each session. Missing for 10: any documented scheduling/trigger mechanism, recurring task execution, or evidence of an automation running unattended over time.
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
Martin's docs describe multiple always-on background automations—daily/weekly briefings, proactive email drafting, email triage, wake-up calls, cc-to-schedule meeting booking, and custom multi-step shortcuts—all of which run without direct user prompting, and community reports (e.g., using Martin as a persistent background agent for todos) corroborate real autonomous use. Missing for 10: independent verification of scheduling/configuration UI for these background jobs and long-term reliability data beyond one HN comment about failure rates improving.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round to MartinPerplexitydisputedcontradicted5/10Perplexity ships a built-in 'Assistant' and 'Computer' agent that can draft emails, book reservations, browse the web, run code, and connect to 400+ services (perplexity-docs-9, -17, -19, -29, -30, -38), which is a genuine in-product delegation capability. However, hands-on community reports say the Computer/agentic research feature 'often fails to trigger via the UI, and when it does work, sessions frequently stall without returning an answer' (perplexity-comm-7), directly contradicting the vendor's smooth-delegation claims. Missing for 10: independent corroboration that the assistant reliably completes delegated multi-step tasks, and resolution of the reported stalling/failure-to-trigger issue.
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [claimed-docs] “When a task requires interacting with a website, filling forms, or accessing login-gated content, Computer launches a browser session automa…”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin IS the built-in AI assistant, and users delegate tasks to it across calendar, email, Slack, reminders, todos, notes, and multi-step shortcuts via chat, phone, SMS, email, or Slack, with hands-on community accounts confirming real task delegation and reliability improvements. missing for 10: independent quality/reliability benchmarking beyond anecdotal HN comments, and no evidence of failure-mode transparency or task-success metrics.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [community] “I’m impressed. I’ll probably cancel ChatGPT Pro subscription and switch to this... it’s handling some complicated requests correctly the fir…”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
ai-native userOperate the product with natural-language commands
weight 2 · round to MartinPerplexitydisputedcontradicted6/10Perplexity's core product is a natural-language chat/search interface (voice and text queries, cited answers) and its 'Assistant'/Computer agent claims to handle draft emails, scheduling, and multi-step web tasks purely via NL commands. However, hands-on community reports say the agentic 'Computer' research feature frequently fails to trigger via the UI and stalls without returning results, directly contradicting the docs' claims of reliable NL-driven task execution. missing for 10: independent verification that the Assistant reliably completes booking/scheduling tasks, and resolution of the reported reliability failures.
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “· Voice: Instant, up-to-date answers whether you type or say it.”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin is explicitly designed around natural-language commands across calendar, email, Slack, reminders, todos, notes, shortcuts, and phone/SMS interfaces, with docs and taglines like 'Text Jon my arrival time' or 'Cc Martin on an email to schedule a meeting' showing conversational control, and community feedback (HN) corroborates real usage of natural-language task delegation. missing for 10: independent hands-on benchmarking of NL command breadth/accuracy beyond anecdotal HN praise, and no formal API/spec confirming NLU robustness.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you when the time comes.”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [claimed-docs] “Text Jon my arrival time.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [community] “I’m impressed. I’ll probably cancel ChatGPT Pro subscription and switch to this... it’s handling some complicated requests correctly the fir…”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
Api quality
ai-native userExplore an interactive API reference with runnable examples
weight 2 · round to PerplexityPerplexity publishes a machine-readable OpenAPI spec (openapi.json) and structured API docs (quickstart, building-agents guides) that would typically power an interactive reference, but the evidence pack never explicitly shows a 'try it' playground or runnable code examples within the docs UI. missing for 10: explicit interactive 'try it now' console screenshots/docs, confirmation of runnable code snippets executed in-browser, independent user report of using the interactive reference.
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.perplexity.ai/llms.txt # Perplexity > Perplexity API documentation for building with the Agent API…”
- [probe] “PROBE docs-md: HTTP 200 at https://docs.perplexity.ai/docs/getting-started/overview.md > ## Documentation Index > Fetch the complete documen…”
Martinnone0/10Martin is a personal assistant product with docs pages but no evidence of any interactive API reference or runnable examples; probes explicitly show no OpenAPI/swagger spec found at any candidate path. missing for 10: interactive API reference UI, runnable code examples, OpenAPI spec availability.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round to PerplexityA probe confirms a live, machine-readable OpenAPI spec at https://docs.perplexity.ai/openapi.json returning HTTP 200 with an 'openapi' key, alongside an llms.txt documentation index, directly satisfying the story. Missing for 10: independent/community confirmation of the spec's completeness or usage in the wild.
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
- [probe] “PROBE llms.txt: HTTP 200 at https://docs.perplexity.ai/llms.txt # Perplexity > Perplexity API documentation for building with the Agent API…”
- [probe] “PROBE docs-md: HTTP 200 at https://docs.perplexity.ai/docs/getting-started/overview.md > ## Documentation Index > Fetch the complete documen…”
Martinnone0/10Martin is a personal assistant product, not a developer API platform, but the axis of publishing a machine-readable API spec still applies as a fair question; the probe explicitly checked all standard OpenAPI/swagger paths and found only 404s, with no evidence of any downloadable spec.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · round drawnPerplexitynone0/10Evidence shows Perplexity has an API with an OpenAPI spec and 'versioned' profiles for agent configurations, but nothing documents API version numbering or a deprecation/sunset policy for endpoints or models. Missing for 10: explicit API versioning scheme (e.g., v1/v2 paths), documented deprecation/sunset timeline, and any changelog or migration guide referenced in the evidence pack.
- [claimed-docs] “A profile is a reusable, versioned configuration that you save and manage.”
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
Martinnone0/10Martin is a personal-assistant product with no evidence of any public API, versioning scheme, or deprecation policy; the openapi probe returned 404 on all candidate paths and no docs mention API versioning. missing for 10: any public API reference, version numbers, changelog, deprecation policy documentation.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
Agents tasks — stories about agents tasks in this arenaAgents tasks
Stories about agents tasks in this arena
Agent mode
power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review
weight 3 · round to MartinPerplexitydisputedcontradicted5/10Perplexity's 'Computer' (Labs/Assistant) is documented as an autonomous background agent that can browse the web, execute code, use 400+ connectors, and complete tasks like drafting emails or booking reservations, returning structured results — matching the delegate-and-review story (perplexity-docs-9,10,17-19,29,30,38). However, a hands-on community report says the Computer/research feature 'often fails to trigger via the UI, and when it does work, sessions frequently stall without returning an answer,' directly contradicting reliable autonomous completion (perplexity-comm-7). missing for 10: independent corroboration that Computer reliably completes tasks and returns results, resolution of the reported stalling/failure-to-trigger issue.
- [claimed-docs] “Through the Model Context Protocol, your MCP client can delegate complex, multi-step work to Computer and receive structured results.”
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Perplexity Labs: Bring your reports and projects to life faster than ever before.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [claimed-docs] “When a task requires interacting with a website, filling forms, or accessing login-gated content, Computer launches a browser session automa…”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin's docs describe multiple background/autonomous capabilities (proactive email drafts, email triage with follow-up actions, cc-to-schedule meeting booking, custom multi-step shortcuts, daily briefings) that match delegating a task for autonomous background work with results delivered back to the user, and community posts corroborate real usage of the cloud-based agent for ongoing tasks (todos) across sessions. However, evidence doesn't clearly show a distinct 'review before finalizing' step for these autonomous actions (e.g., whether drafts are held for approval vs. auto-sent), and independent hands-on validation of the full delegate→work→review loop is thin. Missing for 10: explicit review/approval workflow evidence, and richer independent hands-on accounts of multi-step autonomous task completion.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites
weight 3 · round to PerplexityPerplexitydisputedcontradicted5/10Perplexity documents a 'Computer' agent with a full cloud browser that can search, browse, fill forms, and access login-gated pages, launched automatically for such tasks and accessible via MCP (perplexity-docs-17, -29, -30, -38) — squarely matching the story. However, hands-on community reporting says this same 'Computer' feature 'often fails to trigger via the UI, and when it does work, sessions frequently stall without returning an answer' (perplexity-comm-7), directly contradicting reliable operation. missing for 10: independent corroboration that browser automation completes tasks reliably, and no rebuttal to the stall/failure reports.
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [claimed-docs] “When a task requires interacting with a website, filling forms, or accessing login-gated content, Computer launches a browser session automa…”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martinnone0/10Martin's documented capabilities cover calendar, email, Slack, notes, reminders, todos, and search-engine lookups, but nothing in the evidence describes it operating a web browser, navigating websites, or completing multi-step tasks on arbitrary sites on the user's behalf.
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
power-userLet the assistant see and operate applications on my computer to complete work
weight 2 · round to MartinPerplexitydisputedcontradicted4/10Perplexity's 'Computer' (via MCP) and Assistant app claim to browse the web, execute code in a sandbox, connect to 400+ services, and perform tasks like booking/scheduling — a form of 'operate applications' — but this is a cloud browser/sandbox, not literal control of apps on the user's own computer, and community hands-on reports say the Computer research feature 'often fails to trigger via the UI, and when it does work, sessions frequently stall without returning an answer.' This directly contradicts the vendor's claims of reliable task completion. missing for 10: evidence of actually operating local desktop applications (not just cloud browser/sandbox), reliability data contradicting the stalling reports, independent success case studies.
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “Computer can: **Search and browse** the web for real-time information, including login-gated pages * **Write and execute code** in an intera…”
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [claimed-docs] “When a task requires interacting with a website, filling forms, or accessing login-gated content, Computer launches a browser session automa…”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin can act inside specific applications via integrations (calendar, email, Slack, notes, to-dos) rather than through general screen/GUI-level control of arbitrary desktop apps — it operates named services via API-like connections, not a computer-use style visual agent. A desktop app exists (martin-comm-4) but evidence only shows it syncing to-dos, not controlling arbitrary programs. Missing for 10: evidence of generic screen/vision-based computer control, ability to operate arbitrary (non-integrated) applications, and independent hands-on proof of this broader 'operate any app' capability.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
Tasks
power-userSchedule recurring or one-off tasks that run automatically and come back to me with results
weight 2 · round to MartinPerplexitynone0/10Evidence shows search, Q&A, Computer/MCP agent capabilities, and an Assistant that can draft emails or book reservations, but nothing describes a mechanism for scheduling recurring or one-off tasks that run automatically in the background and return results later. Community evidence even notes the 'Computer' research feature often fails to trigger or stalls without returning an answer, but there's no documented scheduling/task-runner feature at all.
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin supports recurring background tasks (daily/weekly briefings, wake-up calls, email triage) and one-off scheduled reminders that ping the user via chosen interface, matching the core of the story. However, there's no unified 'task scheduler' concept with arbitrary custom recurring workflows beyond the specific built-in background tasks listed, and no independent verification of reliability for scheduled/recurring runs. missing for 10: evidence of general-purpose custom recurring task scheduling (not just fixed briefings/wake-up-calls), independent hands-on confirmation of reminder/briefing reliability, and any dashboard/management UI for viewing scheduled tasks.
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you when the time comes.”
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
- [community] “A big piece of product feedback we got was 'I don't trust AI to take actions like sending texts/emails on my behalf if it's not 100% reliabl…”
Apps devices — stories about apps devices in this arenaApps devices
Stories about apps devices in this arena
Apps
power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen
weight 2 · round drawnPerplexitynone0/10The evidence pack only documents Perplexity's mobile apps (iOS/Android), a Chrome browser extension, a CLI, and MCP/API integrations — none describe an official desktop app with OS-level keyboard shortcuts or screen-content access.
- [claimed-docs] “Perplexity Pro Search & Deep Research: Guided AI search for deeper exploration.”
- [claimed-docs] “Instant Page Summaries: Make sense of any article or webpage at a glance.”
- [claimed-docs] “This free app syncs across devices and leverages the power of the top AI models from OpenAI, Anthropic, Meta, and more.”
- [claimed-docs] “The pplx CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and co…”
Martinnone0/10Community evidence confirms a Martin desktop app exists (martin-comm-4), and docs mention in-app 'shortcuts' for multi-step actions (martin-docs-7), but there is no evidence of OS-level global keyboard shortcuts or any capability for Martin to read/access what's on the user's screen. missing for 10: evidence of OS-level hotkey integration, evidence of screen-reading/context capture, any documentation describing desktop-native system integration beyond a generic app shell.
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
knowledge-workerUse full-featured official mobile apps for iOS and Android
weight 2 · round to PerplexityPerplexity has official iOS and Android apps (App Store and Play Store listings) with a broad feature set: Pro Search/Deep Research, Assistant tasks, voice, citations, library/history sync across devices, and cross-model access — indicating full-featured rather than bare-bones apps. Missing for 10: independent hands-on app-store review/rating evidence and no direct community commentary specifically on mobile app quality (community feedback cited is about the web/desktop product and Computer feature, not mobile apps specifically).
- [claimed-docs] “Perplexity Pro Search & Deep Research: Guided AI search for deeper exploration.”
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Perplexity Labs: Bring your reports and projects to life faster than ever before.”
- [claimed-docs] “Voice: Instant, up-to-date answers whether you type or say it.”
- [claimed-docs] “Trust Built In: Cited sources for every answer.”
- [claimed-docs] “Your Library: More than search history, it's a curation of your discoveries.”
- [claimed-docs] “Discover: Learn new things from the community.”
- [claimed-docs] “This free app syncs across devices and leverages the power of the top AI models from OpenAI, Anthropic, Meta, and more.”
- [claimed-docs] “Cut through the clutter and get straight to credible, up-to-date answers.”
- [claimed-docs] “Thread Follow-Ups: Keep the conversation going for a deeper understanding.”
Martinnone0/10Martin's docs describe channel-based access (phone, SMS, WhatsApp, email, Slack, desktop) but no evidence of dedicated, full-featured native iOS/Android apps; a community comment explicitly asks 'I would try this if it had Android support! Is that planned?' indicating no Android app exists, and no iOS app is mentioned anywhere.
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “I would try this if it had Android support! Is that planned?”
Custom bots
power-userBuild and share custom assistants with their own instructions and knowledge
weight 2 · round drawnPerplexitynone0/10The evidence pack covers Perplexity's search products, apps, CLI, MCP servers, and Agent API (including 'profiles' as reusable API configs), but nothing describes a user-facing feature for building a custom assistant with its own persistent instructions plus an attached knowledge base that can be shared with others (e.g., a Spaces/custom-GPT-like capability).
Martinnone0/10Martin is a personal AI assistant with fixed integrations (calendar, email, Slack, todos, notes, reminders) and shortcuts, but there is no evidence of a feature to build a custom assistant with its own distinct instructions/persona and knowledge base, nor any sharing mechanism for such an assistant. missing for 10: custom assistant creation with configurable instructions/persona, custom knowledge base attachment, and sharing/publishing of a built assistant.
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round to MartinPerplexitynone0/10No evidence of a batch/bulk API, batch endpoint, or multi-item processing mode; the CLI and Agent API are described as single-call/pipeline-oriented tools that a user could script externally, but Perplexity itself does not document any bulk-operation capability.
- [claimed-docs] “The `pplx` CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and …”
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
Martin's docs show a few multi-item behaviors — e.g. forwarding an email with several events and having 'all of them' added to the calendar (martin-docs-23), and automatic email labeling/triage across an inbox (martin-docs-11) — which imply some batch-like processing, but there is no explicit bulk-operations feature (e.g. batch todo updates, mass note edits, multi-item scheduling command) described anywhere in the docs. missing for 10: explicit bulk-action tooling/API for operating on many items at once, first-party documentation of bulk operations, and independent confirmation of bulk-scale reliability.
- [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
ai-native userDefine rules that trigger actions automatically on events
weight 3 · round to MartinPerplexitynone0/10No evidence of a rules/trigger/automation engine (event-based conditions triggering actions) anywhere in the docs — Perplexity's evidence covers search, chat, APIs, MCP/Computer agent tasks, and CLI, but nothing about defining persistent rules that fire automatically on events.
Martin ships several automatic, event-triggered behaviors (email triage that auto-labels and follows up, cc-to-schedule meeting creation, forwarded-email calendar parsing, proactive drafts, wake-up calls, briefings) which act like predefined automation rules, and 'custom shortcuts' let users define multi-step action sequences. However, there's no evidence of a general user-defined rule/trigger engine (e.g., 'if email from X arrives then do Y' configurable conditions) — the automations shown are fixed built-in behaviors rather than arbitrary user-authored event rules. Missing for 10: a documented custom rule/condition builder, evidence of arbitrary event-trigger definitions beyond built-in background tasks, and independent confirmation these automations fire reliably in practice.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Cc Martin on an email to schedule a meeting.”
- [claimed-docs] “Martin can proactively draft emails for you and send them on your behalf.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
ai-native userSchedule recurring jobs or workflows
weight 2 · round to MartinPerplexitynone0/10No evidence of scheduling, cron-like triggers, or recurring workflow automation anywhere in the docs, apps, or API references; the Agent API, CLI, MCP servers, and assistant features described are all single-invocation or on-demand tools with no persistent job scheduler.
Martin ships several built-in recurring background jobs — daily/weekly briefings, daily wake-up calls, and automatic email triage — which are documented recurring workflows, and shortcuts allow custom multi-step actions. However, there's no evidence of a general-purpose, user-defined recurring job scheduler (e.g., custom cadence for arbitrary tasks/workflows beyond the fixed built-in recurring features). Missing for 10: user-configurable custom recurring schedules beyond the fixed briefing/wake-up-call cadence, and independent confirmation these recurring jobs run reliably at scale.
- [claimed-docs] “Martin can send you daily or weekly briefings via email.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
- [claimed-docs] “Martin can automatically label your emails and take follow up actions on your behalf.”
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
ai-native userVersion, review, and roll back my automations
weight 1 · round to PerplexityThe Agent API's 'profiles' feature is described as a reusable, versioned configuration that can be saved and managed, offering a thin sliver of version control for automation configs, but there is no documented review workflow or rollback mechanism for automations. missing for 10: rollback/restore functionality, review/diff UI, versioning for Computer/MCP-based automations, evidence of actual usage beyond a single doc line.
- [claimed-docs] “A profile is a reusable, versioned configuration that you save and manage.”
Martinnone0/10Martin is a personal assistant agent (email, calendar, reminders, shortcuts) with no evidence of version history, review workflows, or rollback for its automations/shortcuts; docs describe creating shortcuts but nothing about versioning or undoing them. Missing for 10: version history UI, review/approval workflow, rollback mechanism.
- [claimed-docs] “Create custom shortcuts that trigger multi-step actions.”
Connectors apps — stories about connectors apps in this arenaConnectors apps
Stories about connectors apps in this arena
Connectors
power-userBrowse a directory of third-party apps and connectors and add them to the assistant
weight 2 · round to PerplexityDocs mention Perplexity's Computer feature can 'connect to 400+ services through a managed connector framework with one-click OAuth,' implying a connector catalog exists, but there is no evidence of an actual browsable directory UI, categories, or user-facing app marketplace, and no independent/hands-on confirmation of this experience. Missing for 10: dedicated connector/app directory UI evidence, list of example connectors, independent user reports of browsing/adding connectors.
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
Martinnone0/10Evidence shows Martin ships a small fixed set of first-party integrations (Calendar, Inbox, Slack) rather than a browsable directory/marketplace of third-party apps and connectors that a power-user can explore and add. No docs, UI, or community mentions describe an app directory or connector marketplace.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Have Martin read and send messages in Slack from your account.”
knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers
weight 3 · round drawnPerplexity's Computer/MCP docs claim a 'managed connector framework' connecting to 400+ services via one-click OAuth, and the Assistant feature claims it can draft emails and schedule appointments, which implies email/calendar integration, but no evidence names specific connectors like Google Drive, Gmail, or Google/Outlook Calendar, nor shows search results being grounded in those personal sources. Community reports also note the 'Computer' feature (where this connector framework lives) often fails to trigger via the UI and stalls without returning an answer, raising doubts about reliability. Missing for 10: named cloud-drive/email/calendar connector examples, documentation of how connected-source data is surfaced in answers, and independent confirmation the connector framework works reliably.
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “· Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martin has well-documented calendar and email (inbox) integrations letting it read, draft, reply, and add events on the user's behalf, plus a general search capability across connected sources. However, no evidence mentions a cloud drive (e.g., Google Drive/Dropbox) connector, so the story's full connector set is only partially covered. missing for 10: cloud drive integration, independent verification that search actually spans all connected sources.
- [claimed-docs] “Have Martin read, create, and update events in your calendar.”
- [claimed-docs] “Have Martin read, draft, and reply to emails in your inbox.”
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
- [claimed-docs] “Once connected, you can tell Martin to add an event to your calendar, and he will add it at the specified time with the specified details.”
- [claimed-docs] “Once connected, you can tell Martin to read, draft, and reply to emails on your behalf.”
- [claimed-docs] “Got an email with events coming up? Forward it to Martin, and he'll add them all to your calendar.”
Files analysis — stories about files analysis in this arenaFiles analysis
Stories about files analysis in this arena
Files
knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents
weight 3 · round drawnPerplexitynone0/10The evidence pack contains no mention of document, spreadsheet, or PDF upload/analysis features anywhere in Perplexity's docs, API, CLI, MCP server, or app store listings — coverage focuses on web search, citations, sandboxed code execution, and browser automation. Missing for 10: any documentation of file/PDF/spreadsheet upload, parsing, or analysis capability, and any user or hands-on evidence of accurate document Q&A.
Martinnone0/10Martin is a personal-assistant product focused on calendar, email, Slack, reminders, notes, and todos; no evidence anywhere in the pack mentions document, spreadsheet, or PDF upload/analysis capabilities. This is a plausible axis for an AI assistant but there's no supporting documentation or community mention of file/document analysis features.
Memory context — stories about memory context in this arenaMemory context
Stories about memory context in this arena
Memory
power-userHave the assistant remember relevant context from previous chats and apply it in new conversations
weight 3 · round to MartinPerplexitynone0/10Evidence shows only within-conversation context ('conversation context across turns', 'Thread Follow-Ups') and a searchable history/library, but no documented feature where the assistant recalls or applies context from previous separate chats into new conversations. Missing for 10: any explicit cross-session memory feature, opt-in/opt-out memory controls, or evidence of persisted user facts being reused in new threads.
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [claimed-docs] “Thread Follow-Ups: Keep the conversation going for a deeper understanding.”
- [claimed-docs] “Your Library: More than search history, it's a curation of your discoveries.”
Martin's notes, to-dos, and reminders (martin-docs-6, martin-docs-22, martin-docs-5) provide persistent storage that Martin can read back across interfaces, giving it some ability to carry information forward. However, there is no explicit documentation of the assistant automatically recalling relevant context from prior conversations and applying it in new, unrelated chats — memory here is user-invoked (explicit notes) rather than an automatic contextual-memory feature. Missing for 10: explicit memory/context-recall feature description, evidence of automatic application of past-conversation context in new sessions, independent confirmation of this behavior.
- [claimed-docs] “You can tell Martin to read, add, and edit your notes from any interface.”
- [claimed-docs] “Call Martin and say "Note down everything we talked about on this call and call it 'Brain Dump'."”
- [claimed-docs] “You can tell Martin to add, edit, and check off your to-dos on your behalf from any interface.”
- [claimed-docs] “Tell Martin to remind you to do something, and he will ping you at the specified time, via the specified interface.”
power-userSet persistent custom instructions and preferences that shape every response
weight 1 · round to PerplexityThe only related evidence is the Agent API 'profiles' feature (a reusable, versioned configuration you save and manage), which could function as persistent settings shaping responses, but this is a developer/API concept, not documented as a consumer-facing custom-instructions or persona feature. Missing for 10: explicit evidence of user-facing custom instructions/preferences in the consumer app, confirmation that profiles persist across all conversations/responses, and independent corroboration of this working as claimed.
- [claimed-docs] “A profile is a reusable, versioned configuration that you save and manage.”
- [claimed-docs] “Your Library: More than search history, it's a curation of your discoveries.”
Multimodal — stories about multimodal in this arenaMultimodal
Stories about multimodal in this arena
Images
knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them
weight 2 · round drawnPerplexitynone0/10The evidence pack contains no mention of image/screenshot upload or visual interpretation capability anywhere in the docs, app store listings, or API references—only text search, voice, browsing, and coding features are described.
Voice
knowledge-workerHave a natural, real-time voice conversation with the assistant
weight 2 · round to MartinPerplexity's mobile app docs mention a 'Voice' feature ('Instant, up-to-date answers whether you type or say it'), indicating voice input/output exists, but there's no evidence describing a natural, continuous, real-time back-and-forth voice conversation mode (like a dedicated voice-chat UI) or its quality/latency. Missing for 10: details on conversational turn-taking, interruption handling, voice mode UX specifics, and independent hands-on validation of voice conversation quality.
- [claimed-docs] “Voice: Instant, up-to-date answers whether you type or say it.”
- [claimed-docs] “· Voice: Instant, up-to-date answers whether you type or say it.”
Martin supports real phone-call interactions — users can call Martin to dictate notes, and Martin can call users for wake-up briefings — indicating a live voice channel exists (martin-docs-22, martin-docs-24, martin-docs-12). However, there is no documentation or independent evidence describing the naturalness, latency, or conversational fluidity of these voice interactions, and community feedback focuses on text/action reliability rather than voice quality. Missing for 10: hands-on/independent evidence of real-time conversational voice quality, documentation of voice-specific features like interruption handling or natural turn-taking.
- [claimed-docs] “Call Martin and say "Note down everything we talked about on this call and call it 'Brain Dump'."”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
- [claimed-docs] “Martin can call you at a specific time every morning to wake you up with the weather and your schedule.”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userDo everything through the API that I can do in the UI
weight 2 · round to PerplexityThe API/Agent API exposes web-grounded search, citations, sandboxed code execution, structured output, model fallback, and CLI/MCP integrations, covering much of what the UI offers, but UI-only consumer features like Assistant task automation (email drafting, scheduling, reservations), Voice, Library/Discover, and browser extension page-context features have no documented API equivalents. missing for 10: API parity for Assistant actions (email/scheduling/booking), Voice interface, Library/Discover/curation features, browser-extension contextual page understanding, and independent confirmation that all UI capabilities are API-accessible.
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
- [claimed-docs] “Structured output makes the model return JSON that conforms to a schema you define, so you can deserialize it directly.”
- [claimed-docs] “Model fallback enables specifying multiple models in a `models` array. The API tries each model in order until one succeeds, providing autom…”
- [claimed-docs] “Assistant: Draft emails, schedule appointments, book reservations, and more.”
- [claimed-docs] “Voice: Instant, up-to-date answers whether you type or say it.”
- [claimed-docs] “Your Library: More than search history, it's a curation of your discoveries.”
- [claimed-docs] “Discover: Learn new things from the community.”
- [claimed-docs] “Contextual Understanding: Get answers relevant to your current page or even specific to your current domain.”
Martinnone0/10Martin's documented surface is entirely conversational interfaces (email, Slack, phone, SMS, WhatsApp) with no mention of a public/developer API; explicit probes for an OpenAPI/swagger spec at all standard paths returned 404, indicating no programmatic API exists to mirror these UI capabilities.
- [probe] “PROBE openapi: all candidate paths 404 (https://docs.trymartin.com/openapi.json, https://docs.trymartin.com/swagger.json, https://docs.tryma…”
- [claimed-docs] “Martin is reachable through all your communication channels, including phone, SMS, WhatsApp, email, and Slack.”
ai-native userExport all of my data in open formats and leave
weight 3 · round drawnPerplexitynone0/10No evidence of a data export/portability feature for user account data (chat history, library, settings) in open formats; the docs cover API access to models/search but nothing about exporting personal user data or account deletion workflows. missing for 10: any documented data export tool, format spec (JSON/CSV/etc.), or account-deletion-with-export flow.
ai-native userRead the product's source under an open license
weight 2 · round drawnPerplexitynone0/10Perplexity is a closed, proprietary product; the evidence pack shows API docs, apps, CLI, and MCP integrations but no mention of open-sourcing the product itself or any open-license source code repository.
Martinnone0/10No evidence Martin's source code is available under any license; a community comment explicitly calls for Martin to 'make that system open source' as a trust-building step, implying it currently is not.
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userSelf-host the core product
weight 3 · round drawnPerplexitynone0/10Perplexity is offered exclusively as a hosted SaaS (web app, mobile apps, browser extension, cloud API/CLI/MCP) with no evidence of any self-hostable core product, open-source release, or on-prem deployment option.
Martinnone0/10Martin is offered exclusively as a cloud-based assistant (email, Slack, calendar interfaces, cloud-based agent per martin-comm-4); no evidence of a self-hostable core product, open-source release, or on-prem deployment option. One community comment (martin-comm-3) even calls for open-sourcing the data-handling system, implying it is not currently available.
- [community] “oh, martin desktop is finally here! I use Martin to manage my todo list while i'm coding (on an hourly basis) - having it aside VSC is so ha…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userChoose where my data is stored (region/residency)
weight 2 · round drawnPerplexitynone0/10No evidence in the pack mentions data residency, regional storage options, or any user-selectable region controls; Perplexity's docs focus on models, search, MCP/CLI integrations, and app features but never address data storage location or residency choices.
Martinnone0/10No evidence anywhere in the pack mentions data residency, region selection, or storage location controls; docs focus entirely on assistant features and integrations. Community comments raise general privacy/security concerns but do not address data residency options. missing for 10: any mention of region selection, data residency policy, or storage location controls.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userPrevent my data from being used to train AI models
weight 3 · round drawnPerplexitynone0/10No evidence in the pack of any opt-out setting, privacy policy statement, or documented control letting users prevent their data from being used for AI training; the evidence pack only covers product features (search, CLI, MCP, browser extension) and unrelated community complaints about crawling/robots.txt behavior. Missing for 10: any documentation of a training opt-out toggle, privacy settings page, or data-use policy addressing model training.
Martinnone0/10No evidence pack item addresses AI-training data opt-out or data-usage policy; community comments explicitly raise privacy/trust concerns without any documented answer or control from Martin. Missing for 10: any privacy policy statement, opt-out setting, or documented no-training-data commitment.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userControl data retention and deletion
weight 2 · round drawnPerplexitynone0/10The evidence pack contains no documentation of data retention settings, deletion controls, export options, or privacy dashboard features for Perplexity users; the only privacy-adjacent items concern the company's own web-crawling/robots.txt controversy, which is off-topic for user data control. This axis clearly applies to a consumer AI assistant, so absence of evidence yields 'none'.
Martinnone0/10No evidence describes data retention policies, deletion controls, export tools, or privacy settings; community comments even raise unaddressed concerns about lack of transparency around data handling. Missing for 10: any documentation of data retention periods, user-initiated deletion mechanism, or privacy controls.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
ai-native userOpt out of telemetry and usage tracking
weight 2 · round drawnPerplexitynone0/10No evidence in the pack describes any telemetry opt-out, privacy settings, or usage-tracking controls; the community items discuss crawling/robots.txt disputes and product quality, not telemetry opt-out. Missing for 10: any documentation of a privacy settings page, data-collection opt-out toggle, or telemetry policy.
Martinnone0/10No evidence of any telemetry opt-out, privacy settings, or data collection controls; community comments even raise unresolved privacy/trust concerns (martin-comm-2, martin-comm-3) with no documented response or opt-out mechanism.
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
Research answers — stories about research answers in this arenaResearch answers
Stories about research answers in this arena
Research
knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report
weight 3 · round to PerplexityPerplexitydisputedcontradicted5/10Perplexity's docs explicitly advertise 'Pro Search & Deep Research: Guided AI search for deeper exploration' with citations built into every answer, matching the story's core capability. However, hands-on community reports directly contradict reliable delivery: one user found citations/references 'frequently mismatched to the text' and quality declining over time, and another reports the 'Computer' research feature 'often fails to trigger via the UI, and when it does work, sessions frequently stall without returning an answer,' leading them to prefer other tools for actual research. Missing for 10: independent verification of successful autonomous multi-source runs, resolution of the stalling/citation-mismatch complaints, and clearer documentation distinguishing 'Deep Research' reliability from the separate 'Computer' agent.
- [claimed-docs] “Perplexity Pro Search & Deep Research: Guided AI search for deeper exploration.”
- [claimed-docs] “Features: · Perplexity Pro Search & Deep Research: Guided AI search for deeper exploration.”
- [claimed-docs] “Trust Built In: Cited sources for every answer.”
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [community] “User used a free 12-month Perplexity Pro offer: initially useful for quick queries like recipes or manuals, but quality declined as the comp…”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
- [community] “For actual research, the user now prefers Claude or ChatGPT over Perplexity, saying results are higher quality and more accurate despite bei…”
Martinnone0/10Martin's docs mention a basic search capability that 'syncs with multiple search engines to find relevant information' (martin-docs-8), but there is no evidence of an autonomous multi-source deep-research mode that returns a structured, cited report — no mention of citation formatting, report generation, or a dedicated 'deep research' feature.
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
knowledge-workerGet answers grounded in current web results with citations back to the sources
weight 2 · round to MartinPerplexitydisputedcontradicted5/10Perplexity's docs and consumer apps clearly document web-grounded answers with inline citations across the API, apps, and browser extension (perplexity-docs-2, -12, -24, -31), and this is a core, heavily marketed feature. However, hands-on community reports concretely contradict citation quality: users report citations/links frequently mismatched to the text and Perplexity citing AI-generated 'best software' listicle spam, undermining trust in the grounding (perplexity-comm-6, perplexity-comm-11), with some users switching to Claude/ChatGPT for research quality (perplexity-comm-9). missing for 10: independent verification that citation accuracy holds up at scale, and resolution of reported citation/source mismatch issues.
- [claimed-docs] “Get web-grounded answers with built-in citations in one call, or access third-party models from OpenAI, Anthropic, Google, and xAI with web …”
- [claimed-docs] “Trust Built In: Cited sources for every answer.”
- [claimed-docs] “Cut through the clutter and get straight to credible, up-to-date answers.”
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [community] “User used a free 12-month Perplexity Pro offer: initially useful for quick queries like recipes or manuals, but quality declined as the comp…”
- [community] “For actual research, the user now prefers Claude or ChatGPT over Perplexity, saying results are higher quality and more accurate despite bei…”
- [community] “Report claims Perplexity cites AI-generated 'best software' listicle sites en masse, raising concerns about it being manipulated by SEO/AEO …”
Martin claims to sync with multiple search engines to find relevant information (martin-docs-8), suggesting web-grounded answers, but there is no evidence of citation formatting, source linking, or hands-on verification that answers include traceable citations back to web sources. Missing for 10: documentation or examples showing inline citations/source links, independent corroboration of search-grounded answer quality, and detail on which search engines/sources are used.
- [claimed-docs] “Martin syncs with multiple search engines to find you the most relevant information.”
Trust controls — stories about trust controls in this arenaTrust controls
Stories about trust controls in this arena
Admin
team-adminManage members, permissions, and data policies for my organization's workspace
weight 2 · round drawnPerplexitynone0/10No evidence in the pack mentions team/workspace admin controls, member management, permission roles, or data policy settings; all evidence covers API features, apps, CLI, and MCP integrations. This is a fair axis for a team-oriented product like Perplexity (which offers Enterprise/Team plans), but absence of any admin-console or policy documentation means it cannot be credited.
Martinnone0/10Martin's evidence pack is entirely about individual personal-assistant features (calendar, email, Slack, reminders, to-dos) with no mention of organization workspaces, member management, permission controls, or data-policy settings for teams. missing for 10: any admin console, member/role management, workspace-level permissions, or data governance policy documentation.
Data controls
knowledge-workerExport my complete chat history and account data
weight 1 · round drawnPerplexitynone0/10No evidence in the pack mentions a data export feature, account data download, or chat history export capability for Perplexity's consumer product; documentation focuses on API, MCP, CLI, and app features with no trust-controls/export functionality described.
Martinnone0/10No evidence in the pack mentions data export, chat history download, or account data portability features; community comments even raise privacy concerns without any mention of export tools. Missing for 10: any documentation or feature reference to exporting chat history or account data, data portability API, or GDPR-style export mechanism.
knowledge-workerControl whether my conversations are used to train models
weight 3 · round drawnPerplexitynone0/10No evidence in the pack addresses privacy settings, opt-out of training, or data-usage controls for conversations; all citations concern product features (search, MCP, CLI, apps) or unrelated crawler/quality controversies. This axis applies to any consumer AI product handling user conversations, so absence of evidence yields 'none'.
Martinnone0/10No evidence in the pack mentions any setting, policy, or statement about whether user conversations/data are used for model training; community comments explicitly raise privacy/trust concerns without any documented opt-out or training-control mechanism (martin-comm-2, martin-comm-3).
- [community] “I want this, but very concerned about the security and privacy - you're talking about getting my most personal of personals (email, calendar…”
- [community] “You should create a system where you cannot access user data, and it can never be shared with third parties. Make that system open source to…”
Not comparable on these axes
ai-native userRun the product headlessly / in CI for automation
weight 2 · not comparablePerplexity provides an OpenAI-compatible Agent API with structured JSON output, model fallback, sandboxed code execution, and reusable profiles, plus a dedicated `pplx` CLI explicitly designed for shell pipelines and coding agents that need current web results — all suitable for headless/CI automation. missing for 10: no independent/hands-on report confirming real-world CI pipeline usage, and no documented rate-limit/quota guidance specifically for automated batch workloads.
- [claimed-docs] “The pplx CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and co…”
- [claimed-docs] “The `pplx` CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and …”
- [claimed-docs] “The `pplx` CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and …”
- [claimed-docs] “Get accurate, up-to-date answers grounded in real-time web search, with inline citations in a single call, and conversation context across t…”
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
- [claimed-docs] “Structured output makes the model return JSON that conforms to a schema you define, so you can deserialize it directly.”
- [claimed-docs] “Model fallback enables specifying multiple models in a `models` array. The API tries each model in order until one succeeds, providing autom…”
- [claimed-docs] “A profile is a reusable, versioned configuration that you save and manage.”
- [probe] “PROBE openapi: HTTP 200 at https://docs.perplexity.ai/openapi.json — contains "openapi" key”
- [probe] “official CLI documented at https://docs.perplexity.ai/docs/cli/overview”
Martinn/aMartin is a personal AI assistant for consumer communication channels (email, Slack, phone, SMS), not a developer tool or agent framework meant to be run headlessly in CI pipelines; there's no API, CLI, or programmatic invocation model evidenced, and CI automation is not a fair category expectation for this kind of product.
ai-native userConnect an agent via an official MCP server
weight 3 · not comparablePerplexity documents two official MCP servers—the general 'Perplexity MCP Server' for search/reasoning and the 'Computer' MCP server for delegating multi-step browsing/coding tasks—explicitly stating AI assistants can connect via MCP to access these capabilities, corroborated by a probe confirming the docs page exists. Missing for 10: independent/hands-on corroboration that the MCP server works reliably in practice (community reports note the related 'Computer' feature sometimes stalls in the UI, though that's not MCP-specific).
- [claimed-docs] “The Perplexity MCP Server enables AI assistants to access Perplexity's powerful search and reasoning capabilities directly within their work…”
- [claimed-docs] “Give AI assistants the ability to complete real-world tasks using Perplexity Computer through the Model Context Protocol (MCP).”
- [claimed-docs] “Through the Model Context Protocol, your MCP client can delegate complex, multi-step work to Computer and receive structured results.”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “**Connect to 400+ services** through a managed connector framework with one-click OAuth”
- [claimed-docs] “Browser Control Computer includes a full cloud browser for tasks that go beyond search.”
- [probe] “official MCP server documented at https://docs.perplexity.ai/docs/getting-started/integrations/computer-mcp-server”
ai-native userUse an official CLI
weight 2 · not comparablePerplexity documents an official `pplx` CLI that returns structured JSON from the Search API, explicitly designed for shell pipelines, terminal work, and coding agents, with an independent probe confirming the docs page exists. Missing for 10: independent hands-on community review of the CLI itself (evidence is entirely first-party docs/probe) and detail on install/auth flows.
- [claimed-docs] “The pplx CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and co…”
- [claimed-docs] “The `pplx` CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and …”
- [claimed-docs] “The `pplx` CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and …”
- [claimed-docs] “The `pplx` CLI returns structured JSON from the Perplexity Search API, making it useful for shell pipelines, interactive terminal work, and …”
- [probe] “official CLI documented at https://docs.perplexity.ai/docs/cli/overview”
ai-native userSubscribe to events via webhooks
weight 2 · not comparablePerplexitynone0/10No evidence anywhere in the pack of a webhook subscription mechanism for events (e.g., completed jobs, search results, agent tasks); documentation covers APIs, CLI, MCP servers, and apps but no event-driven webhook system.
ai-native userTest against a sandbox environment without touching production data
weight 1 · not comparablePerplexitynone0/10Evidence only shows a code-execution sandbox (isolated Linux container) used by Perplexity's agent/Computer tools for running code within an answer, not a separate staging/test environment that lets a developer exercise the Perplexity API or product without touching live production data or billing. No mention of test API keys, staging endpoints, or a sandbox mode for the platform itself.
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “Computer can: **Search and browse** the web for real-time information, including login-gated pages * **Write and execute code** in an intera…”
Martinn/aMartin is a personal AI assistant that operates directly on a user's real calendar, inbox, Slack, etc.; there is no concept of a sandbox/test environment separate from production data in its evidence or product category. This axis fits developer-facing platforms/APIs, not a consumer assistant like Martin.
power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files
weight 3 · not comparablePerplexitydisputedcontradicted4/10Perplexity documents a code-execution sandbox (Computer MCP / Agent API 'sandbox' tool) that can write and run Python/Node code and return outputs, and Labs is pitched for 'reports and projects,' suggesting some support for computing answers/files from data. However, hands-on community reporting says the 'Computer' feature 'often fails to trigger via the UI, and when it does work, sessions frequently stall without returning an answer,' directly contradicting reliable delivery of this workflow. missing for 10: explicit evidence of chart generation, working with user-uploaded datasets, downloadable file outputs, and independent confirmation the sandbox reliably works in the consumer product.
- [claimed-docs] “Computer can: Search and browse the web for real-time information, including login-gated pages; Write and execute code in an interactive Lin…”
- [claimed-docs] “Computer can: **Search and browse** the web for real-time information, including login-gated pages * **Write and execute code** in an intera…”
- [claimed-docs] “The `sandbox` tool gives the agent an isolated Linux container to run real code and use the output in its answer”
- [claimed-docs] “Perplexity Labs: Bring your reports and projects to life faster than ever before.”
- [community] “The 'Computer' research feature in Perplexity often fails to trigger via the UI, and when it does work, sessions frequently stall without re…”
Martinn/aMartin is a personal-assistant agent for email, calendar, messaging, reminders and notes; there is no evidence of a code execution/data analysis capability for producing charts, computed answers, or downloadable files, which is outside its product category as a personal-life-admin assistant.
knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export
weight 2 · not comparablePerplexity Labs is described as helping 'bring your reports and projects to life,' hinting at document/report generation, but the evidence pack gives no detail on iterative editing, presentation creation, or exporting files to common formats. Missing for 10: iterative document/presentation editing workflow, export format support (PDF/DOCX/PPT), and any independent confirmation these outputs are usable/editable.
- [claimed-docs] “Perplexity Labs: Bring your reports and projects to life faster than ever before.”
Martinn/aMartin is a personal-assistant product focused on email, calendar, Slack, notes, todos, and reminders — not a document/presentation creation or file-editing tool. No evidence in the pack mentions creating or iteratively editing documents, presentations, or exportable files, so this axis is a category mismatch for Martin's product type.
knowledge-workerOrganize related chats and files into a project or space that shares context and instructions
weight 2 · not comparablePerplexitynone0/10The evidence pack mentions a 'Library' for curating search history but nothing about a 'Spaces'/'Projects' feature that groups chats and files with shared context or custom instructions, which is the core of this story. Missing for 10: any mention of collections/spaces, file upload grounding within a project, or persistent custom instructions per project.
Martinn/aMartin is a personal-assistant agent operating over email, calendar, Slack, notes, and to-dos for an individual user — it has no concept of 'projects' or 'spaces' grouping chats and files with shared instructions, which is a workspace/organization construct outside its product category.
knowledge-workerGenerate and edit images from natural-language prompts
weight 2 · not comparablePerplexitynone0/10The evidence pack shows Perplexity is focused on web-grounded search, citations, code sandboxes, MCP/CLI integrations, and browser automation via 'Computer,' but contains no mention of image generation or editing capabilities from natural-language prompts anywhere in the docs, app store listings, or community reports.