Undermind vs Sakana Marlin

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round drawn
   Undermind—none0/10

   Direct probes show no llms.txt, no docs.md, and no openapi spec (all 404), meaning there is no agent-consumable documentation file for a generic AI agent to fetch. The only agent-oriented artifact is the MCP server page itself, which is a different integration mechanism, not llms.txt-style docs.

   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   The llms.txt probe returned a 404, and no other evidence shows agent-oriented docs (like an API spec or agent-readable documentation) for Marlin; the evidence pack is entirely marketing copy about the product's research capabilities, not machine-readable docs.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to Undermind
   Undermind~partialprobed2/10

   Undermind's enterprise page claims 'programmatic queries via API' and integration into 'other tools and workflows,' hinting at automatable/headless use, but there is no CLI, no published API reference, and probes for OpenAPI/API docs all returned 404s. The only concretely documented automation path is the MCP server, which is designed for interactive agent clients (Cursor, VS Code, Claude) rather than headless CI pipelines. Missing for 10: documented API/CLI with auth and examples, evidence of CI/automation usage, and confirmation the enterprise API is publicly accessible rather than bespoke.

   • [claimed-docs] “Integrate Undermind's deep literature research capabilities directly into your other tools and workflows.”
   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Marlin is presented as a research-report generation web product with a UI and pay-per-use credits, with no CLI, API, SDK, or webhook documentation for headless/CI usage; probes for llms.txt and OpenAPI specs both returned 404, indicating no programmatic interface is exposed.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”
   • [claimed-docs] “Add your card. Start right away.”

   proof ↗⚑ flag

3. ai-native userUse an official CLI

   weight 2 · round drawn
   Undermind—none0/10

   Evidence shows an MCP server, API access, and web/ChatGPT app integrations, but there is no mention of an official CLI tool for Undermind anywhere in the docs or probes; llms.txt, docs-md, and openapi probes all 404, and no CLI is documented.

   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   No evidence of an official CLI; Marlin appears to be a web-based research tool with a pay-per-credit UI, and probes for API/llms.txt endpoints returned 404s, suggesting no developer-facing interface is exposed.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

4. ai-native userDrive the product through a documented public API

   weight 3 · round to Undermind
   Undermind~partialprobed5/10

   Undermind documents a public MCP server (mcp.undermind.ai) with clear tool definitions for search, PDF Q&A, and workspace notes, which does let an AI agent drive the product programmatically (undermind-docs-3,4,5,13,14,15,19). However, a general documented REST/OpenAPI-style public API is only vaguely alluded to ('Programmatic queries via API' under Enterprise) and probes for llms.txt, docs.md, and openapi/swagger specs all return 404s, indicating no broadly published API reference. Missing for 10: a public OpenAPI/Swagger spec or REST API docs, and confirmation that the enterprise API is self-serve rather than sales-gated.

   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “This adds Undermind to VS Code as an MCP server.”
   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [claimed-docs] “Point the client at `https://mcp.undermind.ai/mcp`”
   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”
   • [probe] “official MCP server documented at https://undermind.ai/mcp”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   No documented public API is evidenced; probes for llms.txt and OpenAPI/swagger endpoints all returned 404s, and all other evidence describes the product's research capabilities, not a programmatic interface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

5. ai-native userBuild against official SDKs

   weight 2 · round drawn
   Undermind—none0/10

   Evidence only mentions a vague 'Programmatic queries via API' for enterprise customers and an MCP server, but no official SDKs (client libraries, language bindings) are documented; probes for OpenAPI specs and docs (llms.txt, mcp.md, openapi.json) all return 404, indicating no public developer SDK resources exist.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   No evidence of any official SDK, API, or developer library for Marlin; probes for llms.txt and OpenAPI specs both returned 404, and all docs describe an end-user research product with no mention of programmatic/SDK access.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

6. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   Undermind—none0/10

   The evidence mentions a notification feature for new papers (undermind-docs-9) but nothing indicates this is delivered via webhooks or any programmatic subscription mechanism; no webhook API, endpoint, or docs are present, and probes for API/openapi specs all 404.

   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   No evidence of a webhook or event subscription mechanism; probes for API/OpenAPI specs returned 404s and docs focus only on research report generation. Missing for 10: any webhook documentation, event subscription API, or callback mechanism.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round drawn
   Undermind✓fullcommunity8/10

   Undermind's core capability is AI-generated synthesis and insight extraction from literature data: it runs deep research plans, produces ranked papers with written synthesis, answers cross-paper questions from PDFs, traces citations, and proactively notifies users of new relevant papers—all generated from the user's research data within the product. Community reviews corroborate that these AI-derived insights are often more useful than manual search (undermind-comm-2, undermind-comm-6, undermind-comm-15, undermind-comm-16), though some found gaps in coverage (undermind-comm-1, undermind-comm-4). Missing for 10: independent verification of insight/synthesis accuracy at scale and clearer support for arbitrary user-uploaded (non-literature) datasets.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”

   proof ↗⚑ flag

   Sakana Marlin✓fullclaimed8/10

   Marlin autonomously researches user-provided topics, mapping causal relationships, comparing hypotheses, and generating structured strategic insights and reports with citations, going beyond simple summarization. Missing for 10: independent/hands-on third-party validation beyond vendor-curated testimonials, and no visibility into underlying data/insight quality benchmarks.

   • [claimed-docs] “Sakana Marlin maps the causal relationships at work in complex business environments and organizes them into structured strategic options.”
   • [claimed-docs] “It does more than summarize. Sakana Marlin maps the causal relationships at work in complex business environments and organizes them into st…”
   • [claimed-docs] “Rather than merely aggregating information, it compares and evaluates multiple hypotheses to provide deep insights.”
   • [claimed-docs] “From ideation and data gathering to resolving contradictions and structuring the report, the AI autonomously executes the entire research pr…”
   • [claimed-docs] “The research was of extremely high quality, grounded strictly in primary sources, resulting in a highly convincing and reliable final report…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Sakana Marlin
   Undermind~partialclaimed3/10

   The only evidence of background automation is a single line about being notified when relevant papers are published, with no detail on how such alerts are configured, scheduled, or run autonomously as multi-step agent workflows. missing for 10: documentation of automation/scheduling setup, evidence of autonomous multi-step background agent tasks, and any hands-on confirmation of the notification feature working.

   • [claimed-docs] “Get notified whenever relevant papers are published.”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed6/10

   Marlin's docs clearly describe a single research task running autonomously for up to ~8 hours without further human input once a topic is set (docs-9, docs-10, docs-16), which matches the 'runs in background autonomously' idea. However, this is a one-shot session, not a recurring/scheduled automation you configure and forget — there's no evidence of triggers, schedules, or multi-run automation management typical of 'set up automations.' Missing for 10: scheduled/recurring automation setup, background job management UI, independent hands-on corroboration of unattended runtime.

   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [claimed-docs] “From ideation and data gathering to resolving contradictions and structuring the report, the AI autonomously executes the entire research pr…”
   • [claimed-docs] “It is designed for use cases where you want to delegate everything up to "issue framing (agenda setting)" prior to decision-making to the AI…”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Sakana Marlin
   Undermind—none0/10

   Undermind is positioned as an MCP server/tool that other AI clients (Cursor, Claude, ChatGPT) connect to, not as a product with its own built-in AI assistant that users delegate tasks to within Undermind itself; evidence describes it being added to external agent tools rather than an in-product assistant. missing for 10: any evidence of a native, built-in AI assistant/chat agent inside Undermind's own UI that a user can delegate tasks to.

   • [claimed-docs] “This adds Undermind directly to Cursor”
   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “Undermind is available as a published ChatGPT app.”

   proof ↗⚑ flag

   Sakana Marlin✓fullclaimed8/10

   Marlin is explicitly designed as a built-in AI agent that users delegate entire research/strategy tasks to, working autonomously for hours with minimal human input beyond initial framing (docs-1, docs-9, docs-10, docs-16, docs-21). This directly matches the story of delegating tasks to a built-in assistant within the product. Missing for 10: independent/hands-on verification beyond vendor testimonials, and detail on interactive control while a task is delegated.

   • [claimed-docs] “Once you set a research topic, it works without further human input: repeatedly forming hypotheses, gathering information, navigating the we…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [claimed-docs] “From ideation and data gathering to resolving contradictions and structuring the report, the AI autonomously executes the entire research pr…”
   • [claimed-docs] “It is designed for use cases where you want to delegate everything up to "issue framing (agenda setting)" prior to decision-making to the AI…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Undermind
   Undermind✓fullprobed8/10

   Undermind ships an official MCP server (Cursor, VS Code, Claude, ChatGPT app) that lets users issue open-ended natural-language research goals which the tool autonomously plans, searches, and synthesizes into reports, fitting the ai-native/agentic story well. Missing for 10: independent hands-on confirmation of the MCP natural-language workflow specifically (community evidence covers the web search UI, not the MCP NL commands) and any public usage examples/logs.

   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “This adds Undermind to VS Code as an MCP server.”
   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [claimed-docs] “Undermind is available as a published ChatGPT app.”
   • [probe] “official MCP server documented at https://undermind.ai/mcp”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed5/10

   Marlin is initiated by giving it a research topic and a brief natural-language exchange to set direction (docs-10), suggesting natural-language input drives its operation, but there is no evidence of a broader natural-language command interface (e.g., chat-style control, follow-up instructions, or command syntax) beyond initial topic-setting. Missing for 10: documentation of ongoing NL command/control during execution, examples of varied NL commands, independent/hands-on confirmation of NL interaction quality.

   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “It is designed for use cases where you want to delegate everything up to "issue framing (agenda setting)" prior to decision-making to the AI…”

   proof ↗⚑ flag

Api quality

1. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Undermind—none0/10

   Undermind mentions 'Programmatic queries via API' for enterprise but there is no evidence of a downloadable OpenAPI/Swagger spec; direct probes for openapi.json, swagger.json, and llms.txt all returned 404. Missing for 10: any published machine-readable API spec, documented API schema, or discoverable spec endpoint.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Probes for OpenAPI/swagger spec files and llms.txt all returned 404, and no documentation mentions a machine-readable API spec. Missing for 10: any published OpenAPI/Swagger file, API reference docs, or equivalent machine-readable spec.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

2. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Undermind—none0/10

   There is a mention of a 'Programmatic queries via API' for enterprise, but no evidence of versioning or a documented deprecation policy; probes for OpenAPI/docs all returned 404s. Missing for 10: any API versioning scheme, changelog, or deprecation policy documentation.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   No evidence of any public API, versioning scheme, or deprecation policy; probes for OpenAPI/llms.txt endpoints returned 404s, and all docs describe the research product itself, not a developer API. Missing for 10: any API documentation, versioning scheme, deprecation policy.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Undermind
   Undermind~partialclaimed6/10

   Undermind's MCP tools explicitly support bulk-style operations: reading full-text PDFs in parallel and answering questions across many papers at once, and running a deep literature review that autonomously searches and synthesizes across large numbers of papers. Enterprise API access also enables programmatic bulk queries. However, there is no evidence of bulk editing/tagging/exporting or batch management operations across items (e.g., bulk-star, bulk-move to folders) — missing for 10: documented batch update/edit/export APIs, evidence of bulk actions beyond reading/analysis, independent verification of parallel-processing claims.

   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Programmatic queries via API”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   All evidence describes Marlin running a single autonomous research task per topic (one report, one investigation) rather than processing many items/topics in bulk; no mention of batch submission, multi-item queues, or parallel bulk execution.

   ⚑ flag

2. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   Undermind—none0/10

   There's a notification feature for new papers (undermind-docs-9) but no evidence of scheduling recurring jobs/workflows, cron-like automation, or configurable recurring tasks; the product focuses on on-demand deep research via MCP tools rather than persistent scheduled automation.

   • [claimed-docs] “Get notified whenever relevant papers are published.”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Sakana Marlin is a single-run autonomous research/report tool triggered by a user topic; no evidence of scheduling, recurrence, cron-like triggers, or workflow automation for repeated jobs. Probes also show no API/OpenAPI surface that could support scheduled invocation.

   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

Sharing

1. analystShare a research session or report with collaborators who can view or build on it

   weight 2 · round drawn
   Undermind—none0/10

   Evidence covers workspace files, folders, and note creation but never mentions sharing sessions/reports with collaborators, multi-user access, or permission controls. missing for 10: any mention of sharing/collaboration features, invite/permission mechanisms, or multi-user workspace access.

   ⚑ flag

   Sakana Marlin—none0/10

   No evidence describes any collaboration or sharing features—no mention of shared workspaces, links, comments, or multi-user access to reports/sessions; the pack only covers autonomous research generation, pricing tiers, and API probes returning 404s.

   • [claimed-docs] “We have made Marlin available as a pay-per-use tier to monthly Pro, Team, and Enterprise-tier plans.”
   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

Alerts

1. researcherSet up standing searches or alerts that surface new relevant sources as they appear

   weight 1 · round to Undermind
   Undermind~partialclaimed6/10

   Undermind explicitly offers a 'Get notified whenever relevant papers are published' alert feature, which directly matches the standing-search/alert story, plus curated folders and starred papers for ongoing tracking. However, there is no independent/hands-on evidence of how the alert system works in practice (frequency, delivery channel, reliability), and community discussion focuses on one-off search quality rather than alerting. Missing for 10: independent corroboration of alert functionality, details on alert configuration/frequency, and hands-on user reports of ongoing alerts working as described.

   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Marlin is a one-shot deep-research report generator that runs autonomously for a single session (up to ~8 hours) and produces a report; there is no evidence of standing searches, saved alerts, or recurring monitoring for new sources over time.

   ⚑ flag

Corpus

1. researcherUpload my own PDFs or corpus and have the agent research over them

   weight 2 · round drawn
   Undermind—none0/10

   Evidence shows Undermind reads full-text PDFs and lets users curate/star papers discovered via its own search engine, but nothing indicates a feature to upload arbitrary personal PDFs or a private corpus for the agent to research over — all workflows described start from Undermind's own literature search rather than user-supplied documents.

   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Evidence describes Marlin as an autonomous web-research agent that gathers information via web navigation and generates reports, but there is no mention of uploading a user's own PDFs or corpus for the agent to research over. Missing for 10: any document/file upload feature, corpus ingestion, or evidence of researching over user-supplied materials rather than open web sources.

   ⚑ flag

Reviews

1. researcherRun a systematic screening and extraction workflow across many papers with consistent criteria

   weight 2 · round to Undermind
   Undermind~partialcommunity6/10

   Undermind's MCP tools support open-ended literature review with ranked results, full-text PDF question-answering across many papers, and note/synthesis creation, which covers much of a screening-and-extraction workflow (undermind-docs-4, undermind-docs-5, undermind-docs-6, undermind-docs-7). However, there is no evidence of formal criteria-based screening (e.g., inclusion/exclusion rules) or structured, consistent extraction fields across a batch of papers, and community feedback notes gaps in coverage (missed gray literature/theses) that could undermine consistency (undermind-comm-1, undermind-comm-4). Missing for 10: explicit support for defined screening criteria, structured/consistent extraction schema, and independent validation of consistency at scale.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [community] “OK, I'm both impressed and disappointed. It seems to rely too much on citation count, and I don't see much dissertations/theses in the resul…”
   • [community] “Overall, I am impressed, and I can easily imagine my lab paying for this... but it seems to have missed a lot of the gray literature, partic…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Marlin is positioned as an autonomous business/market strategy research agent producing single deep-dive reports, not as a tool for systematic multi-paper screening/extraction with consistent criteria (a literature-review workflow). No evidence describes handling many papers, applying consistent inclusion/extraction criteria, or batch processing across a corpus — the described unit of work is one topic producing one report.

   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “It is designed for use cases where you want to delegate everything up to "issue framing (agenda setting)" prior to decision-making to the AI…”
   • [claimed-docs] “putting Marlin to work on real tasks such as strategy formulation, market research, risk analysis, and competitive analysis”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Undermind
   Undermind~partialprobed5/10

   Undermind exposes core research capabilities (deep literature search, PDF Q&A, note creation, curation, starring) via an official MCP server, and separately claims 'Programmatic queries via API' for enterprise customers, showing some AI-native parity. However, there is no public API/OpenAPI documentation (all probes 404), no evidence that UI-only features like notifications/alerts or workspace management are exposed programmatically, and the API claim is a single unelaborated enterprise line rather than a documented full-parity API. Missing for 10: public API docs/OpenAPI spec, confirmation that all UI features (alerts, workspace/library management) are API-accessible, and independent verification of API completeness.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”
   • [claimed-docs] “Programmatic queries via API”
   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   No evidence of any public API for Sakana Marlin; probes for llms.txt and OpenAPI spec both returned 404, and all documentation describes only UI/credit-based access.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”
   • [claimed-docs] “Add your card. Start right away.”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round drawn
   Undermind—none0/10

   No evidence of any data export feature or open-format export capability for user data/papers/workspaces; probes for docs/API endpoints also 404. The evidence covers MCP integration and search quality, not data portability or export/leave capability.

   ⚑ flag

   Sakana Marlin—none0/10

   No evidence of data export, open-format download, or account portability features; probes for llms.txt and OpenAPI both returned 404, and docs only describe generated reports/slides, not export of underlying user data.

   • [probe] “PROBE llms.txt: HTTP 404 at https://sakana.ai/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://sakana.ai/openapi.json, https://sakana.ai/swagger.json, https://sakana.ai/api/openapi.json, …”

   proof ↗⚑ flag

Pricing

1. researcherTry the product meaningfully on a free tier or trial

   weight 1 · round to Undermind
   Undermind!disputedcontradicted4/10

   Docs imply a tiered system (e.g. '10x higher usage limits' for paid vs default) suggesting a free/limited tier exists, but community evidence shows a hard institutional/company email requirement blocking sign-up, with an independent researcher explicitly reporting they 'can't get in' and another calling the requirement 'obnoxious' and a 'roadblock' — concretely contradicting the ability for many researchers to try it meaningfully for free. Missing for 10: explicit vendor documentation of a free tier or trial with stated limits, and confirmation the email gate has been removed or has an exception path for independent researchers.

   • [claimed-docs] “Deepest analysis of full texts 10x higher usage limits Unlimited workspaces, files, and paper libraries”
   • [community] “Independent researcher without academic address; can't get in. Best of luck.”
   • [community] “'Please use a valid institutional or company email address.' This is obnoxious. Please remove this unnecessary roadblock.”

   proof ↗⚑ flag

   Sakana Marlin—none0/10

   Marlin is explicitly pay-per-use available only to paid Pro/Team/Enterprise plans, requires adding a card to start, and cancelling mid-run still consumes credits — there is no free tier or trial for researchers to test it meaningfully.

   • [claimed-docs] “We have made Marlin available as a pay-per-use tier to monthly Pro, Team, and Enterprise-tier plans.”
   • [claimed-docs] “Add your card. Start right away.”
   • [claimed-docs] “You can cancel at any time during execution, but please note that credits will still be consumed.”
   • [claimed-docs] “Add-on credits available (¥98 / credit)”

   proof ↗⚑ flag

2. researcherUnderstand plan pricing and usage limits before committing

   weight 2 · round to Sakana Marlin
   Undermind—none0/10

   Evidence includes only a fragmentary marketing snippet ('10x higher usage limits, unlimited workspaces...') with no actual price points, plan names, or explicit usage caps, and no dedicated pricing page is cited. A researcher cannot compare plans or understand limits before committing from this evidence alone.

   • [claimed-docs] “Deepest analysis of full texts 10x higher usage limits Unlimited workspaces, files, and paper libraries”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed4/10

   Marlin's docs mention it's offered as a pay-per-use add-on to Pro/Team/Enterprise plans, credits are consumed even if cancelled mid-run, and additional credits cost ¥98 each, giving a researcher some pricing signal. However, there's no concrete breakdown of how many credits a typical run consumes, no explicit usage caps, and no comparison table of plan tiers — missing for 10: full plan pricing table, credit-consumption-per-task estimates, explicit usage limits, independent/hands-on cost verification.

   • [claimed-docs] “You can cancel at any time during execution, but please note that credits will still be consumed.”
   • [claimed-docs] “We have made Marlin available as a pay-per-use tier to monthly Pro, Team, and Enterprise-tier plans.”
   • [claimed-docs] “Add-on credits available (¥98 / credit)”
   • [claimed-docs] “Add your card. Start right away.”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Undermind—none0/10

   No evidence in the pack mentions data residency, regional storage options, or any data-location controls for Undermind. missing for 10: any mention of region selection, data residency policy, or storage location controls.

   ⚑ flag

   Sakana Marlin—none0/10

   No evidence in the pack mentions data residency, region selection, or storage location controls for Sakana Marlin; the evidence covers only research capabilities and pricing.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   Undermind—none0/10

   No evidence in the pack addresses data privacy, opt-out of AI training, or data usage policies for Undermind; nothing here confirms or denies such a control exists.

   ⚑ flag

   Sakana Marlin—none0/10

   No evidence in the pack addresses data-training opt-out, privacy controls, or data usage policy for Sakana Marlin; missing for 10: any mention of training opt-out settings, privacy policy, or data retention controls.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   Undermind—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy/data-handling settings for Undermind; all evidence concerns search quality, MCP integration, and product features. This axis applies to any AI-native product handling user data/queries, but there is no documented capability for controlling or deleting stored data.

   ⚑ flag

   Sakana Marlin—none0/10

   No evidence in the pack addresses data retention, deletion controls, or privacy settings for Marlin; the evidence pack only covers research capabilities, pricing, and product marketing.

   ⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round drawn
   Undermind—none0/10

   No evidence in the pack mentions telemetry, usage tracking, opt-out settings, or privacy controls for Undermind; all evidence covers product features, MCP integration, and general reception.

   ⚑ flag

   Sakana Marlin—none0/10

   No evidence in the pack addresses telemetry, usage tracking, or any privacy/opt-out controls for Sakana Marlin. Missing for 10: any documentation of telemetry practices, an opt-out mechanism, or privacy policy details.

   ⚑ flag

Reports

1. researcherExport results to common formats, including documents, spreadsheets, and reference-manager files

   weight 1 · round to Sakana Marlin
   Undermind—none0/10

   Evidence shows Undermind creates/edits Markdown notes and reports with citations, and can curate/star papers, but there is no mention of exporting to common document formats (e.g., Word/PDF), spreadsheets (e.g., CSV/Excel), or reference-manager formats (e.g., BibTeX, RIS, EndNote).

   ⚑ flag

   Sakana Marlin~partialclaimed4/10

   Marlin auto-generates full reports with references and PowerPoint slides (docs-3, docs-9, docs-20), covering the 'documents' part of the story, but there is no evidence of spreadsheet export or reference-manager file formats (e.g., BibTeX/RIS/EndNote) for citations. missing for 10: spreadsheet export, reference-manager file export (BibTeX/RIS/EndNote), independent corroboration of export formats.

   • [claimed-docs] “Everything from the main body to appendices, references, and presentation slides is automatically generated — at a quality that stands along…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “From a fully referenced report to PowerPoint slides, everything is automatically generated — at a quality that stands alongside professional…”

   proof ↗⚑ flag

2. analystGet a structured report with sections, tables, and a summary that I can share with stakeholders

   weight 3 · round to Sakana Marlin
   Undermind~partialclaimed5/10

   Undermind produces a ranked list of papers with a written synthesis and can create/edit Markdown notes, syntheses, and reports with citations linking back to sources, which supports shareable structured output. However, there is no evidence of built-in tables, formal 'sections' structuring, or a dedicated stakeholder-facing report/export format beyond Markdown notes. Missing for 10: explicit table generation, multi-section report templates, and export/sharing formats (PDF/Word) for stakeholders beyond in-workspace Markdown.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”

   proof ↗⚑ flag

   Sakana Marlin✓fullclaimed7/10

   Docs describe autonomous generation of a full structured report with main body, appendices, references, and presentation slides/executive summary — directly matching sections, tables (implied by structured strategic options), and summary needs for stakeholder sharing. Missing for 10: no independent/hands-on verification of table formatting or actual sample report shown, and no evidence beyond vendor marketing copy.

   • [claimed-docs] “Everything from the main body to appendices, references, and presentation slides is automatically generated — at a quality that stands along…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “From a fully referenced report to PowerPoint slides, everything is automatically generated — at a quality that stands alongside professional…”
   • [claimed-docs] “Sakana Marlin maps the causal relationships at work in complex business environments and organizes them into structured strategic options.”

   proof ↗⚑ flag

Agent runs

1. researcherPose a research question and get an autonomous multi-step investigation, not just a single-pass summary

   weight 3 · round drawn
   Undermind✓fullcommunity8/10

   Docs explicitly describe an autonomous multi-step deep literature review agent that plans its own searches, follows citations and key authors, reads full-text PDFs in parallel, and stops only when new searches stop finding relevant papers — not a single-pass summary. Community reviews corroborate multi-minute, iterative search behavior yielding comprehensive results beyond a simple query-response. Missing for 10: independent technical breakdown of the multi-step planning/agentic loop and more recent hands-on validation of the 'stops when exhausted' claim.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Plans its own searches, follows citations and key authors, and stops only when new searches stop finding relevant papers.”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [community] “Been using Undermind for several months now and it's honestly been a lifesaver in getting a comprehensive understanding of a research topic.”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”

   proof ↗⚑ flag

   Sakana Marlin✓fullclaimed8/10

   Vendor docs describe autonomous multi-step research: forming hypotheses, gathering info, resolving contradictions, running for hours across thousands of cycles without further human input, producing a full structured report - directly matching the story. This is corroborated by beta-tester quotes praising depth beyond chat-based research tools, though all evidence is vendor-published/testimonial rather than independent hands-on verification. missing for 10: independent third-party evaluation or benchmark of the autonomous multi-step process, technical detail on how contradictions/hypotheses are actually verified

   • [claimed-docs] “Once you set a research topic, it works without further human input: repeatedly forming hypotheses, gathering information, navigating the we…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [claimed-docs] “From ideation and data gathering to resolving contradictions and structuring the report, the AI autonomously executes the entire research pr…”
   • [claimed-docs] “Many told us that Marlin was more practical at digging deeply into information than the chat-based research tools they had used before”
   • [claimed-docs] “Rather than merely aggregating information, it compares and evaluates multiple hypotheses to provide deep insights.”

   proof ↗⚑ flag

2. analystStart a long research job that keeps working unattended and notifies me when the result is ready

   weight 2 · round to Sakana Marlin
   Undermind~partialcommunity5/10

   Undermind's deep literature review runs autonomously, planning its own searches and stopping only when exhausted (undermind-docs-4/16), and it has a notification feature for relevant papers (undermind-docs-9), suggesting async, unattended operation. However, the notification feature is documented as an ongoing 'new paper published' alert rather than a 'job complete, come see results' notification, and community reports describe run times of minutes (3-6 min) rather than long unattended background jobs (undermind-comm-14/15/16). Missing for 10: explicit documentation that a single research job can run for extended/unattended periods (hours+) and trigger a completion notification, plus independent confirmation of this exact workflow.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Plans its own searches, follows citations and key authors, and stops only when new searches stop finding relevant papers.”
   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [community] “Hmm, does this just use traditional term frequency search under the hood with query expansion? Using GPT4 as a cross encoder seems really wa…”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed6/10

   Vendor docs clearly describe long unattended autonomous research runs (~8 hours) producing full reports, which supports the core of the story, but there is no mention of a notification mechanism when results are ready and no independent/hands-on corroboration beyond marketing copy. missing for 10: evidence of a completion notification/alert feature, independent verification of unattended runtime and reliability, and API/technical docs confirming job-control (start/monitor/cancel) beyond the marketing page.

   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [claimed-docs] “Once you set a research topic, it works without further human input: repeatedly forming hypotheses, gathering information, navigating the we…”
   • [claimed-docs] “You can cancel at any time during execution, but please note that credits will still be consumed.”

   proof ↗⚑ flag

3. researcherSteer the depth, effort, and scope of a research run before or while it executes

   weight 1 · round to Sakana Marlin
   Undermind—none0/10

   Undermind's research runs are described as fully autonomous — it 'plans its own searches... and stops only when new searches stop finding relevant papers' (undermind-docs-4, undermind-docs-16), with no documented controls for setting depth, effort, or scope before or during a run. A user comment notes confusion about the 'Discovery Progress and Exhaustiveness' indicator (undermind-comm-16), suggesting only passive visibility, not steering. No evidence of parameters, sliders, or mid-run adjustments exists in the pack.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Plans its own searches, follows citations and key authors, and stops only when new searches stop finding relevant papers.”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed4/10

   Marlin only allows a brief initial exchange to set direction before running fully autonomously for up to ~8 hours with no mid-run steering, and there's no documented control over depth/effort/scope parameters (e.g., report length, time budget, source breadth) beyond the initial topic framing; cancellation is possible but not adjustment. missing for 10: mid-execution steering controls, explicit depth/effort/scope parameters or settings, independent evidence of pre-run configurability beyond a 'brief exchange'.

   • [claimed-docs] “Sakana Marlin sharpens the direction of the investigation through a brief exchange with the user. Once the course is set, it works without f…”
   • [claimed-docs] “Give it a research topic, and Marlin works autonomously for up to roughly eight hours, crafting a detailed strategy report up to a hundred p…”
   • [claimed-docs] “You can cancel at any time during execution, but please note that credits will still be consumed.”
   • [claimed-docs] “It is designed for use cases where you want to delegate everything up to "issue framing (agenda setting)" prior to decision-making to the AI…”

   proof ↗⚑ flag

Citations

1. researcherSee citations for every substantive claim so I can verify it against the underlying source

   weight 3 · round to Undermind
   Undermind✓fullcommunity7/10

   Undermind's docs explicitly claim in-line citations traceable to source papers ([undermind-docs-12], [undermind-docs-6]) and community reviews corroborate it reliably surfaces cited references (e.g. [undermind-comm-8] notes it 'solves' the reference-provision problem unlike a chatbot). However, no independent hands-on verification of citation accuracy/completeness at the claim level is present, and some reviewers note gaps in coverage (missing gray literature/theses) which could affect verifiability of some claims. Missing for 10: independent audit of citation accuracy per-claim, and confirmation citations withstand scrutiny across all source types.

   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [community] “Compared roughly similar research questions using Claude 3.5 Sonnet and Undermind. Claude is reluctant to provide references, but Undermind …”
   • [community] “OK, I'm both impressed and disappointed. It seems to rely too much on citation count, and I don't see much dissertations/theses in the resul…”
   • [community] “Overall, I am impressed, and I can easily imagine my lab paying for this... but it seems to have missed a lot of the gray literature, partic…”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed5/10

   Vendor docs claim Marlin generates 'fully referenced reports' grounded in primary sources with appendices and references, and a testimonial praises its higher-quality citations to primary vs secondary sources, suggesting citation support exists. However, there is no independent verification, no example of inline citation format, and no detail on how claims map to sources for auditability. Missing for 10: independent hands-on verification of citation accuracy, example output showing citation linking, and confirmation citations are traceable/clickable to primary sources.

   • [claimed-docs] “The research was of extremely high quality, grounded strictly in primary sources, resulting in a highly convincing and reliable final report…”
   • [claimed-docs] “他の生成AIと比較して、引用される情報の量と質が高く、二次情報ではなく一次情報を参照できている点に優位性を感じました。”
   • [claimed-docs] “From a fully referenced report to PowerPoint slides, everything is automatically generated — at a quality that stands alongside professional…”
   • [claimed-docs] “Everything from the main body to appendices, references, and presentation slides is automatically generated — at a quality that stands along…”

   proof ↗⚑ flag

Corpus

1. researcherSearch scholarly literature and primary sources, not just the open web

   weight 2 · round to Undermind
   Undermind✓fullcommunity8/10

   Undermind is purpose-built for scholarly literature search: it runs deep literature reviews over papers, reads full-text PDFs including figures/tables/equations, and traces claims back to source papers via citations, with independent community reports confirming it surfaces relevant academic papers beyond Google Scholar. Some community feedback notes gaps in coverage (dissertations, gray literature), which tempers but doesn't negate the core capability. Missing for 10: no independent benchmark on primary-source/preprint coverage breadth, and some users report missed gray literature/theses.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [claimed-docs] “Undermind's v1 search engine delivered 10x better results than Google Scholar”
   • [community] “This is a nice search engine. I found it to be more effective than crawling with Google Scholar. Good work guys!”
   • [community] “As a CS academic, the top 10 results contained two items I really ought to have found myself... overall I'm very impressed with this.”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”
   • [community] “OK, I'm both impressed and disappointed. It seems to rely too much on citation count, and I don't see much dissertations/theses in the resul…”
   • [community] “Overall, I am impressed, and I can easily imagine my lab paying for this... but it seems to have missed a lot of the gray literature, partic…”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed6/10

   Vendor docs claim research is 'grounded strictly in primary sources' and a testimonial notes it references primary rather than secondary information compared to other generative AI tools, but there is no evidence of dedicated scholarly database access (e.g., PubMed, arXiv, JSTOR integration) or citation verification—only general web navigation is described. missing for 10: evidence of scholarly/academic database integration, independent verification of primary-source claim, and details on how it distinguishes scholarly vs open-web sources.

   • [claimed-docs] “The research was of extremely high quality, grounded strictly in primary sources, resulting in a highly convincing and reliable final report…”
   • [claimed-docs] “他の生成AIと比較して、引用される情報の量と質が高く、二次情報ではなく一次情報を参照できている点に優位性を感じました。”
   • [claimed-docs] “Once you set a research topic, it works without further human input: repeatedly forming hypotheses, gathering information, navigating the we…”
   • [claimed-docs] “From ideation and data gathering to resolving contradictions and structuring the report, the AI autonomously executes the entire research pr…”

   proof ↗⚑ flag

Synthesis

1. analystSee where sources agree and disagree instead of a single unqualified answer

   weight 2 · round to Sakana Marlin
   Undermind—none0/10

   The evidence pack describes literature search, synthesis, citation tracing, and PDF Q&A features, but nowhere does it mention surfacing conflicting findings, agreement/disagreement across sources, or qualifying claims by consensus vs. dispute. Citation tracing (docs-12) only supports tracing a single claim to its source, not comparing multiple sources' stances. Missing for 10: any feature or documentation showing detection/display of cross-source agreement or contradiction, any UI element flagging conflicting conclusions, community evidence of this behavior.

   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”

   proof ↗⚑ flag

   Sakana Marlin~partialclaimed4/10

   Marketing copy claims Marlin 'resolves contradictions' and 'compares and evaluates multiple hypotheses' rather than merely aggregating, implying some handling of conflicting sources, but there is no evidence of a UI feature or report section that explicitly surfaces where sources agree/disagree to the analyst. Missing for 10: concrete example of a report showing conflicting source viewpoints, screenshot/description of how disagreement is presented, independent corroboration beyond vendor marketing.

   • [claimed-docs] “Once you set a research topic, it works without further human input: repeatedly forming hypotheses, gathering information, navigating the we…”
   • [claimed-docs] “From ideation and data gathering to resolving contradictions and structuring the report, the AI autonomously executes the entire research pr…”
   • [claimed-docs] “Rather than merely aggregating information, it compares and evaluates multiple hypotheses to provide deep insights.”

   proof ↗⚑ flag