Elicit vs Undermind

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to Elicit
   Elicit✓fullprobed8/10

   Elicit hosts a live llms.txt at support.elicit.com/llms.txt (HTTP 200, confirmed via probe) listing agent-oriented docs, and it also exposes an official MCP server for agent access, showing genuine agent-oriented documentation infrastructure. missing for 10: no independent/community corroboration of an agent actually consuming llms.txt successfully, and no OpenAPI/agent-doc spec beyond the llms.txt itself.

   • [probe] “PROBE llms.txt: HTTP 200 at https://support.elicit.com/llms.txt # Elicit Help Center > Help center for Elicit ## Getting Started - [Getti…”
   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind—none0/10

   Direct probes show no llms.txt, no docs.md, and no openapi spec (all 404), meaning there is no agent-consumable documentation file for a generic AI agent to fetch. The only agent-oriented artifact is the MCP server page itself, which is a different integration mechanism, not llms.txt-style docs.

   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to Elicit
   Elicit~partialclaimed6/10

   Elicit documents an API (and MCP server) explicitly for running its search/report/systematic-review capabilities 'from your own code, scripts, and workflows,' which supports headless/automated use outside the UI. However, there's no explicit CI/pipeline example, and API access appears gated as a paid plan feature rather than a fully documented automation-first workflow. Missing for 10: explicit CI/automation examples or tutorials, rate-limit/auth details for unattended use, and independent confirmation that the API works reliably in automated pipelines.

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [claimed-docs] “API access”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind~partialprobed2/10

   Undermind's enterprise page claims 'programmatic queries via API' and integration into 'other tools and workflows,' hinting at automatable/headless use, but there is no CLI, no published API reference, and probes for OpenAPI/API docs all returned 404s. The only concretely documented automation path is the MCP server, which is designed for interactive agent clients (Cursor, VS Code, Claude) rather than headless CI pipelines. Missing for 10: documented API/CLI with auth and examples, evidence of CI/automation usage, and confirmation the enterprise API is publicly accessible rather than bespoke.

   • [claimed-docs] “Integrate Undermind's deep literature research capabilities directly into your other tools and workflows.”
   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

3. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round drawn
   Elicit—none0/10

   Evidence shows Elicit exposes itself AS an MCP server for other clients (e.g., Claude Desktop) to consume its research tools (elicit-docs-28, elicit-docs-35), not the reverse capability of Elicit acting as an MCP client that plugs in external MCP servers to use their tools. No evidence exists that Elicit can connect to and use third-party MCP servers.

   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind—none0/10

   All MCP-related evidence describes Undermind acting as an MCP *server* that other clients (Cursor, VS Code, Claude, ChatGPT) can plug into to use Undermind's own tools — the reverse of this story, which asks whether a user can plug external MCP servers into Undermind so it can use their tools. No evidence shows Undermind hosting/consuming external MCP servers as a client.

   • [claimed-docs] “This adds Undermind directly to Cursor”
   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “This adds Undermind to VS Code as an MCP server.”
   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [claimed-docs] “Undermind works with any MCP-compatible client.”
   • [claimed-docs] “Undermind is available as a published ChatGPT app.”

   proof ↗⚑ flag

4. ai-native userConnect an agent via an official MCP server

   weight 3 · round drawn
   Elicit✓fullclaimed8/10

   Elicit provides an official documented MCP server endpoint (claude mcp add --transport http elicit https://elicit.com/api/mcp) exposing full API functionality for use from Claude Desktop, Claude Code, and other MCP-compatible clients. missing for 10: no independent/hands-on corroboration of the MCP server working, and no detail on auth/tool-list scope beyond the docs.

   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind✓fullprobed8/10

   Undermind publishes an official hosted MCP server (mcp.undermind.ai/mcp) with documented setup instructions for Cursor, VS Code, Claude, and any MCP-compatible client, plus specific tool capabilities (literature review, PDF Q&A, notes, curation). This is first-party documentation with concrete transport/endpoint details, confirmed by probe evidence of the docs page existing. Missing for 10: independent/hands-on community confirmation specifically of MCP connectivity (community evidence only covers the web search product, not MCP usage) and no public API schema (openapi probes 404).

   • [claimed-docs] “This adds Undermind directly to Cursor”
   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “This adds Undermind to VS Code as an MCP server.”
   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [claimed-docs] “Point the client at `https://mcp.undermind.ai/mcp`”
   • [claimed-docs] “Undermind works with any MCP-compatible client.”
   • [probe] “official MCP server documented at https://undermind.ai/mcp”

   proof ↗⚑ flag

5. ai-native userUse an official CLI

   weight 2 · round drawn
   Elicit—none0/10

   Evidence shows Elicit offers an API and an MCP server for programmatic/agentic access, but there is no mention anywhere of an official command-line interface (CLI) tool. Since API-based products could plausibly ship a CLI, absence of evidence means this axis is unmet rather than inapplicable.

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”

   proof ↗⚑ flag

   Undermind—none0/10

   Evidence shows an MCP server, API access, and web/ChatGPT app integrations, but there is no mention of an official CLI tool for Undermind anywhere in the docs or probes; llms.txt, docs-md, and openapi probes all 404, and no CLI is documented.

   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

6. ai-native userDrive the product through a documented public API

   weight 3 · round to Elicit
   Elicit✓fullprobed8/10

   Elicit documents a public API with keys/auth management and specific programmatic endpoints (search 138M+ papers, automated report generation, full systematic review workflow control), plus an MCP server exposing the same functionality for agentic clients. Missing for 10: an actual OpenAPI/swagger spec was not found (404s on candidate paths) and no independent/hands-on developer report validates real-world API usage.

   • [claimed-docs] “API access”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.elicit.com/openapi.json, https://support.elicit.com/swagger.json, https://support.el…”

   proof ↗⚑ flag

   Undermind~partialprobed5/10

   Undermind documents a public MCP server (mcp.undermind.ai) with clear tool definitions for search, PDF Q&A, and workspace notes, which does let an AI agent drive the product programmatically (undermind-docs-3,4,5,13,14,15,19). However, a general documented REST/OpenAPI-style public API is only vaguely alluded to ('Programmatic queries via API' under Enterprise) and probes for llms.txt, docs.md, and openapi/swagger specs all return 404s, indicating no broadly published API reference. Missing for 10: a public OpenAPI/Swagger spec or REST API docs, and confirmation that the enterprise API is self-serve rather than sales-gated.

   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “This adds Undermind to VS Code as an MCP server.”
   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [claimed-docs] “Point the client at `https://mcp.undermind.ai/mcp`”
   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”
   • [probe] “official MCP server documented at https://undermind.ai/mcp”

   proof ↗⚑ flag

7. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round drawn
   Elicit—none0/10

   Elicit does offer API keys and an MCP server for programmatic/agent access (elicit-docs-34, elicit-docs-35, elicit-docs-28), so the axis of credential management applies, but there is no evidence of scoped or least-privilege permissions, roles, or restricted-scope API keys — the docs only describe managing API keys generically, not limiting their scope.

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”

   proof ↗⚑ flag

   Undermind—none0/10

   No evidence of scoped/least-privilege API credential issuance for agents; the API is only mentioned generically ('Programmatic queries via API') with no docs on credential scoping, permissions, or key management, and OpenAPI probes returned 404s.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

8. ai-native userBuild against official SDKs

   weight 2 · round to Elicit
   Elicit~partialclaimed6/10

   Elicit documents an official API (with managed API keys) for programmatic access to search and automated research reports, plus full API functionality exposed via an MCP server for Claude Desktop/Code integration, which supports agentic, code-driven workflows. However, evidence shows only a REST-style API and API-key docs, not a dedicated official SDK/client library in specific languages, nor code samples or independent developer corroboration. Missing for 10: named client SDKs (e.g., Python/JS packages), quickstart code examples, and independent/hands-on developer confirmation of API reliability.

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [claimed-docs] “API access”
   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”

   proof ↗⚑ flag

   Undermind—none0/10

   Evidence only mentions a vague 'Programmatic queries via API' for enterprise customers and an MCP server, but no official SDKs (client libraries, language bindings) are documented; probes for OpenAPI specs and docs (llms.txt, mcp.md, openapi.json) all return 404, indicating no public developer SDK resources exist.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

9. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   Elicit—none0/10

   Elicit offers email alerts, an API, and an MCP server, but no evidence anywhere in the pack mentions webhook subscriptions or event-driven callbacks for programmatic integration.

   • [claimed-docs] “Turn on **Instant email alerts** to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind—none0/10

   The evidence mentions a notification feature for new papers (undermind-docs-9) but nothing indicates this is delivered via webhooks or any programmatic subscription mechanism; no webhook API, endpoint, or docs are present, and probes for API/openapi specs all 404.

   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to Undermind
   Elicit!disputedcontradicted5/10

   Elicit's Research Agent, columns, chat-with-papers, and Systematic Review reports are documented to generate AI insights and suggestions from ingested papers (elicit-docs-11, elicit-docs-40, elicit-docs-41), and one HN user found topic analysis genuinely useful (elicit-comm-1). However, independent hands-on reports concretely contradict reliability: users found mostly incorrect summaries, missed key papers, and fabricated/hallucinated facts even when directly quoting sources (elicit-comm-3, elicit-comm-4, elicit-comm-7), and Elicit's own docs admit ~10% inaccuracy requiring manual verification (elicit-comm-2). missing for 10: independent corroboration that generated insights are consistently accurate rather than frequently hallucinated, and resolution of the documented factual-error reports.

   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “Chat enables you to: Compare and contrast papers - Summarize multiple papers along specific dimensions (like their methodologies) - Cluster …”
   • [claimed-docs] “the Research Agent can pull from a wide range of sources (e.g. publications, public filings, press releases), produce flexible outputs, and …”
   • [community] “I asked about media bias detection and used the topic analysis feature. A minute or so later, I had a list of concepts with citations and li…”
   • [community] “Elicit states: 'assume that around 90% of the information you see in Elicit is accurate... it's very important for you to check the work in …”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”
   • [community] “I tried abstract summarization with a whitepaper and it came up with completely made-up facts, describing an algorithm acronym incorrectly. …”

   proof ↗⚑ flag

   Undermind✓fullcommunity8/10

   Undermind's core capability is AI-generated synthesis and insight extraction from literature data: it runs deep research plans, produces ranked papers with written synthesis, answers cross-paper questions from PDFs, traces citations, and proactively notifies users of new relevant papers—all generated from the user's research data within the product. Community reviews corroborate that these AI-derived insights are often more useful than manual search (undermind-comm-2, undermind-comm-6, undermind-comm-15, undermind-comm-16), though some found gaps in coverage (undermind-comm-1, undermind-comm-4). Missing for 10: independent verification of insight/synthesis accuracy at scale and clearer support for arbitrary user-uploaded (non-literature) datasets.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Elicit
   Elicit~partialclaimed5/10

   Elicit's Alerts feature lets users set up a background process that automatically monitors for new relevant papers and notifies them (e.g., via instant email alerts), which is a real autonomous background automation, and the API/MCP server also enables scripted automated report generation from external workflows. However, this is narrow (limited to paper-discovery alerts) rather than a general-purpose scheduling/automation system for arbitrary agentic tasks, and there's no evidence of recurring scheduled jobs, triggers, or workflow orchestration beyond alerts. Missing for 10: evidence of a general automation/scheduling engine, ability to chain multi-step autonomous tasks, and independent confirmation that alerts reliably run unattended over time.

   • [claimed-docs] “Turn on **Instant email alerts** to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “Alerts allow you to stay up to date on the latest research about topics that are relevant to you, so you can add them to your Library for fu…”
   • [claimed-docs] “Turn on Instant email alerts to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind~partialclaimed3/10

   The only evidence of background automation is a single line about being notified when relevant papers are published, with no detail on how such alerts are configured, scheduled, or run autonomously as multi-step agent workflows. missing for 10: documentation of automation/scheduling setup, evidence of autonomous multi-step background agent tasks, and any hands-on confirmation of the notification feature working.

   • [claimed-docs] “Get notified whenever relevant papers are published.”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Elicit
   Elicit✓fullcommunity8/10

   Elicit ships a built-in Research Agent that users can delegate tasks to directly (search, screening, extraction, column creation, chat with papers, skills), with effort-level control and iterative outputs, all inside the product interface (elicit-docs-2,7,8,11,12,21,40,42). Community evidence corroborates real task delegation working in practice (elicit-comm-1) though also raises accuracy concerns that temper trust in outputs (elicit-comm-2,3,4). Missing for 10: independent quality benchmarking beyond anecdotal HN threads and more recent hands-on validation of the newer effort-level/skills features.

   • [claimed-docs] “Every Research Agent session runs at an effort level, which you set from the slider in the prompt box before you send your question.”
   • [claimed-docs] “Projects in Elicit allow you to link together multiple sessions for fluid reasoning across different aspects of your work.”
   • [claimed-docs] “A skill is a set of instructions you can hand to Elicit's agent so it approaches a task a particular way.”
   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “the Research Agent can pull from a wide range of sources (e.g. publications, public filings, press releases), produce flexible outputs, and …”
   • [claimed-docs] “you can filter and export your sources, generate figures, and draft slides, all without leaving the conversation”
   • [claimed-docs] “Chat enables you to: Compare and contrast papers - Summarize multiple papers along specific dimensions (like their methodologies) - Cluster …”
   • [claimed-docs] “A skill is a set of instructions you hand to Elicit's agent so it approaches a task a particular way.”
   • [community] “I asked about media bias detection and used the topic analysis feature. A minute or so later, I had a list of concepts with citations and li…”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”

   proof ↗⚑ flag

   Undermind—none0/10

   Undermind is positioned as an MCP server/tool that other AI clients (Cursor, Claude, ChatGPT) connect to, not as a product with its own built-in AI assistant that users delegate tasks to within Undermind itself; evidence describes it being added to external agent tools rather than an in-product assistant. missing for 10: any evidence of a native, built-in AI assistant/chat agent inside Undermind's own UI that a user can delegate tasks to.

   • [claimed-docs] “This adds Undermind directly to Cursor”
   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “Undermind is available as a published ChatGPT app.”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Undermind
   Elicit✓fullcommunity7/10

   Elicit's Research Agent and semantic search are explicitly natural-language driven (e.g., asking questions in plain language, adding columns via natural-language commands like 'Add a column for study type'), and skills let users reference natural-language instructions instead of re-typing prompts. However, community reports raise accuracy/hallucination concerns that temper confidence in reliability of NL command execution. Missing for 10: independent hands-on verification of complex multi-step NL command chains, and no evidence of NL support outside the research/agent workflows (e.g., no broader command-line or API NL interface).

   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “With Elicit's semantic search engine, you can ask a question in natural language, and Elicit will find relevant papers, without you having t…”
   • [claimed-docs] “Elicit's semantic search means you don't have to know all the right keywords to get relevant results.”
   • [claimed-docs] “Instead of writing out the same detailed prompt every time you run a market sizing or a landscape review, you reference the skill and the ag…”
   • [claimed-docs] “the Research Agent can pull from a wide range of sources (e.g. publications, public filings, press releases), produce flexible outputs, and …”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”

   proof ↗⚑ flag

   Undermind✓fullprobed8/10

   Undermind ships an official MCP server (Cursor, VS Code, Claude, ChatGPT app) that lets users issue open-ended natural-language research goals which the tool autonomously plans, searches, and synthesizes into reports, fitting the ai-native/agentic story well. Missing for 10: independent hands-on confirmation of the MCP natural-language workflow specifically (community evidence covers the web search UI, not the MCP NL commands) and any public usage examples/logs.

   • [claimed-docs] “Undermind works with any MCP-compatible client. The protocol's recommended way for a new client to identify itself is a Client ID Metadata D…”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “This adds Undermind to VS Code as an MCP server.”
   • [claimed-docs] “claude mcp add --transport http undermind https://mcp.undermind.ai/mcp”
   • [claimed-docs] “Undermind is available as a published ChatGPT app.”
   • [probe] “official MCP server documented at https://undermind.ai/mcp”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   Elicit—none0/10

   Elicit documents an API and MCP server (elicit-docs-6, elicit-docs-34, elicit-docs-35, elicit-docs-36) but there is no evidence of an interactive API reference/playground with runnable examples; probes for OpenAPI/swagger specs all returned 404 (elicit-probe-3), suggesting no such interactive reference exists.

   • [claimed-docs] “API access”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.elicit.com/openapi.json, https://support.elicit.com/swagger.json, https://support.el…”

   proof ↗⚑ flag

   Undermind—none0/10

   There is no evidence of an interactive API reference or runnable examples; probes explicitly show no OpenAPI/Swagger spec and no docs.md/llms.txt exist. The 'Programmatic queries via API' mention is a bare feature claim with no interactive reference or runnable examples provided.

   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [claimed-docs] “Programmatic queries via API”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Elicit—none0/10

   Elicit documents a REST API (elicit-docs-34,36) and an MCP server (elicit-docs-28,35), but no evidence of a downloadable OpenAPI/Swagger spec exists; direct probes for openapi.json/swagger.json all returned 404 (elicit-probe-3). Missing for 10: any published OpenAPI/Swagger file, machine-readable schema, or API reference page listing such a spec.

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.elicit.com/openapi.json, https://support.elicit.com/swagger.json, https://support.el…”

   proof ↗⚑ flag

   Undermind—none0/10

   Undermind mentions 'Programmatic queries via API' for enterprise but there is no evidence of a downloadable OpenAPI/Swagger spec; direct probes for openapi.json, swagger.json, and llms.txt all returned 404. Missing for 10: any published machine-readable API spec, documented API schema, or discoverable spec endpoint.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”

   proof ↗⚑ flag

3. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Elicit—none0/10

   Evidence confirms Elicit has an API and MCP server (elicit-docs-34, elicit-docs-35, elicit-docs-36) but nothing documents API versioning or a deprecation policy, and probes for an OpenAPI/spec file returned 404s (elicit-probe-3).

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.elicit.com/openapi.json, https://support.elicit.com/swagger.json, https://support.el…”

   proof ↗⚑ flag

   Undermind—none0/10

   There is a mention of a 'Programmatic queries via API' for enterprise, but no evidence of versioning or a documented deprecation policy; probes for OpenAPI/docs all returned 404s. Missing for 10: any API versioning scheme, changelog, or deprecation policy documentation.

   • [claimed-docs] “Programmatic queries via API”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Elicit
   Elicit✓fullclaimed8/10

   Elicit's core Systematic Reviews and Tables/Columns workflows explicitly apply extraction and screening operations across many papers at once (docs-11, docs-18, docs-22, docs-45), with bulk import (RIS/BIB, Zotero) and bulk export (CSV/Excel/RIS/BIB) of entire tables (docs-25, docs-38, docs-47), plus API/MCP access to run full systematic reviews programmatically at scale (docs-34, docs-36). Missing for 10: independent/hands-on evidence specifically validating bulk-scale accuracy or performance (community evidence addresses general accuracy, not bulk-operation mechanics).

   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “Create a column for each data point you'd like to extract from your papers. Columns can pull data from the papers' body text or from tables …”
   • [claimed-docs] “Elicit supports the major steps of a systematic review: 1. Set up your review on the Setup page 2. Gather all papers for the systematic revi…”
   • [claimed-docs] “Tables can be exported in CSV and Excel format. Certain tables of sources can be exported as RIS or BIB files.”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [claimed-docs] “You can import RIS and BIB files into Elicit. This makes it much easier to import titles/abstracts from other tools like EndNote, Mendeley, …”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”

   proof ↗⚑ flag

   Undermind~partialclaimed6/10

   Undermind's MCP tools explicitly support bulk-style operations: reading full-text PDFs in parallel and answering questions across many papers at once, and running a deep literature review that autonomously searches and synthesizes across large numbers of papers. Enterprise API access also enables programmatic bulk queries. However, there is no evidence of bulk editing/tagging/exporting or batch management operations across items (e.g., bulk-star, bulk-move to folders) — missing for 10: documented batch update/edit/export APIs, evidence of bulk actions beyond reading/analysis, independent verification of parallel-processing claims.

   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Programmatic queries via API”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round drawn
   Elicit~partialclaimed3/10

   Elicit's 'Alerts' feature lets a user set a topic and receive an automatic email notification when a new relevant paper is found, which is a narrow event→action automation, but there is no general rule-builder allowing arbitrary triggers/conditions/actions across the product. Missing for 10: user-defined trigger conditions beyond 'new paper found', support for actions besides email alerts, and any workflow/automation engine tying events to custom actions.

   • [claimed-docs] “Turn on **Instant email alerts** to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “Alerts allow you to stay up to date on the latest research about topics that are relevant to you, so you can add them to your Library for fu…”
   • [claimed-docs] “Turn on Instant email alerts to be immediately alerted whenever a new relevant research paper is found.”

   proof ↗⚑ flag

   Undermind~partialclaimed3/10

   The only automation-relevant capability is a notification feature that alerts users when relevant papers are published (undermind-docs-9), which is a basic event trigger but not a configurable rule engine with user-defined conditions and multiple downstream actions. Missing for 10: ability to define custom trigger conditions, chain multiple actions, or integrate rules into broader workflows beyond a single notification type.

   • [claimed-docs] “Get notified whenever relevant papers are published.”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round to Elicit
   Elicit~partialclaimed4/10

   Elicit's Alerts feature lets users get recurring updates when new relevant papers matching a saved search appear (via instant email alerts), which is a limited form of a recurring job, but there is no evidence of general scheduling of arbitrary Research Agent workflows, systematic reviews, or API-driven jobs on a recurring cadence. Missing for 10: ability to schedule/repeat full Research Agent or Systematic Review workflows, cron-like or interval-based automation beyond paper alerts, and confirmation this works via API/MCP for programmatic recurring runs.

   • [claimed-docs] “Turn on **Instant email alerts** to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “Alerts allow you to stay up to date on the latest research about topics that are relevant to you, so you can add them to your Library for fu…”
   • [claimed-docs] “Turn on Instant email alerts to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind—none0/10

   There's a notification feature for new papers (undermind-docs-9) but no evidence of scheduling recurring jobs/workflows, cron-like automation, or configurable recurring tasks; the product focuses on on-demand deep research via MCP tools rather than persistent scheduled automation.

   • [claimed-docs] “Get notified whenever relevant papers are published.”

   proof ↗⚑ flag

Sharing

1. analystShare a research session or report with collaborators who can view or build on it

   weight 2 · round to Elicit
   Elicit✓fullclaimed8/10

   Elicit has a documented feature to invite team members to collaborate live in Research Agent sessions, with edit-access collaborators able to ask the agent questions, produce new artifacts, and edit others' work, plus reports/tables can be exported as PDF/Word/CSV for sharing. missing for 10: no independent/hands-on corroboration of the live collaboration feature working smoothly, and no detail on view-only/read-access sharing permissions.

   • [claimed-docs] “Collaborators with edit access can ask the agent questions in your session, produce new artifacts (documents, tables, etc.), and edit other …”
   • [claimed-docs] “Invite your team members to collaborate live with you in Research Agent sessions.”
   • [claimed-docs] “Invite your team members to collaborate live with you in Research Agent sessions. Collaborators with edit access can ask the agent questions…”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”

   proof ↗⚑ flag

   Undermind—none0/10

   Evidence covers workspace files, folders, and note creation but never mentions sharing sessions/reports with collaborators, multi-user access, or permission controls. missing for 10: any mention of sharing/collaboration features, invite/permission mechanisms, or multi-user workspace access.

   ⚑ flag

Alerts

1. researcherSet up standing searches or alerts that surface new relevant sources as they appear

   weight 1 · round to Elicit
   Elicit✓fullclaimed7/10

   Elicit's Alerts feature explicitly lets researchers set up standing topic alerts with instant email notifications when new relevant papers are found, adding them to a Library for future use — directly matching the standing-search/alert story. Missing for 10: independent/hands-on verification of alert accuracy or timeliness, and detail on how alert relevance/topics are configured beyond docs claims.

   • [claimed-docs] “Turn on **Instant email alerts** to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “Alerts allow you to stay up to date on the latest research about topics that are relevant to you, so you can add them to your Library for fu…”
   • [claimed-docs] “Turn on Instant email alerts to be immediately alerted whenever a new relevant research paper is found.”

   proof ↗⚑ flag

   Undermind~partialclaimed6/10

   Undermind explicitly offers a 'Get notified whenever relevant papers are published' alert feature, which directly matches the standing-search/alert story, plus curated folders and starred papers for ongoing tracking. However, there is no independent/hands-on evidence of how the alert system works in practice (frequency, delivery channel, reliability), and community discussion focuses on one-off search quality rather than alerting. Missing for 10: independent corroboration of alert functionality, details on alert configuration/frequency, and hands-on user reports of ongoing alerts working as described.

   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”

   proof ↗⚑ flag

Corpus

1. researcherUpload my own PDFs or corpus and have the agent research over them

   weight 2 · round to Elicit
   Elicit✓fullcommunity7/10

   Elicit supports importing/uploading a user's own corpus (RIS/BIB import, Zotero integration, Collections) and running research operations (chat, columns/data extraction, systematic reviews) over those uploaded papers, with the browser extension auto-fetching full text for extraction. Community feedback raises accuracy/hallucination concerns about summarization quality, which tempers reliability but does not contradict the upload/research capability itself. Missing for 10: independent hands-on verification of accuracy when researching over a user-uploaded corpus, and clearer documentation of raw multi-PDF drag-and-drop upload versus reference-manager import formats.

   • [claimed-docs] “Elicit's Zotero integration helps you bring your paper collections into Elicit, where you can extract data and analyze your papers!”
   • [claimed-docs] “You can import RIS and BIB files into Elicit. This makes it much easier to import titles/abstracts from other tools like EndNote, Mendeley, …”
   • [claimed-docs] “Create a column for each data point you'd like to extract from your papers. Columns can pull data from the papers' body text or from tables …”
   • [claimed-docs] “You can now organize and manage your papers in the Elicit Library using Collections. Collections help you group related research, arrange it…”
   • [claimed-docs] “Elicit will automatically fetch papers during the data extraction phase of your Systematic Reviews”
   • [claimed-docs] “you can spend less time downloading full-text PDFs from publisher websites to extract in Elicit – we'll get the papers for you”
   • [claimed-docs] “Chat enables you to: Compare and contrast papers - Summarize multiple papers along specific dimensions (like their methodologies) - Cluster …”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”

   proof ↗⚑ flag

   Undermind—none0/10

   Evidence shows Undermind reads full-text PDFs and lets users curate/star papers discovered via its own search engine, but nothing indicates a feature to upload arbitrary personal PDFs or a private corpus for the agent to research over — all workflows described start from Undermind's own literature search rather than user-supplied documents.

   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”

   proof ↗⚑ flag

Reviews

1. researcherRun a systematic screening and extraction workflow across many papers with consistent criteria

   weight 2 · round to Elicit
   Elicit✓fullcommunity8/10

   Elicit documents a dedicated Systematic Reviews workflow covering setup, search/gather, title-abstract screening, automated full-text screening, and data extraction via consistent custom columns applied across all papers, with export of screening/extraction tables — directly matching the story. Community evidence raises general accuracy/hallucination concerns about Elicit's paper analysis (not specifically the systematic review pipeline), which tempers confidence in perfect consistency at scale. Missing for 10: independent hands-on validation of the systematic review workflow's accuracy/consistency specifically (vs. general chat/summarization complaints), and no third-party benchmarking of screening reliability across large paper sets.

   • [claimed-docs] “The Systematic Reviews workflow provides step-by-step guidance through search, screening, and data extraction, culminating in a research rep…”
   • [claimed-docs] “Elicit supports the major steps of a systematic review: 1. Set up your review on the Setup page 2. Gather all papers for the systematic revi…”
   • [claimed-docs] “Full-Text Screening is a distinct, automated step in the Systematic Review workflow that catches these mismatches before you commit to data …”
   • [claimed-docs] “Create a column for each data point you'd like to extract from your papers. Columns can pull data from the papers' body text or from tables …”
   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, including the screening recommendation tables and the data…”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”
   • [claimed-docs] “Elicit can help you save up to 80% of time usually spent on a systematic review without sacrificing accuracy.”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”

   proof ↗⚑ flag

   Undermind~partialcommunity6/10

   Undermind's MCP tools support open-ended literature review with ranked results, full-text PDF question-answering across many papers, and note/synthesis creation, which covers much of a screening-and-extraction workflow (undermind-docs-4, undermind-docs-5, undermind-docs-6, undermind-docs-7). However, there is no evidence of formal criteria-based screening (e.g., inclusion/exclusion rules) or structured, consistent extraction fields across a batch of papers, and community feedback notes gaps in coverage (missed gray literature/theses) that could undermine consistency (undermind-comm-1, undermind-comm-4). Missing for 10: explicit support for defined screening criteria, structured/consistent extraction schema, and independent validation of consistency at scale.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [community] “OK, I'm both impressed and disappointed. It seems to rely too much on citation count, and I don't see much dissertations/theses in the resul…”
   • [community] “Overall, I am impressed, and I can easily imagine my lab paying for this... but it seems to have missed a lot of the gray literature, partic…”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Undermind
   Elicit~partialclaimed4/10

   Elicit's API and MCP server expose search and end-to-end Systematic Review functionality (search, screening, extraction, reporting), giving programmatic access to core research capabilities, but there's no evidence that UI-only features like the interactive Research Agent chat, Skills, real-time collaboration, columns customization, alerts, or the browser extension are exposed via the API/MCP surface. Missing for 10: explicit documentation of full feature parity, API/MCP access to Research Agent conversational sessions, skills, collaboration, and alerts.

   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”
   • [claimed-docs] “API access”
   • [claimed-docs] “claude mcp add --transport http elicit https://elicit.com/api/mcp”

   proof ↗⚑ flag

   Undermind~partialprobed5/10

   Undermind exposes core research capabilities (deep literature search, PDF Q&A, note creation, curation, starring) via an official MCP server, and separately claims 'Programmatic queries via API' for enterprise customers, showing some AI-native parity. However, there is no public API/OpenAPI documentation (all probes 404), no evidence that UI-only features like notifications/alerts or workspace management are exposed programmatically, and the API claim is a single unelaborated enterprise line rather than a documented full-parity API. Missing for 10: public API docs/OpenAPI spec, confirmation that all UI features (alerts, workspace/library management) are API-accessible, and independent verification of API completeness.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Curate papers into a folder for long-term use.”
   • [claimed-docs] “Star important papers across the workspace.”
   • [claimed-docs] “Programmatic queries via API”
   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [probe] “PROBE llms.txt: HTTP 404 at https://undermind.ai/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://undermind.ai/mcp.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://undermind.ai/openapi.json, https://undermind.ai/swagger.json, https://undermind.ai/api/opena…”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to Elicit
   Elicit~partialclaimed6/10

   Elicit supports exporting Library, tables, and reports in open formats (RIS, CSV, BIB, PDF, DOCX) and offers API/MCP access for programmatic retrieval, which supports data portability. However, export of core artifacts like screening/extraction tables is gated behind Pro/Scale/Enterprise plans, and there's no evidence of full account data export (e.g., all research agent sessions, projects, skills, chat history) in open formats, nor an explicit 'delete account and take everything' workflow. missing for 10: full-account/session export beyond tables and library, confirmation of free-tier export ability, independent verification of export completeness/fidelity.

   • [claimed-docs] “Your Elicit Library can be exported as a .ris file, which you can import into Zotero, Mendeley, EndNote, or another reference manager.”
   • [claimed-docs] “Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, including the screening recommendation tables and the data…”
   • [claimed-docs] “Tables can be exported in CSV and Excel format. Certain tables of sources can be exported as RIS or BIB files.”
   • [claimed-docs] “Export to RIS, CSV, BIB, PDF and DOCX”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “All API functionality is also available via MCP (Model Context Protocol) server, enabling use from Claude Desktop, Claude Code, and other MC…”

   proof ↗⚑ flag

   Undermind—none0/10

   No evidence of any data export feature or open-format export capability for user data/papers/workspaces; probes for docs/API endpoints also 404. The evidence covers MCP integration and search quality, not data portability or export/leave capability.

   ⚑ flag

Pricing

1. researcherTry the product meaningfully on a free tier or trial

   weight 1 · round to Undermind
   Elicit—none0/10

   The evidence pack includes pricing-page references (e.g., elicit-docs-4, elicit-docs-6, elicit-docs-31) but none describe a free tier's scope, limits, or a trial period — no content confirms what a researcher could do without paying. Axis clearly applies to a SaaS research tool, but no evidence substantiates a meaningful free/trial experience.

   ⚑ flag

   Undermind!disputedcontradicted4/10

   Docs imply a tiered system (e.g. '10x higher usage limits' for paid vs default) suggesting a free/limited tier exists, but community evidence shows a hard institutional/company email requirement blocking sign-up, with an independent researcher explicitly reporting they 'can't get in' and another calling the requirement 'obnoxious' and a 'roadblock' — concretely contradicting the ability for many researchers to try it meaningfully for free. Missing for 10: explicit vendor documentation of a free tier or trial with stated limits, and confirmation the email gate has been removed or has an exception path for independent researchers.

   • [claimed-docs] “Deepest analysis of full texts 10x higher usage limits Unlimited workspaces, files, and paper libraries”
   • [community] “Independent researcher without academic address; can't get in. Best of luck.”
   • [community] “'Please use a valid institutional or company email address.' This is obnoxious. Please remove this unnecessary roadblock.”

   proof ↗⚑ flag

2. researcherUnderstand plan pricing and usage limits before committing

   weight 2 · round to Elicit
   Elicit~partialclaimed3/10

   Evidence confirms a public pricing page exists (elicit.com/pricing) and reveals plan tier names (Pro, Scale, Enterprise) tied to feature gating like table exports, but no evidence pack content shows actual price points, free-tier limits, or usage caps that a researcher would need to compare plans before committing. Missing for 10: actual price figures per tier, usage/query limits, free-plan restrictions, and any independent confirmation of pricing transparency.

   • [claimed-docs] “Import from Zotero”
   • [claimed-docs] “API access”
   • [claimed-docs] “Export to RIS, CSV, BIB, PDF and DOCX”
   • [claimed-docs] “Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, including the screening recommendation tables and the data…”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”

   proof ↗⚑ flag

   Undermind—none0/10

   Evidence includes only a fragmentary marketing snippet ('10x higher usage limits, unlimited workspaces...') with no actual price points, plan names, or explicit usage caps, and no dedicated pricing page is cited. A researcher cannot compare plans or understand limits before committing from this evidence alone.

   • [claimed-docs] “Deepest analysis of full texts 10x higher usage limits Unlimited workspaces, files, and paper libraries”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Elicit—none0/10

   No evidence in the pack mentions data residency, regional storage, or the ability to choose where data is stored; Elicit's docs cover exports, imports, API, and workflows but not data residency options. missing for 10: any mention of region/data-residency controls, enterprise data-locality options, or storage location settings.

   ⚑ flag

   Undermind—none0/10

   No evidence in the pack mentions data residency, regional storage options, or any data-location controls for Undermind. missing for 10: any mention of region selection, data residency policy, or storage location controls.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   Elicit—none0/10

   No evidence pack items address opt-out from AI training, data usage policies for model training, or any privacy/data-control settings related to training data; all evidence covers product features (search, review workflows, exports, API/MCP) with no mention of training-data privacy controls. missing for 10: any documentation of a training opt-out setting, data usage/privacy policy statement, or enterprise data handling terms addressing model training.

   ⚑ flag

   Undermind—none0/10

   No evidence in the pack addresses data privacy, opt-out of AI training, or data usage policies for Undermind; nothing here confirms or denies such a control exists.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   Elicit—none0/10

   No evidence pack items address data retention policies, deletion controls, or account/data deletion mechanisms; docs cover export/import formats but not retention or deletion of user data.

   ⚑ flag

   Undermind—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy/data-handling settings for Undermind; all evidence concerns search quality, MCP integration, and product features. This axis applies to any AI-native product handling user data/queries, but there is no documented capability for controlling or deleting stored data.

   ⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round drawn
   Elicit—none0/10

   No evidence in the pack mentions telemetry, usage tracking, or an opt-out mechanism; only unrelated docs about search, exports, and API/MCP features appear. This is a reasonable privacy-posture question for a SaaS AI product, but nothing in the evidence pack supports Elicit offering telemetry opt-out.

   ⚑ flag

   Undermind—none0/10

   No evidence in the pack mentions telemetry, usage tracking, opt-out settings, or privacy controls for Undermind; all evidence covers product features, MCP integration, and general reception.

   ⚑ flag

Reports

1. researcherExport results to common formats, including documents, spreadsheets, and reference-manager files

   weight 1 · round to Elicit
   Elicit✓fullclaimed9/10

   Elicit documents export of tables/reports to CSV, Excel, PDF, DOCX, RIS, and BIB, covering documents, spreadsheets, and reference-manager formats, and also supports Zotero/EndNote/Mendeley import/export via RIS. Missing for 10: independent hands-on verification of export fidelity beyond vendor docs.

   • [claimed-docs] “Tables can be exported in CSV and Excel format. Certain tables of sources can be exported as RIS or BIB files.”
   • [claimed-docs] “Export to RIS, CSV, BIB, PDF and DOCX”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”
   • [claimed-docs] “Your Elicit Library can be exported as a .ris file, which you can import into Zotero, Mendeley, EndNote, or another reference manager.”
   • [claimed-docs] “Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, including the screening recommendation tables and the data…”
   • [claimed-docs] “You can import RIS and BIB files into Elicit. This makes it much easier to import titles/abstracts from other tools like EndNote, Mendeley, …”

   proof ↗⚑ flag

   Undermind—none0/10

   Evidence shows Undermind creates/edits Markdown notes and reports with citations, and can curate/star papers, but there is no mention of exporting to common document formats (e.g., Word/PDF), spreadsheets (e.g., CSV/Excel), or reference-manager formats (e.g., BibTeX, RIS, EndNote).

   ⚑ flag

2. analystGet a structured report with sections, tables, and a summary that I can share with stakeholders

   weight 3 · round to Elicit
   Elicit✓fullclaimed8/10

   Elicit's Systematic Reviews workflow produces a research report summarizing papers, includes data extraction and screening tables, and both reports and tables can be exported as PDF/Word/CSV/Excel for sharing with stakeholders (elicit-docs-1, elicit-docs-22, elicit-docs-47, elicit-docs-19, elicit-docs-25). The Research Agent can also produce documents, tables, and figures within a session (elicit-docs-9, elicit-docs-21, elicit-docs-33). Missing for 10: independent/hands-on corroboration that the exported report format is polished enough for external stakeholder sharing, and no evidence of customizable report sectioning beyond the standard systematic-review structure.

   • [claimed-docs] “The Systematic Reviews workflow provides step-by-step guidance through search, screening, and data extraction, culminating in a research rep…”
   • [claimed-docs] “Elicit supports the major steps of a systematic review: 1. Set up your review on the Setup page 2. Gather all papers for the systematic revi…”
   • [claimed-docs] “Research Reports can be exported as a PDF or Word file... Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, …”
   • [claimed-docs] “Pro, Scale, and Enterprise subscribers can export tables from Systematic Reviews, including the screening recommendation tables and the data…”
   • [claimed-docs] “Tables can be exported in CSV and Excel format. Certain tables of sources can be exported as RIS or BIB files.”
   • [claimed-docs] “Collaborators with edit access can ask the agent questions in your session, produce new artifacts (documents, tables, etc.), and edit other …”
   • [claimed-docs] “you can filter and export your sources, generate figures, and draft slides, all without leaving the conversation”

   proof ↗⚑ flag

   Undermind~partialclaimed5/10

   Undermind produces a ranked list of papers with a written synthesis and can create/edit Markdown notes, syntheses, and reports with citations linking back to sources, which supports shareable structured output. However, there is no evidence of built-in tables, formal 'sections' structuring, or a dedicated stakeholder-facing report/export format beyond Markdown notes. Missing for 10: explicit table generation, multi-section report templates, and export/sharing formats (PDF/Word) for stakeholders beyond in-workspace Markdown.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”

   proof ↗⚑ flag

Agent runs

1. researcherPose a research question and get an autonomous multi-step investigation, not just a single-pass summary

   weight 3 · round to Undermind
   Elicit~partialcommunity6/10

   Elicit's Research Agent and Systematic Review workflows are explicitly documented as multi-step (effort-level slider from Fastest to Smartest, pulling from multiple source types, iterating until output is complete, and separate search/screen/extract/report phases) rather than single-pass answers (elicit-docs-2, elicit-docs-12/13, elicit-docs-21/33, elicit-docs-22/45). However, hands-on community reports describe results arriving quickly and resembling a single pass over topic clusters rather than deep autonomous investigation, and multiple independent accounts report missed papers, hallucinated conclusions, and shallow reasoning that undercut confidence in true multi-step depth (elicit-comm-1, elicit-comm-3, elicit-comm-4, elicit-comm-5). Missing for 10: independent verification that the agent performs genuinely autonomous multi-step reasoning (not just sequential fixed workflow steps) and evidence rebutting the accuracy/depth complaints.

   • [claimed-docs] “Every Research Agent session runs at an effort level, which you set from the slider in the prompt box before you send your question.”
   • [claimed-docs] “the Research Agent can pull from a wide range of sources (e.g. publications, public filings, press releases), produce flexible outputs, and …”
   • [claimed-docs] “click it to open the slider and move between Fastest, Fast, Balanced, Smart, and Smartest”
   • [claimed-docs] “you can filter and export your sources, generate figures, and draft slides, all without leaving the conversation”
   • [claimed-docs] “Elicit supports the major steps of a systematic review: 1. Set up your review on the Setup page 2. Gather all papers for the systematic revi…”
   • [claimed-docs] “Full-Text Screening is a distinct, automated step in the Systematic Review workflow that catches these mismatches before you commit to data …”
   • [community] “I asked about media bias detection and used the topic analysis feature. A minute or so later, I had a list of concepts with citations and li…”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”
   • [community] “Testing Elicit gave me quite a bit worse results than using PaperQA by futurehouse. While paperqa could understand a bit of the nuance of a …”

   proof ↗⚑ flag

   Undermind✓fullcommunity8/10

   Docs explicitly describe an autonomous multi-step deep literature review agent that plans its own searches, follows citations and key authors, reads full-text PDFs in parallel, and stops only when new searches stop finding relevant papers — not a single-pass summary. Community reviews corroborate multi-minute, iterative search behavior yielding comprehensive results beyond a simple query-response. Missing for 10: independent technical breakdown of the multi-step planning/agentic loop and more recent hands-on validation of the 'stops when exhausted' claim.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Plans its own searches, follows citations and key authors, and stops only when new searches stop finding relevant papers.”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [community] “Been using Undermind for several months now and it's honestly been a lifesaver in getting a comprehensive understanding of a research topic.”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”

   proof ↗⚑ flag

2. analystStart a long research job that keeps working unattended and notifies me when the result is ready

   weight 2 · round to Undermind
   Elicit~partialclaimed4/10

   Elicit documents an alerts feature that emails you when new relevant papers are found (elicit-docs-3, elicit-docs-15, elicit-docs-26), and long-running workflows like Systematic Reviews and Research Agent effort levels ('Smartest' mode) imply tasks that can take longer to complete (elicit-docs-2, elicit-docs-13, elicit-docs-22). However, alerts are for ongoing topic monitoring, not notification of a specific job's completion, and there's no evidence of a 'start and walk away, get notified when this specific job is done' async job model. Missing for 10: explicit documentation of background/async execution of a research job plus a completion notification (vs. topic-monitoring alerts), and any independent confirmation this works as described.

   • [claimed-docs] “Turn on **Instant email alerts** to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “Alerts allow you to stay up to date on the latest research about topics that are relevant to you, so you can add them to your Library for fu…”
   • [claimed-docs] “Turn on Instant email alerts to be immediately alerted whenever a new relevant research paper is found.”
   • [claimed-docs] “Every Research Agent session runs at an effort level, which you set from the slider in the prompt box before you send your question.”
   • [claimed-docs] “click it to open the slider and move between Fastest, Fast, Balanced, Smart, and Smartest”
   • [claimed-docs] “Elicit supports the major steps of a systematic review: 1. Set up your review on the Setup page 2. Gather all papers for the systematic revi…”

   proof ↗⚑ flag

   Undermind~partialcommunity5/10

   Undermind's deep literature review runs autonomously, planning its own searches and stopping only when exhausted (undermind-docs-4/16), and it has a notification feature for relevant papers (undermind-docs-9), suggesting async, unattended operation. However, the notification feature is documented as an ongoing 'new paper published' alert rather than a 'job complete, come see results' notification, and community reports describe run times of minutes (3-6 min) rather than long unattended background jobs (undermind-comm-14/15/16). Missing for 10: explicit documentation that a single research job can run for extended/unattended periods (hours+) and trigger a completion notification, plus independent confirmation of this exact workflow.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Plans its own searches, follows citations and key authors, and stops only when new searches stop finding relevant papers.”
   • [claimed-docs] “Get notified whenever relevant papers are published.”
   • [community] “Hmm, does this just use traditional term frequency search under the hood with query expansion? Using GPT4 as a cross encoder seems really wa…”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”

   proof ↗⚑ flag

3. researcherSteer the depth, effort, and scope of a research run before or while it executes

   weight 1 · round to Elicit
   Elicit~partialclaimed7/10

   Elicit's Research Agent lets users set an effort level (Fastest→Smartest) via a slider before sending a query, and users can shape scope through columns, skills, and iterative follow-up prompts within a session; the API also exposes control over search strategy, screening criteria, and extraction parameters for Systematic Reviews. However, evidence only shows steering before/between turns, not genuine mid-execution adjustment of an in-flight run. Missing for 10: documentation of pausing/adjusting effort or scope while a run is actively executing, and independent verification that scope/effort controls meaningfully change output depth.

   • [claimed-docs] “Every Research Agent session runs at an effort level, which you set from the slider in the prompt box before you send your question.”
   • [claimed-docs] “click it to open the slider and move between Fastest, Fast, Balanced, Smart, and Smartest”
   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “Create a column for each data point you'd like to extract from your papers. Columns can pull data from the papers' body text or from tables …”
   • [claimed-docs] “you can filter and export your sources, generate figures, and draft slides, all without leaving the conversation”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”

   proof ↗⚑ flag

   Undermind—none0/10

   Undermind's research runs are described as fully autonomous — it 'plans its own searches... and stops only when new searches stop finding relevant papers' (undermind-docs-4, undermind-docs-16), with no documented controls for setting depth, effort, or scope before or during a run. A user comment notes confusion about the 'Discovery Progress and Exhaustiveness' indicator (undermind-comm-16), suggesting only passive visibility, not steering. No evidence of parameters, sliders, or mid-run adjustments exists in the pack.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Plans its own searches, follows citations and key authors, and stops only when new searches stop finding relevant papers.”
   • [community] “These are the best results that I've gotten from an AI research assistant. I really don't mind the long latency... The 'Discovery Progress a…”

   proof ↗⚑ flag

Citations

1. researcherSee citations for every substantive claim so I can verify it against the underlying source

   weight 3 · round to Undermind
   Elicit!disputedcontradicted5/10

   Elicit's search/columns features are built around pulling data from papers with links back to sources (elicit-docs-18, elicit-docs-20), and a hands-on user confirms getting 'a list of concepts with citations and links to papers' (elicit-comm-1). However, independent hands-on reports directly contradict the claim that citations reliably let you verify claims: users found Elicit 'hallucinates just as much and then gives a quote that directly contradicts its statement' (elicit-comm-4), produced 'mostly incorrect summaries' and missed key papers (elicit-comm-3), and Elicit itself warns only ~90% accuracy with a need to 'check the work in Elicit closely' (elicit-comm-2). Missing for 10: evidence that citation/quote extraction is reliably accurate, independent verification benchmarks, and resolution of the hallucination-despite-quoting complaints.

   • [claimed-docs] “Create a column for each data point you'd like to extract from your papers. Columns can pull data from the papers' body text or from tables …”
   • [claimed-docs] “With Elicit's semantic search engine, you can ask a question in natural language, and Elicit will find relevant papers, without you having t…”
   • [community] “I asked about media bias detection and used the topic analysis feature. A minute or so later, I had a list of concepts with citations and li…”
   • [community] “Elicit states: 'assume that around 90% of the information you see in Elicit is accurate... it's very important for you to check the work in …”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”

   proof ↗⚑ flag

   Undermind✓fullcommunity7/10

   Undermind's docs explicitly claim in-line citations traceable to source papers ([undermind-docs-12], [undermind-docs-6]) and community reviews corroborate it reliably surfaces cited references (e.g. [undermind-comm-8] notes it 'solves' the reference-provision problem unlike a chatbot). However, no independent hands-on verification of citation accuracy/completeness at the claim level is present, and some reviewers note gaps in coverage (missing gray literature/theses) which could affect verifiability of some claims. Missing for 10: independent audit of citation accuracy per-claim, and confirmation citations withstand scrutiny across all source types.

   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [claimed-docs] “Creates and edits Markdown notes, syntheses, and reports in the workspace. Citations link back to the source papers, and files stay availabl…”
   • [community] “Compared roughly similar research questions using Claude 3.5 Sonnet and Undermind. Claude is reluctant to provide references, but Undermind …”
   • [community] “OK, I'm both impressed and disappointed. It seems to rely too much on citation count, and I don't see much dissertations/theses in the resul…”
   • [community] “Overall, I am impressed, and I can easily imagine my lab paying for this... but it seems to have missed a lot of the gray literature, partic…”

   proof ↗⚑ flag

Corpus

1. researcherSearch scholarly literature and primary sources, not just the open web

   weight 2 · round to Elicit
   Elicit✓fullclaimed9/10

   Elicit's docs clearly show it searches scholarly literature (138M+ academic papers via semantic and keyword search), clinical trials, and journal-restricted queries, plus API/MCP access to the same corpus and systematic-review workflows built around paper screening/extraction rather than general web search. This directly matches the story of searching scholarly/primary sources rather than the open web. Missing for 10: independent corroboration specifically about breadth/quality of the scholarly corpus (community evidence addresses answer accuracy/hallucination, not source scope, so it doesn't contradict this particular axis).

   • [claimed-docs] “With Elicit's semantic search engine, you can ask a question in natural language, and Elicit will find relevant papers, without you having t…”
   • [claimed-docs] “The Elicit API lets you access Elicit's research capabilities programmatically: search 138 million+ academic papers and generate automated r…”
   • [claimed-docs] “Elicit allows you to search both research papers and clinical trials.”
   • [claimed-docs] “Elicit offers both semantic search and keyword search to find the most relevant papers for your systematic review.”
   • [claimed-docs] “Add +journal:"INSERT JOURNAL NAME HERE" to your query”
   • [claimed-docs] “Advanced search filters are a powerful hidden feature in the Find Papers workflow. You can use them to search within a particular journal, r…”
   • [claimed-docs] “Systematic Review: run a full review end to end, with control over search strategy, screening criteria, extraction parameters, and reporting…”

   proof ↗⚑ flag

   Undermind✓fullcommunity8/10

   Undermind is purpose-built for scholarly literature search: it runs deep literature reviews over papers, reads full-text PDFs including figures/tables/equations, and traces claims back to source papers via citations, with independent community reports confirming it surfaces relevant academic papers beyond Google Scholar. Some community feedback notes gaps in coverage (dissertations, gray literature), which tempers but doesn't negate the core capability. Missing for 10: no independent benchmark on primary-source/preprint coverage breadth, and some users report missed gray literature/theses.

   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”
   • [claimed-docs] “Reads full-text PDFs in parallel and answers specific questions across many papers at once, including from figures, tables, and equations.”
   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [claimed-docs] “Undermind's v1 search engine delivered 10x better results than Google Scholar”
   • [community] “This is a nice search engine. I found it to be more effective than crawling with Google Scholar. Good work guys!”
   • [community] “As a CS academic, the top 10 results contained two items I really ought to have found myself... overall I'm very impressed with this.”
   • [community] “I actually was able to find at least 4 new informative papers... in less than six minutes, your search engine was able to give me more relev…”
   • [community] “OK, I'm both impressed and disappointed. It seems to rely too much on citation count, and I don't see much dissertations/theses in the resul…”
   • [community] “Overall, I am impressed, and I can easily imagine my lab paying for this... but it seems to have missed a lot of the gray literature, partic…”

   proof ↗⚑ flag

Synthesis

1. analystSee where sources agree and disagree instead of a single unqualified answer

   weight 2 · round to Elicit
   Elicit~partialcommunity5/10

   Elicit's Chat/Compare feature explicitly lets analysts 'compare and contrast papers' and 'summarize multiple papers along specific dimensions,' and its column/table extraction lets you see each paper's data side-by-side, which supports spotting agreement/disagreement across sources. However, there is no dedicated feature that explicitly flags or highlights when sources conflict versus concur (no consensus/disagreement indicator), and community reports note the model can hallucinate quotes that contradict its own summaries, undermining confidence in cross-source synthesis. Missing for 10: an explicit contradiction/agreement-detection UI, and independent verification that comparisons are reliably accurate rather than hallucination-prone.

   • [claimed-docs] “Chat enables you to: Compare and contrast papers - Summarize multiple papers along specific dimensions (like their methodologies) - Cluster …”
   • [claimed-docs] “Create a column for each data point you'd like to extract from your papers. Columns can pull data from the papers' body text or from tables …”
   • [claimed-docs] “To add a column, simply tell the research agent what column(s) you'd like to add. For example, you can say: "Add a column for study type."”
   • [claimed-docs] “Elicit supports the major steps of a systematic review: 1. Set up your review on the Setup page 2. Gather all papers for the systematic revi…”
   • [community] “It seems like it should hallucinate less, as it directly quotes, but nope, it still hallucinates just as much and then gives a quote that di…”
   • [community] “I gave it a topic I researched in depth recently. It gave me mostly incorrect summaries (one said hypothesis X is confirmed; nope it hasn't)…”

   proof ↗⚑ flag

   Undermind—none0/10

   The evidence pack describes literature search, synthesis, citation tracing, and PDF Q&A features, but nowhere does it mention surfacing conflicting findings, agreement/disagreement across sources, or qualifying claims by consensus vs. dispute. Citation tracing (docs-12) only supports tracing a single claim to its source, not comparing multiple sources' stances. Missing for 10: any feature or documentation showing detection/display of cross-source agreement or contradiction, any UI element flagging conflicting conclusions, community evidence of this behavior.

   • [claimed-docs] “Trace any statement by following in-line citations back to the source paper”
   • [claimed-docs] “Runs a deep literature review from an open-ended research goal and produces a ranked list of papers with a written synthesis. Plans its own …”

   proof ↗⚑ flag