Pilot vs Mercury Books

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to Pilot
   Pilot~partialprobed4/10

   A probe confirms Pilot serves an llms.txt file at HTTP 200, so an agent can indeed be pointed at it — but the content shown is minimal (just entity/category metadata, no structured docs or API references), and other agent-doc formats (docs-md, openapi) return 404. Missing for 10: substantive llms.txt content beyond basic metadata, markdown docs mirror, and any first-party statement about agent-oriented documentation strategy.

   • [probe] “PROBE llms.txt: HTTP 200 at https://pilot.com/llms.txt # Pilot [Entity: Pilot] [Category: Professional Services] [Subcategory: Acco…”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

   Mercury Books!disputedcontradicted2/10

   Mercury's blog promises a future MCP layer for agents, but direct probes show no llms.txt file (404) and no discoverable OpenAPI/agent-oriented docs at any candidate path, meaning there is currently nothing an agent could be pointed at. Missing for 10: a live llms.txt or agent-readable docs file, a shipped API/MCP endpoint, any evidence of the promised MCP layer actually existing.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round drawn
   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

   Mercury Books—none0/10

   Mercury explicitly frames a full API and MCP layer as a future roadmap item ('Soon...'), and direct probes for API/OpenAPI/llms.txt endpoints all returned 404s, confirming no headless/CI-usable interface exists today. Command is a plain-language, in-app assistant, not a scriptable or automatable interface.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

3. ai-native userConnect an agent via an official MCP server

   weight 3 · round drawn
   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any MCP server offering; docs mention integrations (Bill.com, Stripe, Gusto) but nothing about AI agent connectivity via MCP, and API/openapi probes returned 404s.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Mercury only states that an MCP layer is coming 'soon' for AI agents, with no evidence it currently exists; probes for API/OpenAPI/llms.txt endpoints all return 404s, confirming no official MCP server is live today.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

4. ai-native userDrive the product through a documented public API

   weight 3 · round drawn
   Pilot—none0/10

   No evidence of a public API for Pilot; OpenAPI/swagger probes all returned 404 and no docs mention an API for driving the product programmatically. Pilot is a human-service accounting/bookkeeping product with integrations, not an API-driven platform.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Mercury explicitly says a full accounting API and MCP layer are coming 'soon,' not currently available, and direct probes for llms.txt and OpenAPI docs both returned 404s, confirming no public API exists today.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

5. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round drawn
   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

   Mercury Books—none0/10

   Evidence only mentions a future accounting API and MCP layer as 'soon' (not yet shipped), with no mention of API keys, OAuth scopes, or least-privilege credential issuance; probes confirm no OpenAPI/spec or docs endpoints currently exist. There is no evidence Mercury Books lets a user issue scoped credentials for an agent today.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

6. ai-native userBuild against official SDKs

   weight 2 · round drawn
   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any official SDKs; probes for API/OpenAPI specs returned 404s, and no docs mention developer SDKs.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Mercury explicitly frames the accounting API and MCP layer as future ('Soon'), and probes confirm no live OpenAPI/llms.txt endpoints exist yet — there is no official SDK currently available to build against.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

7. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   Pilot—none0/10

   No evidence of any webhook subscription capability or event API; Pilot is an accounting/bookkeeping service and probes show no OpenAPI or developer API surface exists.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

   Mercury Books—none0/10

   No evidence pack item mentions webhooks or event subscriptions; the only programmatic-access claim is a forward-looking 'soon' API/MCP mention, and probes confirm no public API/openapi spec exists yet. Missing for 10: any webhook documentation, event types, or subscription mechanism.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to Mercury Books
   Pilot~partialclaimed4/10

   Pilot's marketing mentions 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead' (pilot-docs-7), which points to some AI-generated insight capability inside the product, and scenario/cash-flow modeling features (pilot-docs-8, pilot-docs-21) suggest similar analytical output, though these are framed as human CFO-delivered rather than explicitly AI-driven. There is no independent/hands-on corroboration of the AI feature actually working, and community reviews focus on bookkeeping accuracy/time savings rather than AI insights. Missing for 10: detailed documentation of the AI feature's scope/accuracy, independent user testimony specifically about the AI insights, and clarity on whether insights are AI-generated vs. human-analyst-generated.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Model cash flow scenarios Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Track company expenses in real time Find the $2,000/month you didn't know you were wasting.”
   • [claimed-docs] “Find the $2,000/month you didn't know you were wasting.”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed7/10

   Mercury Command lets users ask natural-language questions about their financial data and get AI-grounded answers, plus AI-driven GL code suggestions and categorization, directly inside Books. missing for 10: independent/hands-on verification of insight quality, no detail on proactive suggestion generation beyond categorization/GL coding, and Mercury's own caveat that automation is not full autopilot.

   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “The banking side feeds clean data to any ledger: "Transactions on Mercury are now automatically assigned GL codes based on your categorizati…”
   • [claimed-docs] “Ask Mercury Command a question about your books, or hand off a bookkeeping task to it directly, in plain language.”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Mercury Books
   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

   Mercury Books~partialclaimed5/10

   Mercury Books documents continuous, automatic categorization/reconciliation and a Command assistant that can be handed bookkeeping tasks in plain language (bulk GL coding, categorization rules), which is real background automation. However, the vendor itself explicitly cautions that 'a connected system isn't the same as fully automated' and that it should not be treated as 'putting your books on autopilot,' and the promised MCP/agent layer for end-to-end autonomous handling is described as 'soon,' not shipped. Missing for 10: a live, user-configurable autonomous automation/agent layer (MCP) with independent confirmation it runs unattended in production.

   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Use Mercury Command to bulk assign GL codes, create categorization rules, and more”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”
   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Mercury Books
   Pilot~partialclaimed3/10

   Pilot's pricing page mentions an AI feature offering 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' which is a thin, single-mention hint of an in-product AI assistant capable of some task-like actions (scenario modeling). There's no further documentation on scope, autonomy, or how tasks are delegated to it, and community evidence focuses on human bookkeepers/CFOs rather than the AI assistant. Missing for 10: detailed documentation of the AI assistant's task-delegation capabilities, independent/hands-on corroboration of it actually performing delegated tasks, and clarity on its scope beyond Q&A.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed7/10

   Mercury Books ships a built-in AI assistant called Command that users can query in plain language and delegate bookkeeping tasks to (journal entries, chart of accounts organization, bulk categorization), described as 'AI built-in, not bolted on.' Missing for 10: independent/hands-on verification of Command's task-delegation reliability, and the vendor's own caveat that automation isn't 'autopilot' tempers full agentic delegation claims.

   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Ask Mercury Command a question about your books, or hand off a bookkeeping task to it directly, in plain language.”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Mercury Books
   Pilot~partialclaimed3/10

   Pilot's marketing mentions 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' implying some natural-language Q&A interface, but there's no evidence of broader natural-language command execution (e.g., initiating actions, workflows) or any API/CLI to support it. missing for 10: evidence of NL commands beyond Q&A, independent/hands-on corroboration, technical documentation of the AI interface, API or programmatic access.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed7/10

   Mercury Command lets users ask questions and hand off bookkeeping tasks 'in plain language,' directly matching the natural-language command story, and this is documented across multiple first-party sources describing bulk actions, categorization, and Q&A. Missing for 10: independent/hands-on verification of Command's NL capabilities and confirmation that the broader agent-facing API/MCP layer (still described as 'soon') doesn't gate deeper command coverage.

   • [claimed-docs] “Ask Mercury Command a question about your books, or hand off a bookkeeping task to it directly, in plain language.”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Use Mercury Command to bulk assign GL codes, create categorization rules, and more”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   Pilot—none0/10

   Pilot is an accounting/bookkeeping service with no evidence of any developer API reference or runnable examples; probes for OpenAPI/docs-md all returned 404, and no evidence pack items mention an API reference.

   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

   Mercury Books—none0/10

   There is no evidence of any interactive API reference or runnable examples; the API is described only as 'soon' coming, and probes for openapi/llms.txt specs both returned 404s, indicating no public API docs exist yet.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Pilot—none0/10

   Probe explicitly checked common OpenAPI/swagger endpoints and all returned 404, and no documentation mentions a machine-readable API spec. Missing for 10: any published OpenAPI/Swagger spec, API documentation, or developer portal.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Direct probes for llms.txt and OpenAPI/Swagger spec files all return 404, and docs only mention a future accounting API/MCP layer as an upcoming feature, not something currently downloadable. No machine-readable API spec exists today.

   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”
   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”

   proof ↗⚑ flag

3. ai-native userTest against a sandbox environment without touching production data

   weight 1 · round drawn
   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

   Mercury Books—none0/10

   No evidence of any sandbox, staging, or test environment for Mercury Books; the API/MCP layer is described only as forthcoming with no mention of a non-production mode, and probes for docs/OpenAPI endpoints returned 404s.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

4. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any public API, versioning scheme, or deprecation policy; probes for OpenAPI specs all returned 404s. missing for 10: any public API documentation, versioning scheme, deprecation policy, or developer-facing API references.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

   Mercury Books—none0/10

   The API is described as forthcoming ('Soon, a full accounting API will make every core Books action available programmatically'), and direct probes for openapi/llms.txt specs return 404s, showing no versioned API or deprecation policy currently exists.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Mercury Books
   Pilot—none0/10

   Pilot is a bookkeeping/accounting service; no evidence describes any bulk-operation or batch-processing capability across items (transactions, invoices, etc.) for AI-native automation. Missing for 10: any mention of bulk edit/import/export tools, batch API operations, or automation-scale item processing.

   ⚑ flag

   Mercury Books~partialprobed6/10

   Mercury Command explicitly supports bulk actions like bulk GL code assignment, categorization rules, and clearing categorization backlogs in bulk, which directly addresses bulk operations for an AI-native user. However, this is limited to bookkeeping/categorization tasks rather than a general-purpose bulk API, and the promised full accounting API/MCP layer for broader programmatic bulk actions is only 'coming soon,' with probes confirming no public API/OpenAPI spec exists yet. missing for 10: a live public API or MCP layer enabling arbitrary bulk operations, independent/hands-on verification of bulk actions working at scale, and documentation of bulk operation limits or scope beyond categorization/GL codes.

   • [claimed-docs] “Use Mercury Command to bulk assign GL codes, create categorization rules, and more”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to Mercury Books
   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with dedicated human experts and integrations, but there is no evidence of a rules engine or automation-trigger system letting users define event-based automated actions; features described are AI Q&A and integrations, not user-defined trigger/action rules.

   ⚑ flag

   Mercury Books~partialclaimed5/10

   Mercury Command explicitly supports creating 'categorization rules' and bulk GL code assignment, which is a form of user-defined rule-based automation triggered by transaction events, and automatic categorization/reconciliation is built-in. However, there's no evidence of a general-purpose rule/trigger-action framework beyond categorization (e.g., rules for invoicing, alerts, or other business events), and Mercury's own docs caution that automation isn't full autopilot. Missing for 10: broader event types beyond categorization, explicit rule configuration UI/API details, and independent confirmation of rule reliability.

   • [claimed-docs] “Use Mercury Command to bulk assign GL codes, create categorization rules, and more”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

   Mercury Books—none0/10

   Evidence shows automatic categorization/reconciliation and an AI assistant (Command) that can be asked to do tasks, but there is no mention of user-defined recurring/scheduled jobs or workflows; the API/MCP layer that might enable this is explicitly described as 'soon' (not yet shipped), and probes for API endpoints 404. Missing for 10: any documented scheduling/recurring-workflow feature, evidence of a live automation API or MCP layer, and independent confirmation of scheduled task execution.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

Ai reconciliation

1. ai-native userHave an agent reconcile a month end-to-end, matching transactions, flagging exceptions, and preparing the close for human review

   weight 3 · round to Mercury Books
   Pilot~partialcommunity3/10

   Pilot's evidence shows human bookkeepers finalize monthly books with integration-driven transaction classification (pilot-comm-1, pilot-docs-18, pilot-docs-26), which is directionally toward automated reconciliation, but there is no evidence of an autonomous agent matching transactions, flagging exceptions, and preparing a close package end-to-end without human bookkeeper involvement. Missing for 10: explicit agentic exception-flagging workflow, evidence of AI (not human staff) doing the matching/reconciliation, and documentation of an automated close-prep output for review.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

   Mercury Books~partialclaimed5/10

   Mercury Books has continuous automatic reconciliation/categorization and Command can answer questions and offload bookkeeping tasks like journal entries and bulk categorization, but Mercury explicitly states automation is not 'autopilot' and requires human decision-making, and there's no evidence of an agent autonomously running a full month-end close with exception flagging and review prep end-to-end — the MCP/agent layer is only announced as 'soon'. missing for 10: evidence of an actual agent (not just Command chat) performing a full month-end close, explicit exception-flagging workflow, and a shipped MCP/API layer rather than a 'soon' roadmap item.

   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”
   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”

   proof ↗⚑ flag

Bank feeds

1. founderConnect bank and credit-card accounts so transactions import automatically every day

   weight 3 · round to Mercury Books
   Pilot✓fullcommunity7/10

   Pilot's docs and a first-hand customer testimonial confirm bank/credit-card/expense integrations automatically feed transaction data for classification, with real-time account data in the portal, eliminating manual founder bookkeeping work. missing for 10: no explicit list of supported banks, no detail on daily-sync frequency or setup flow, and no independent technical documentation beyond marketing/community claims.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed8/10

   Mercury Books explicitly supports linking external bank accounts, cards, and payroll platforms with transactions pulled in automatically and reconciled/categorized continuously in real time, directly matching the founder story. Multiple first-party docs corroborate this (linking, auto-categorization, continuous reconciliation) and Mercury even publishes an honest caveat that 'connected' isn't 'fully automated,' showing transparency rather than contradiction. missing for 10: independent/hands-on verification beyond Mercury's own docs, and detail on daily import cadence/reliability guarantees.

   • [claimed-docs] “Link external bank accounts, cards, payroll platforms, and more for the complete story of your business.”
   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Third-party data flows in alongside Mercury's own: Books "connects to a growing set of third-party platforms, including Stripe, PayPal, and …”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

Categorization

1. founderGet automatic categorization suggestions for imported transactions that learn from my corrections

   weight 2 · round to Mercury Books
   Pilot—none0/10

   Evidence shows Pilot's transaction classification is handled by integrations plus human bookkeepers/accountants (pilot-comm-1, pilot-docs-17), not by an AI categorization engine that learns from founder corrections. No documentation describes a self-serve ML suggestion-and-correction loop. Missing for 10: any mention of an AI/ML categorization suggestion feature, evidence of a correction/feedback loop, or founder-facing UI for adjusting categorizations.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed8/10

   Mercury explicitly states that transactions are 'automatically assigned GL codes based on your categorization history and AI-driven suggestions,' directly supporting the idea of categorization suggestions that improve from past corrections, and Command lets users bulk-adjust GL codes and create rules that presumably feed this history. Mercury's own blog post also candidly notes automation has limits and isn't 'autopilot,' which sets realistic expectations rather than contradicting the feature. Missing for 10: independent/hands-on verification that suggestions specifically adapt after user corrections, and a public API/schema showing the correction-learning mechanism.

   • [claimed-docs] “The banking side feeds clean data to any ledger: "Transactions on Mercury are now automatically assigned GL codes based on your categorizati…”
   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “Use Mercury Command to bulk assign GL codes, create categorization rules, and more”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

Reconciliation

1. accountantReconcile each bank account against the ledger with matched, unmatched, and duplicate transactions surfaced for review

   weight 3 · round to Mercury Books
   Pilot—none0/10

   Pilot's evidence describes bank/tool integrations and automated transaction classification (pilot-comm-1, pilot-docs-17) but never describes a reconciliation workflow that surfaces matched, unmatched, and duplicate transactions for accountant review. Missing for 10: any documentation or user report of a reconciliation screen or matched/unmatched/duplicate transaction handling.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

   Mercury Books~partialclaimed5/10

   Mercury Books claims accounts 'reconcile in real time' automatically with categorization pulled directly from linked banking data (mercury-books-supp-auto-rec, mercury-books-supp-launch), and Mercury's own honest-scope post acknowledges that full automation still requires human review of ambiguous decisions (mercury-books-supp-honest-scope), implying some reconciliation review workflow exists. However, none of the evidence specifically describes a UI or workflow that surfaces matched, unmatched, and duplicate transactions as distinct categories for accountant review — the emphasis is on automation eliminating manual reconciliation work entirely rather than a structured review interface. Missing for 10: explicit documentation of matched/unmatched/duplicate transaction states, a dedicated reconciliation review screen, and independent/hands-on confirmation of this workflow.

   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

Bill management

1. accountantCapture vendor bills, route them for approval, and schedule payments from one workflow

   weight 2 · round drawn
   Pilot~partialclaimed3/10

   Pilot's pricing page lists 'Full accounts payable' as a service line item and mentions integration with Bill.com, implying vendor bill handling, but there is no documented detail on bill capture, approval routing, or payment scheduling mechanics within a single workflow — AP appears to be a done-for-you service rather than a described self-serve workflow. Missing for 10: bill capture/OCR details, approval routing configuration, payment scheduling functionality, and any hands-on/independent confirmation of the AP workflow.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”

   proof ↗⚑ flag

   Mercury Books~partialclaimed3/10

   Evidence only shows that 'bill pay' transactions are pulled into Mercury Books automatically alongside banking and invoicing data, implying some underlying bill-pay capability exists, but there is no description of a capture-to-approval-to-payment-scheduling workflow, approval routing, or scheduled payments within Books itself. missing for 10: vendor bill capture/OCR, approval routing rules, payment scheduling UI, evidence tying bill pay into an AP-specific workflow rather than just a transaction category.

   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”

   proof ↗⚑ flag

Payables

1. accountantSee accounts payable aging and vendor balances at any point in time

   weight 2 · round to Pilot
   Pilot~partialclaimed4/10

   Pilot advertises 'Full accounts payable' as a service feature and real-time account data access via its portal, implying some visibility into AP status, but there is no specific mention of AP aging reports or vendor balance tracking at a point in time. missing for 10: explicit AP aging report feature, vendor balance detail/history, point-in-time reporting capability, screenshots or hands-on evidence of AP aging views.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Evidence confirms Mercury Books generates P&L, cash flow, and balance sheet reports and mentions 'bill pay' as a data source, but there is no mention of an accounts payable aging report or vendor-balance tracking feature anywhere in the evidence pack. missing for 10: AP aging report, vendor balance report/ledger, point-in-time vendor balance lookups.

   • [claimed-docs] “Generate P&L, cash flow, and balance sheet reports from today’s numbers, not last quarter’s.”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Mercury Books is "Double-entry accounting that pulls directly from your Mercury data", generating "P&L, cash flow, and balance sheet reports…”

   proof ↗⚑ flag

Close process

1. accountantLock closed periods so prior-period numbers cannot change without an explicit reopening

   weight 2 · round drawn
   Pilot—none0/10

   No evidence in the pack mentions period locking, closing periods, or preventing retroactive changes to prior-period financials; the evidence only covers bookkeeping, tax, CFO, and integration features. Missing for 10: any mention of period-lock/close controls, reopening workflow, or audit trail preventing prior-period edits.

   ⚑ flag

   Mercury Books—none0/10

   No evidence in the pack mentions period locking, closing periods, or preventing edits to prior-period transactions without explicit reopening; the evidence covers categorization, reconciliation, reports, and accountant invites but not period lock controls.

   ⚑ flag

2. accountantRun a month-end close against a checklist that tracks reconciliations, accruals, and review sign-offs

   weight 3 · round to Pilot
   Pilot~partialclaimed3/10

   Pilot's monthly bookkeeping service closes books and lets customers communicate on 'outstanding items needed to finalize your books every month' via a portal, implying some close-tracking process, but there is no evidence of an actual checklist artifact tracking reconciliations, accruals, and review sign-offs as distinct trackable steps. missing for 10: explicit reconciliation checklist UI, accrual tracking, and sign-off/approval workflow evidence.

   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Evidence shows continuous automated reconciliation, accrual/cash accounting choice, and accountant collaboration via comments/tagging, but there is no mention of an actual month-end close checklist artifact, accrual entry tracking, or formal review sign-off workflow that an accountant could run through and mark complete. missing for 10: a defined close checklist feature, accrual scheduling/tracking, sign-off/approval workflow tied to close tasks.

   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “Accountant collaboration without seat caps: "You can invite your bookkeeper or accountant directly to your Mercury account with permissions …”
   • [claimed-docs] “Mercury Books is "Double-entry accounting that pulls directly from your Mercury data", generating "P&L, cash flow, and balance sheet reports…”
   • [claimed-docs] “The banking side feeds clean data to any ledger: "Transactions on Mercury are now automatically assigned GL codes based on your categorizati…”

   proof ↗⚑ flag

Collaboration

1. founderInvite my external accountant or bookkeeper with role-scoped access to review and adjust the books

   weight 3 · round to Mercury Books
   Pilot—none0/10

   Pilot's evidence describes its own bookkeeping team communicating with the founder via a portal (docs-18, docs-26) and lets customers keep QuickBooks data so any tax preparer can access it (docs-24), but there is no evidence of a feature to invite an external accountant/bookkeeper into Pilot's own system with role-scoped permissions to review or adjust books. missing for 10: any documentation of user/role invitation, permission scoping, or external collaborator access controls within Pilot's platform.

   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed8/10

   Mercury Books explicitly supports inviting bookkeepers/accountants in-product with role-tailored permissions and no seat caps, allowing them to view transactions, categorizations, and comment/tag on entries. Missing for 10: no independent/hands-on corroboration of the granularity of role-scoping (e.g., specific permission levels) and no detail on whether accountants can directly adjust vs. only comment.

   • [claimed-docs] “Invite your bookkeeper in-product, with unlimited seats at no extra cost.”
   • [claimed-docs] “Accountant collaboration without seat caps: "You can invite your bookkeeper or accountant directly to your Mercury account with permissions …”
   • [claimed-docs] “The banking side feeds clean data to any ledger: "Transactions on Mercury are now automatically assigned GL codes based on your categorizati…”

   proof ↗⚑ flag

Data access

1. developerPull the full general ledger and trial balance through a documented API in open formats

   weight 3 · round drawn
   Pilot—none0/10

   No evidence of a documented API for pulling general ledger or trial balance data; probes for OpenAPI/docs endpoints returned 404s and no API documentation is mentioned anywhere in the evidence pack.

   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

   Mercury Books—none0/10

   The evidence explicitly states a full accounting API is only planned ('Soon, a full accounting API will make every core Books action available programmatically'), and direct probes for OpenAPI/llms.txt docs returned 404s, confirming no current documented API for pulling GL/trial balance data in open formats.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

Integrations

1. founderConnect my banking, payments, and payroll systems so their activity flows into the ledger automatically

   weight 2 · round drawn
   Pilot✓fullcommunity8/10

   Pilot explicitly integrates with banking, payments, and payroll systems (e.g. Bill.com, Stripe, Gusto, 10k+ integrations) to feed real-time transaction data into the ledger, and community testimonials confirm bank/card/payment integrations auto-handle transaction classification with minimal founder effort. missing for 10: no explicit first-party detail on the breadth/setup process of bank feed connections beyond named partners, no independent audit of integration reliability at scale.

   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “10k+ Integrations”
   • [claimed-docs] “If you use Gusto, we’ve partnered with Gusto to automatically apply the credit, saving you time.”
   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed8/10

   Mercury Books explicitly supports linking external bank accounts, cards, and payroll platforms, plus named integrations with Stripe, PayPal, and Gusto, with activity flowing automatically into the ledger via continuous categorization and reconciliation. Mercury itself is candid that this is a strong starting point rather than full autopilot, which tempers but doesn't contradict the core claim. Missing for 10: independent/hands-on verification of these integrations working in practice, and a public API/OpenAPI spec was found to 404, indicating limited programmatic verification.

   • [claimed-docs] “Link external bank accounts, cards, payroll platforms, and more for the complete story of your business.”
   • [claimed-docs] “Third-party data flows in alongside Mercury's own: Books "connects to a growing set of third-party platforms, including Stripe, PayPal, and …”
   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”
   • [claimed-docs] “Customers with enriched integrations to QuickBooks and NetSuite can now attach Classes to transactions on Mercury.”

   proof ↗⚑ flag

Migration

1. founderMigrate historical books from another accounting system without losing transaction detail

   weight 1 · round to Pilot
   Pilot~partialclaimed5/10

   Pilot markets that switching providers is supported and mentions keeping existing QuickBooks account and historical data, implying migration support, but there's no detail on how historical transaction-level detail is preserved or migrated from other systems (e.g., Xero, Wave, spreadsheets) beyond QuickBooks. missing for 10: documented migration process, evidence of no data/detail loss, support for non-QuickBooks source systems, independent confirmation of successful migrations.

   • [claimed-docs] “Whether you’re starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding, underst…”
   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Whether you're starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding, underst…”
   • [claimed-docs] “Whether you’re starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding”

   proof ↗⚑ flag

   Mercury Books—none0/10

   No evidence describes an import/migration tool for bringing historical transaction-level data in from QuickBooks/NetSuite or other systems; in fact Mercury explicitly frames Books as a replacement rather than an integration/sync layer for prior accounting systems, and the cited third-party integrations (Stripe, PayPal, Gusto, bank feeds) are for ongoing data flow, not one-time historical migration.

   • [claimed-docs] “Does Mercury Books replace QuickBooks? Yes. Mercury Books is a complete accounting system — not an add-on or integration layer for another p…”
   • [claimed-docs] “Mercury Books is "Double-entry accounting that pulls directly from your Mercury data", generating "P&L, cash flow, and balance sheet reports…”
   • [claimed-docs] “Third-party data flows in alongside Mercury's own: Books "connects to a growing set of third-party platforms, including Stripe, PayPal, and …”

   proof ↗⚑ flag

Invoicing

1. founderCreate and send invoices with online payment options and see when they are viewed and paid

   weight 3 · round drawn
   Pilot—none0/10

   Evidence only shows Pilot offers 'full accounts receivable' as a bookkeeping service item, but there is no mention of self-serve invoice creation, online payment collection, or view/paid tracking features for founders—Pilot is a done-for-you bookkeeping service, not an invoicing tool. Missing for 10: invoice creation UI, online payment processing, read-receipt/paid-status tracking evidence.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Evidence only mentions 'invoicing' as one of many transaction types Mercury Books pulls in automatically (alongside banking, bill pay); there is no evidence of invoice creation/sending, online payment collection, or view/paid status tracking within Mercury Books itself.

   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Third-party data flows in alongside Mercury's own: Books "connects to a growing set of third-party platforms, including Stripe, PayPal, and …”

   proof ↗⚑ flag

2. founderSet up recurring invoices and automatic payment reminders for overdue customers

   weight 2 · round drawn
   Pilot—none0/10

   Evidence mentions 'Full accounts receivable' as a service but nothing about recurring invoicing or automated overdue payment reminders specifically. Pilot is positioned as a bookkeeping/accounting service, not an invoicing tool with these automation features documented anywhere in the pack.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

   Mercury Books—none0/10

   The evidence pack mentions invoicing only as one data stream feeding into books (transactions across 'banking, invoicing, bill pay'), but there is no mention of recurring invoice scheduling or automated overdue payment reminders anywhere in the docs. This is a fair capability for a full accounting system to offer, so absence of evidence is 'none' rather than 'na'.

   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Link external bank accounts, cards, payroll platforms, and more for the complete story of your business.”

   proof ↗⚑ flag

Receivables

1. accountantTrack accounts receivable with aging reports and per-customer balances

   weight 2 · round to Pilot
   Pilot~partialclaimed4/10

   Pilot's pricing page lists 'Full accounts receivable' as a service offering, confirming AR management is part of the product, but there is no evidence of specific features like aging reports or per-customer balance tracking/reporting in the evidence pack. missing for 10: documentation of aging reports, per-customer balance views, AR-specific dashboards or reports, and independent/hands-on confirmation of these features.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Mercury Books documents P&L, cash flow, and balance sheet reports and mentions invoicing as one of the pulled-in transaction types, but no evidence describes accounts-receivable aging reports or per-customer balance tracking specifically. missing for 10: AR aging report feature, per-customer balance view, any invoicing/AR-specific reporting documentation.

   • [claimed-docs] “Generate P&L, cash flow, and balance sheet reports from today’s numbers, not last quarter’s.”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Mercury Books is "Double-entry accounting that pulls directly from your Mercury data", generating "P&L, cash flow, and balance sheet reports…”

   proof ↗⚑ flag

Ai ledger

1. ai-native userHave an agent draft and post journal entries via the API and leave them in a review queue for my accountant

   weight 3 · round drawn
   Pilot—none0/10

   No evidence of any API, agent integration, or journal entry review queue functionality; Pilot is a human-service bookkeeping/accounting company with no documented API (openapi probes 404). Missing for 10: any API existence, journal entry draft/post capability, review queue workflow, agent-facing endpoints.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE llms.txt: HTTP 200 at https://pilot.com/llms.txt # Pilot [Entity: Pilot] [Category: Professional Services] [Subcategory: Acco…”

   proof ↗⚑ flag

   Mercury Books—none0/10

   The only mention of a programmatic API and MCP layer for agents is explicitly framed as a future roadmap item ('Soon, a full accounting API... will let AI agents handle bookkeeping tasks end-to-end'), not a shipped capability, and probes confirm no live OpenAPI/MCP endpoints exist today (404s on all candidate paths). While Command can draft journal entries via chat and accountants can be invited to collaborate, there is no evidence of an API-driven posting workflow or a formal 'review queue' gating agent-drafted entries for accountant approval.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Accountant collaboration without seat caps: "You can invite your bookkeeper or accountant directly to your Mercury account with permissions …”

   proof ↗⚑ flag

Chart of accounts

1. accountantCustomize the chart of accounts with account types, sub-accounts, and class or tag dimensions

   weight 3 · round to Mercury Books
   Pilot—none0/10

   Pilot is a done-for-you bookkeeping/accounting service, so ledger customization is a fair question, but the evidence pack only mentions generic 'custom workflows and reporting' with no mention of chart of accounts structure, account types, sub-accounts, or class/tag dimensions. Missing for 10: any documentation of COA setup, account type hierarchy, sub-account creation, or class/tag dimension tagging controlled by the accountant.

   • [claimed-docs] “Custom workflows and reporting”

   proof ↗⚑ flag

   Mercury Books~partialclaimed5/10

   Evidence shows GL code assignment, bulk categorization rules, and Class/tag attachment to transactions (via enriched QuickBooks/NetSuite integrations), plus Command's ability to help 'organize your chart of accounts' — indicating some COA customization exists. However there's no explicit documentation of defining account types or creating sub-accounts within the ledger structure itself. missing for 10: explicit account-type configuration, sub-account creation/hierarchy, and native (non-integration) class/tag dimension setup.

   • [claimed-docs] “Use Mercury Command to bulk assign GL codes, create categorization rules, and more”
   • [claimed-docs] “Customers with enriched integrations to QuickBooks and NetSuite can now attach Classes to transactions on Mercury.”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “The banking side feeds clean data to any ledger: "Transactions on Mercury are now automatically assigned GL codes based on your categorizati…”

   proof ↗⚑ flag

Journal entries

1. accountantPost manual journal entries with balanced debits, credits, and supporting memos

   weight 3 · round to Mercury Books
   Pilot—none0/10

   Pilot's evidence describes a done-for-you bookkeeping/CFO service built on QuickBooks with dedicated experts handling books, but there is no mention of any interface for accountants to post manual journal entries with debits/credits and memos. Missing for 10: any UI or workflow for manual JE creation, debit/credit balancing, or memo attachment.

   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”

   proof ↗⚑ flag

   Mercury Books~partialclaimed5/10

   Books is confirmed as a double-entry accounting system with journal entries as a core capability ("writing journal entries" is explicitly listed as a task Command can help with), implying balanced debit/credit posting, but there's no direct documentation of a manual journal-entry UI, memo/note fields, or debit=credit validation for accountant-initiated entries — most journal entry evidence frames it as an AI-assisted/automated task rather than manual accountant entry. Missing for 10: explicit manual entry screen documentation, memo/attachment support on journal entries, and confirmation of balance validation.

   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Mercury Books is "Double-entry accounting that pulls directly from your Mercury data", generating "P&L, cash flow, and balance sheet reports…”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”

   proof ↗⚑ flag

Ai audit

1. ai-native userHave an agent monitor the ledger and flag anomalies in spend or duplicate transactions before the close

   weight 3 · round drawn
   Pilot—none0/10

   Pilot's evidence covers bookkeeping, tax, CFO services, and AI Q&A on transactions, but there is no mention of an autonomous agent that monitors the ledger, flags spend anomalies, or detects duplicate transactions before close. missing for 10: anomaly-detection feature, duplicate-transaction flagging, any agentic monitoring capability, pre-close audit workflow evidence.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Track company expenses in real time Find the $2,000/month you didn't know you were wasting.”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Evidence shows Command can answer questions and bulk-categorize/reconcile transactions, and an MCP layer for agents is only promised as 'soon,' but nothing describes proactive anomaly detection, duplicate-transaction flagging, or pre-close audit alerts.

   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”
   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag

Audit trail

1. accountantSee a complete audit trail of who changed what and when across the entire ledger

   weight 3 · round drawn
   Pilot—none0/10

   No evidence in the pack describes any audit trail, change history, or user-activity logging feature within Pilot's platform; the material focuses on bookkeeping services, integrations, CFO advisory, and tax credits. Missing for 10: any mention of audit logs, change tracking, user attribution, or timestamped edit history across the ledger.

   ⚑ flag

   Mercury Books—none0/10

   No evidence describes an audit trail, change log, user attribution, or history of edits across the ledger; the pack focuses on automation, categorization, reporting, and accountant seat invites, none of which document who-changed-what-when tracking. This is a plausible and expected feature for a full accounting system, so absence of evidence yields 'none' rather than 'na'.

   ⚑ flag

Multi entity

1. accountantManage multiple legal entities and produce consolidated financials across them

   weight 2 · round to Pilot
   Pilot~partialclaimed4/10

   Pilot's FAQ mentions it can provide consolidated reporting for US entities with foreign subsidiaries, but there is no evidence of multi-entity management for domestic entities, no detail on consolidation methodology, and no independent/hands-on corroboration of this feature. missing for 10: multi-entity dashboard/management capability, domestic multi-entity consolidation support, detailed consolidation workflow, independent verification.

   • [claimed-docs] “We can also provide US entities with foreign subsidiaries with consolidated reporting.”

   proof ↗⚑ flag

   Mercury Books—none0/10

   No evidence anywhere in the pack mentions multiple legal entities, inter-company eliminations, or consolidated financial statements across entities; all documentation describes a single-business books setup with one set of P&L/balance sheet/cash flow reports.

   ⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round drawn
   Pilot—none0/10

   No evidence of any public API for Pilot; probes for OpenAPI/swagger endpoints all returned 404, and all documentation describes only the human portal/UI and service offerings. missing for 10: any documented API, API parity claims, or developer endpoints.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Mercury's own docs say a full accounting API is coming 'soon' — it does not exist yet — and probes for llms.txt/openapi specs both return 404, confirming no current API parity with the UI.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round drawn
   Pilot—none0/10

   While Pilot mentions QuickBooks compatibility and tax-preparer portability, there is no evidence of a dedicated data export feature, open-format export (CSV/JSON/API), or a documented process to fully extract and leave with all financial data; probes even show no public API/OpenAPI spec.

   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

   Mercury Books—none0/10

   No evidence pack item mentions any data export feature, open format (CSV/OFX/JSON) download, or account-closure data portability path; the only related probes (llms.txt, openapi.json) return 404s, and Mercury explicitly positions Books as a replacement system rather than an interoperable one ('not an add-on or integration layer for another platform').

   • [claimed-docs] “Does Mercury Books replace QuickBooks? Yes. Mercury Books is a complete accounting system — not an add-on or integration layer for another p…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Pilot—none0/10

   No evidence in the pack addresses data residency, region selection, or storage location controls; Pilot is an accounting/bookkeeping service with no mention of infrastructure or data-residency options. Missing for 10: any documentation of data storage regions, residency guarantees, or configurable data location.

   ⚑ flag

   Mercury Books—none0/10

   No evidence anywhere in the pack discusses data residency, region selection, or storage location controls for Mercury Books; the material covers accounting features, AI assistant capabilities, and integrations only.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   Pilot—none0/10

   Pilot is an accounting/bookkeeping service; the evidence pack contains no privacy policy statements, opt-out controls, or AI-training data usage terms addressing whether customer financial data is used to train AI models. This is a fair question given Pilot advertises 'AI answers' features, but no evidence confirms any data-training opt-out or exclusion mechanism. Missing for 10: privacy policy/ToS language on AI training data usage, an opt-out mechanism, or any statement on data handling for AI features.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

   Mercury Books—none0/10

   The evidence pack contains no mention of data-training opt-outs, AI model training policies, or privacy controls specific to preventing customer data from being used to train AI models; Mercury Books' AI features (Command) are described functionally but with no privacy-posture documentation on this axis. Missing for 10: any privacy policy language, opt-out mechanism, or documentation addressing whether user financial data is used to train AI models.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   Pilot—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy settings for Pilot's AI features or data; the pack only covers accounting, bookkeeping, and tax service offerings. Missing for 10: any documentation of data retention/deletion controls, privacy settings, or data handling policies for AI or customer data.

   ⚑ flag

   Mercury Books—none0/10

   The evidence pack contains no mention of data retention policies, deletion controls, export/purge mechanisms, or any privacy-posture settings a user could control; it focuses entirely on accounting features, AI assistant capabilities, and pricing. This is a fair axis for a financial SaaS product handling sensitive business data, but no supporting evidence exists.

   ⚑ flag

Ai insights

1. ai-native userAsk an agent "can we afford X?" and get an answer grounded in live ledger data pulled through the API

   weight 3 · round to Pilot
   Pilot~partialprobed4/10

   Pilot advertises an in-app AI feature offering 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' which aligns with the 'can we afford X' query use case, but there is no evidence this is exposed via an API for external agents to query — the openapi probe returned 404s and no API/agent-integration docs exist. missing for 10: evidence of a public API/endpoint an external AI agent could call, documentation of grounding in live ledger data via API, and any independent confirmation the AI answer feature works as described.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Model cash flow scenarios Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Know if you can afford new hires well before you make the offers.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Mercury's own docs frame the accounting API and MCP layer for external agents as a future ('Soon') capability, not something shipped today, and direct probes for an OpenAPI spec or llms.txt on Mercury's docs return 404s, indicating no live API for third-party agents yet. The only grounded Q&A shown (Command) is an in-product assistant, not an externally callable API an outside agent could query.

   • [claimed-docs] “Soon, a full accounting API will make every core Books action available programmatically, and an MCP layer will let AI agents handle bookkee…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://support.mercury.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://support.mercury.com/openapi.json, https://support.mercury.com/swagger.json, https://support.…”
   • [claimed-docs] “The built-in AI assistant is Command: "Ask Command anything about your finances — spend, trends, GL codes — and get immediate answers ground…”

   proof ↗⚑ flag

Custom reports

1. accountantBuild custom reports filtered and grouped by class, location, or tag dimensions

   weight 2 · round drawn
   Pilot—none0/10

   Evidence only mentions generic 'custom workflows and reporting' (pilot-docs-10) with no mention of class, location, or tag dimension filtering/grouping capabilities typical of QuickBooks-style reports; missing for 10: any documentation of dimension-based (class/location/tag) filtering or grouping in reports.

   • [claimed-docs] “Custom workflows and reporting”

   proof ↗⚑ flag

   Mercury Books—none0/10

   Evidence shows Mercury Books generates standard P&L, cash flow, and balance sheet reports, and mentions attaching 'Classes' to transactions only for customers with enriched QuickBooks/NetSuite integrations — not a native custom report builder. No evidence of location or tag dimensions, or of building custom reports filtered/grouped by these dimensions within Books itself.

   • [claimed-docs] “Generate P&L, cash flow, and balance sheet reports from today’s numbers, not last quarter’s.”
   • [claimed-docs] “Customers with enriched integrations to QuickBooks and NetSuite can now attach Classes to transactions on Mercury.”

   proof ↗⚑ flag

Statements

1. founderGenerate an accurate P&L, balance sheet, and cash-flow statement for any period on demand

   weight 3 · round to Mercury Books
   Pilot~partialcommunity5/10

   Pilot's bookkeeping and CFO service pages reference real-time account data, custom workflows/reporting, and budget-vs-actuals/scenario planning, implying standard financial statements are produced as part of monthly bookkeeping, and community reviews confirm books are kept accurate and up to date. However, no evidence explicitly confirms generation of a P&L, balance sheet, and cash-flow statement for any arbitrary period on demand. Missing for 10: explicit documentation of the three core statements, confirmation of on-demand/any-period generation (vs. standard monthly close), and independent verification of statement accuracy/timeliness.

   • [claimed-docs] “Custom workflows and reporting”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Custom financial model with strategic insights Budget vs actuals variance analysis Scenario planning model”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”
   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [community] “Pilot customer here; they are amazing. It's pretty different from a regular bookkeeper largely in that Pilot is super accurate and timely. M…”

   proof ↗⚑ flag

   Mercury Books✓fullclaimed8/10

   Mercury Books explicitly generates P&L, cash-flow, and balance-sheet reports on demand from real-time reconciled data, with cash/accrual choice, positioned as a full double-entry replacement for QuickBooks. This is a core advertised feature with detailed first-party docs, though there's no independent/hands-on corroboration of report accuracy and Mercury itself cautions that automation isn't fully hands-off. Missing for 10: independent verification of statement accuracy, and confirmation that reports are audit-grade/error-free in practice.

   • [claimed-docs] “Generate P&L, cash flow, and balance sheet reports from today’s numbers, not last quarter’s.”
   • [claimed-docs] “Mercury Books is "Double-entry accounting that pulls directly from your Mercury data", generating "P&L, cash flow, and balance sheet reports…”
   • [claimed-docs] “From the launch post: "All your transactions across banking, invoicing, bill pay, and more are pulled in automatically as you build your bus…”
   • [claimed-docs] “Reconciliation and categorization are automatic and continuous: "Data across banking, cards, invoicing, and more are categorized automatical…”
   • [claimed-docs] “Mercury's own honest framing of automation limits: "a 'connected' system isn't the same as fully automated. Bank-connected bookkeeping can e…”

   proof ↗⚑ flag