QuickBooks Online vs Pilot

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round drawn
   QuickBooks Online~partialprobed4/10

   llms.txt explicitly returns 404 (no dedicated agent-readable docs file), and no OpenAPI spec was found at standard locations either. However, Intuit does document an official MCP server for QuickBooks Online (developer.intuit.com/.../mcp and a GitHub repo with 145 tools/29 entities), which constitutes agent-oriented documentation an AI agent could be pointed at instead of llms.txt. Missing for 10: an actual llms.txt or equivalent single agent-readable manifest, and independent confirmation the MCP docs page is comprehensive/discoverable rather than a niche developer page.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”

   proof ↗⚑ flag

   Pilot~partialprobed4/10

   A probe confirms Pilot serves an llms.txt file at HTTP 200, so an agent can indeed be pointed at it — but the content shown is minimal (just entity/category metadata, no structured docs or API references), and other agent-doc formats (docs-md, openapi) return 404. Missing for 10: substantive llms.txt content beyond basic metadata, markdown docs mirror, and any first-party statement about agent-oriented documentation strategy.

   • [probe] “PROBE llms.txt: HTTP 200 at https://pilot.com/llms.txt # Pilot [Entity: Pilot] [Category: Professional Services] [Subcategory: Acco…”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   QuickBooks Online exposes a REST API with official OAuth SDKs (Node.js, PHP) and an official MCP server with 145 tools covering CRUD across 29 entities and 11 reports, all of which can be scripted/automated without a UI — and a sandbox environment plus write-safety toggles (QUICKBOOKS_DISABLE_WRITE/UPDATE) support automated, non-interactive testing akin to CI use. However, there is no explicit documentation of a CLI, CI pipeline integration, or headless-run instructions/examples specifically for automation pipelines. Missing for 10: explicit CI/pipeline documentation or examples, a dedicated CLI for scripted automation, and independent evidence of successful headless/CI usage in practice.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

3. ai-native userConnect an agent via an official MCP server

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   Intuit publishes an official MCP server (github.com/intuit/quickbooks-online-mcp-server) with 145 tools covering 29 entity types and 11 financial reports, full CRUD, sandbox/production environment switching, and write-safety toggles for scoping agent actions, and Intuit's developer docs also list the MCP server under official docs. Missing for 10: independent/community hands-on validation of the MCP server itself (only vendor/GitHub-authored evidence) and clearer production-readiness signals (e.g., versioning/maturity status).

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any MCP server offering; docs mention integrations (Bill.com, Stripe, Gusto) but nothing about AI agent connectivity via MCP, and API/openapi probes returned 404s.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”

   proof ↗⚑ flag

4. ai-native userDrive the product through a documented public API

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   QuickBooks Online exposes a documented public REST API with official OAuth2 SDKs (Node.js, PHP) supporting full CRUD across many entity types, plus a sandbox environment for safe integration testing, and an official MCP server with 145 tools covering 29 entities and 11 reports for agentic access. Probes show no discoverable llms.txt or OpenAPI spec at expected paths, and no independent third-party corroboration of API robustness beyond vendor docs. missing for 10: publicly discoverable OpenAPI/llms.txt spec, independent developer reviews of the API's completeness/reliability.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “QuickBooks Fault object parsing for detailed validation errors”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “OAuth 2.0 authentication flow”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of a public API for Pilot; OpenAPI/swagger probes all returned 404 and no docs mention an API for driving the product programmatically. Pilot is a human-service accounting/bookkeeping product with integrations, not an API-driven platform.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

5. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   Intuit's official MCP server exposes environment variables (QUICKBOOKS_DISABLE_WRITE, QUICKBOOKS_DISABLE_UPDATE) and lets you restrict which tool categories are registered, and the OAuth client supports a sandbox/production split—giving some coarse-grained, least-privilege-style control over what an agent can do. However this is app-level config rather than true per-agent scoped OAuth credentials/roles, and there's no documented fine-grained scope system (e.g., read-only vs specific entity scopes) issued per credential. Missing for 10: granular OAuth scope definitions, role-based API key issuance per agent, and independent confirmation these toggles are enforced server-side rather than just client config.

   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

6. ai-native userBuild against official SDKs

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   Intuit maintains official SDKs (oauth-jsclient for Node.js, QuickBooks-V3-PHP-SDK for PHP) with documented OAuth flows, CRUD examples, and sandbox/production environment switches for safe development, plus an official MCP server exposing 145 tools across 29 entity types and 11 financial reports with write-safety toggles — directly enabling AI-native/agentic development against QuickBooks Online. missing for 10: no discoverable OpenAPI/swagger spec or llms.txt (both probed 404), and no independent developer corroboration of SDK/MCP quality beyond first-party docs.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “QuickBooks Fault object parsing for detailed validation errors”
   • [claimed-docs] “OAuth 2.0 authentication flow”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [claimed-docs] “OAuth 2.0 authentication flow - Token management and refresh”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any official SDKs; probes for API/OpenAPI specs returned 404s, and no docs mention developer SDKs.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

7. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack contains no mention of webhooks, event subscriptions, or push notifications anywhere in QuickBooks' docs, GitHub SDKs, or MCP server materials — only OAuth clients, REST CRUD operations, and polling-style API access are documented. Webhook subscription is a plausible capability for an API-driven accounting platform, but no evidence shows QuickBooks Online supports it.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of any webhook subscription capability or event API; Pilot is an accounting/bookkeeping service and probes show no OpenAPI or developer API surface exists.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed8/10

   QuickBooks documents Intuit Intelligence/AI features that generate insights directly from user data: an AI chat that answers questions like "What's driving my profit?" and "How are my invoices doing this month?", instant reports on top expenses/sales trends/industry benchmarking, AI-driven anomaly resolution and tax savings estimation, and Payroll AI that spots inconsistencies proactively. These are first-party vendor claims without independent hands-on corroboration. Missing for 10: independent/community validation that these AI insights work as described, and detail on accuracy/reliability of the suggestions.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”
   • [claimed-docs] “See funding options based on your real-time financials, understand what affects your approval odds for a QuickBooks Term Loan or QuickBooks …”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot's marketing mentions 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead' (pilot-docs-7), which points to some AI-generated insight capability inside the product, and scenario/cash-flow modeling features (pilot-docs-8, pilot-docs-21) suggest similar analytical output, though these are framed as human CFO-delivered rather than explicitly AI-driven. There is no independent/hands-on corroboration of the AI feature actually working, and community reviews focus on bookkeeping accuracy/time savings rather than AI insights. Missing for 10: detailed documentation of the AI feature's scope/accuracy, independent user testimony specifically about the AI insights, and clarity on whether insights are AI-generated vs. human-analyst-generated.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Model cash flow scenarios Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Track company expenses in real time Find the $2,000/month you didn't know you were wasting.”
   • [claimed-docs] “Find the $2,000/month you didn't know you were wasting.”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialcommunity6/10

   QuickBooks ships several rule-based automations (bank-rule categorization, automated payment reminders, automatic bank-feed import, automatic reconciliation reports) and Intuit Intelligence/Payroll AI that proactively monitor data and flag issues, plus an official MCP server exposing 145 tools across 29 entities and financial reports for agent-driven access with sandbox and write-safety toggles. However, these are mostly triggered rules or on-demand AI chat interactions rather than a documented capability for a user to configure agents that run continuously/autonomously in the background without external orchestration; the MCP server itself is a tool interface for agents built by developers, not a built-in scheduler. missing for 10: native scheduling/trigger builder for persistent background automations, evidence of fully autonomous unattended agent runs, independent corroboration of agentic automation reliability.

   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”
   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed7/10

   QuickBooks has a built-in AI assistant ("Intuit Intelligence") that users can chat with to create invoices, resolve anomalies, run payroll, generate reports, and get instant contextual answers — a direct in-product delegation experience, not a separate tool. missing for 10: independent/hands-on verification of the assistant's reliability and scope beyond vendor marketing copy.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's pricing page mentions an AI feature offering 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' which is a thin, single-mention hint of an in-product AI assistant capable of some task-like actions (scenario modeling). There's no further documentation on scope, autonomy, or how tasks are delegated to it, and community evidence focuses on human bookkeepers/CFOs rather than the AI assistant. Missing for 10: detailed documentation of the AI assistant's task-delegation capabilities, independent/hands-on corroboration of it actually performing delegated tasks, and clarity on its scope beyond Q&A.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed6/10

   QuickBooks offers 'Intuit Intelligence' chat where users can issue natural-language commands to create invoices, run payroll, generate reports, and get answers to questions like 'What's driving my profit?' — this directly supports natural-language operation. However, this is a limited chat assistant layered on top of the core UI rather than full natural-language control of all product functions, and there's no independent/hands-on evidence corroborating its reliability or scope beyond vendor claims. Missing for 10: independent verification of the chat's command coverage/reliability, evidence of natural-language control beyond the listed use cases, and hands-on user reports confirming it works as described.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's marketing mentions 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' implying some natural-language Q&A interface, but there's no evidence of broader natural-language command execution (e.g., initiating actions, workflows) or any API/CLI to support it. missing for 10: evidence of NL commands beyond Q&A, independent/hands-on corroboration, technical documentation of the AI interface, API or programmatic access.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence includes only static SDK README code snippets (PHP/Node OAuth examples) and explicit probes showing the developer site lacks an interactive OpenAPI/Swagger explorer (openapi.json 404) and no llms.txt, with no mention of a live, runnable API explorer or sandbox console. missing for 10: interactive browser-based API reference, runnable request/response console, discoverable OpenAPI spec.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is an accounting/bookkeeping service with no evidence of any developer API reference or runnable examples; probes for OpenAPI/docs-md all returned 404, and no evidence pack items mention an API reference.

   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Direct probes for an OpenAPI/swagger spec on Intuit's developer domain returned 404s at all standard locations, and no other evidence shows a downloadable machine-readable API spec; the MCP server and SDKs (Node/PHP) are wrapper tools, not an OpenAPI spec itself.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Pilot—none0/10

   Probe explicitly checked common OpenAPI/swagger endpoints and all returned 404, and no documentation mentions a machine-readable API spec. Missing for 10: any published OpenAPI/Swagger spec, API documentation, or developer portal.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

3. ai-native userTest against a sandbox environment without touching production data

   weight 1 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   Intuit's official OAuth client and MCP server docs explicitly document a sandbox/production environment split, with sandbox using isolated company data and localhost redirect URIs, plus write-safety toggles for agent scoping. This directly supports AI-native testing against sandbox without touching production. Missing for 10: independent/hands-on confirmation of sandbox parity with production and no evidence of persistent sandbox data limitations or resets.

   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

4. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence shows QuickBooks has a versioned REST API (V3 SDK, OAuth client) and even an official MCP server, but nothing in the pack documents a deprecation policy, versioning cadence, or sunset timeline for API versions; probes for openapi/llms.txt docs both 404, suggesting no discoverable machine-readable API reference either. Missing for 10: explicit deprecation policy documentation, version lifecycle/support windows, and any changelog or sunset notice practice.

   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any public API, versioning scheme, or deprecation policy; probes for OpenAPI specs all returned 404s. missing for 10: any public API documentation, versioning scheme, deprecation policy, or developer-facing API references.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence shows QuickBooks Online supports per-entity CRUD via API/MCP server (29 entity types, 11 reports) and vague mentions of 'syncing data in spreadsheets' for Advanced tier, but nowhere is a genuine bulk/batch operation (e.g., a batch API endpoint or agent tool for acting on many records in one call) documented. Missing for 10: explicit bulk/batch API documentation, MCP tool for multi-item operations, or hands-on evidence of processing many items in a single automated action.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “QuickBooks Online Advanced can sync data in spreadsheets to reduce your manual work.”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service; no evidence describes any bulk-operation or batch-processing capability across items (transactions, invoices, etc.) for AI-native automation. Missing for 10: any mention of bulk edit/import/export tools, batch API operations, or automation-scale item processing.

   ⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialcommunity5/10

   QuickBooks Online ships built-in 'bank rules' for automatic transaction categorization (confirmed independently in community discussion), plus automated payment reminders and auto-generated reconciliation reports, and docs mention custom workflows/roles as an Advanced feature — all of which are rule-based, event-triggered actions. However, these are narrow, product-specific automations (categorization, reminders, reconciliation) rather than a general-purpose, user-definable rules/triggers engine that an AI-native user could configure to fire arbitrary actions on arbitrary events; the MCP server exposes CRUD tools but no explicit rule-trigger framework. Missing for 10: a generalized event-condition-action rule builder, evidence of AI/MCP-driven custom automation creation, and independent hands-on confirmation of workflow automation beyond categorization.

   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”
   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with dedicated human experts and integrations, but there is no evidence of a rules engine or automation-trigger system letting users define event-based automated actions; features described are AI Q&A and integrations, not user-defined trigger/action rules.

   ⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack details QuickBooks' MCP server (145 tools, CRUD across 29 entities, sandbox/production split, write-safety toggles) but nowhere describes a mechanism for scheduling recurring jobs or workflows via API/MCP—no cron-like triggers, recurring-transaction API, or workflow scheduler for AI agents is documented. Mentions of 'automated payment reminders' or automatic bank imports are built-in consumer features, not an AI-native scheduling/automation primitive exposed to agents.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [claimed-docs] “Avoid late payments with automated payment reminders.”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

Ai reconciliation

1. ai-native userHave an agent reconcile a month end-to-end, matching transactions, flagging exceptions, and preparing the close for human review

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   QuickBooks ships real building blocks an agent could use—bank-feed transaction matching and reconciliation reports (quickbooks-docs-6/7/8/9), an official MCP server exposing 29 entity types, 11 financial reports, and full CRUD for agent integrations (quickbooks-gh-3/4/5/6/7), plus an 'Intuit Intelligence' chat that claims to 'help resolve anomalies' (quickbooks-docs-19). However, there is no documented tool or workflow that performs the reconciliation itself autonomously, flags exceptions, and packages a close for human review as one orchestrated task; reconciliation is presented as a human-driven feature ('Reconcile bank statements in minutes') and the MCP server's docs list generic CRUD/report access rather than a reconcile-specific or exception-flagging capability. Missing for 10: an explicit agent-driven reconciliation/close workflow tool, documented exception-flagging logic, and evidence of an agent actually completing an end-to-end month-end close.

   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”

   proof ↗⚑ flag

   Pilot~partialcommunity3/10

   Pilot's evidence shows human bookkeepers finalize monthly books with integration-driven transaction classification (pilot-comm-1, pilot-docs-18, pilot-docs-26), which is directionally toward automated reconciliation, but there is no evidence of an autonomous agent matching transactions, flagging exceptions, and preparing a close package end-to-end without human bookkeeper involvement. Missing for 10: explicit agentic exception-flagging workflow, evidence of AI (not human staff) doing the matching/reconciliation, and documentation of an automated close-prep output for review.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Bank feeds

1. founderConnect bank and credit-card accounts so transactions import automatically every day

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullcommunity8/10

   QuickBooks docs directly state bank/credit-card/PayPal/Square connections auto-import transactions daily, plus existing rule-based categorization is corroborated by a community comment, and reconciliation reports confirm ongoing automated matching. Missing for 10: independent hands-on verification of daily-sync reliability and no direct evidence addressing sync frequency/outage issues raised in community comments about QBO reliability.

   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”

   proof ↗⚑ flag

   Pilot✓fullcommunity7/10

   Pilot's docs and a first-hand customer testimonial confirm bank/credit-card/expense integrations automatically feed transaction data for classification, with real-time account data in the portal, eliminating manual founder bookkeeping work. missing for 10: no explicit list of supported banks, no detail on daily-sync frequency or setup flow, and no independent technical documentation beyond marketing/community claims.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Categorization

1. founderGet automatic categorization suggestions for imported transactions that learn from my corrections

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialcommunity4/10

   QuickBooks docs mention auto-sorting expenses (quickbooks-docs-28) and community evidence confirms built-in automatic categorization rules (quickbooks-comm-3), but neither source explicitly describes a machine-learning mechanism that adapts based on the founder's manual corrections. Missing for 10: explicit documentation of ML-based re-categorization suggestions, first-party confirmation that the system improves from user corrections, and independent hands-on validation of this adaptive behavior.

   • [claimed-docs] “Automatically sort expenses to stay ready for tax time”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence shows Pilot's transaction classification is handled by integrations plus human bookkeepers/accountants (pilot-comm-1, pilot-docs-17), not by an AI categorization engine that learns from founder corrections. No documentation describes a self-serve ML suggestion-and-correction loop. Missing for 10: any mention of an AI/ML categorization suggestion feature, evidence of a correction/feedback loop, or founder-facing UI for adjusting categorizations.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Reconciliation

1. accountantReconcile each bank account against the ledger with matched, unmatched, and duplicate transactions surfaced for review

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed7/10

   QuickBooks Online docs explicitly describe connecting bank/credit-card feeds, automatic transaction import and matching, a reconciliation workflow, an auto-generated reconciliation report, and discrepancy-focused reports (Reconciliation Discrepancy Report, Missing Checks Report, Transaction Detail Report) that help surface unmatched/duplicate items for review, directly matching the accountant story. Missing for 10: explicit documentation of a distinct 'duplicate transaction' flag/UI and independent hands-on verification of the reconciliation workflow's accuracy (community evidence is generic and not reconciliation-specific).

   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “When customers pay through QuickBooks invoices, we’ll record and match it for you.”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence describes bank/tool integrations and automated transaction classification (pilot-comm-1, pilot-docs-17) but never describes a reconciliation workflow that surfaces matched, unmatched, and duplicate transactions for accountant review. Missing for 10: any documentation or user report of a reconciliation screen or matched/unmatched/duplicate transaction handling.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Bill management

1. accountantCapture vendor bills, route them for approval, and schedule payments from one workflow

   weight 2 · round to Pilot
   QuickBooks Online—none0/10

   The evidence pack covers invoicing, A/R, bank reconciliation, and generic 'custom roles/workflows' language, but contains no documentation of vendor bill capture, bill approval routing, or scheduled bill payments — the core AP workflow described in the story. Missing for 10: bill capture/entry feature, approval workflow for bills, scheduled/bill-pay payment functionality, any hands-on or docs evidence of an AP module.

   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's pricing page lists 'Full accounts payable' as a service line item and mentions integration with Bill.com, implying vendor bill handling, but there is no documented detail on bill capture, approval routing, or payment scheduling mechanics within a single workflow — AP appears to be a done-for-you service rather than a described self-serve workflow. Missing for 10: bill capture/OCR details, approval routing configuration, payment scheduling functionality, and any hands-on/independent confirmation of the AP workflow.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”

   proof ↗⚑ flag

Payables

1. accountantSee accounts payable aging and vendor balances at any point in time

   weight 2 · round to Pilot
   QuickBooks Online—none0/10

   The evidence pack documents an A/R aging report and accounts-receivable tracking (quickbooks-docs-18, quickbooks-docs-37) but contains no mention of an accounts payable aging report or vendor balance reporting; the MCP server's financial reports list (Balance Sheet, P&L, Cash Flow) does not name AP aging either.

   ⚑ flag

   Pilot~partialclaimed4/10

   Pilot advertises 'Full accounts payable' as a service feature and real-time account data access via its portal, implying some visibility into AP status, but there is no specific mention of AP aging reports or vendor balance tracking at a point in time. missing for 10: explicit AP aging report feature, vendor balance detail/history, point-in-time reporting capability, screenshots or hands-on evidence of AP aging views.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Close process

1. accountantLock closed periods so prior-period numbers cannot change without an explicit reopening

   weight 2 · round drawn
   QuickBooks Online—none0/10

   No evidence pack item mentions closing periods, closing dates, or locking prior-period transactions from edits — QuickBooks Online does have a known 'closing date' feature in general knowledge, but nothing in this evidence pack documents it, so per the rules absence of evidence must be judged 'none'.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack mentions period locking, closing periods, or preventing retroactive changes to prior-period financials; the evidence only covers bookkeeping, tax, CFO, and integration features. Missing for 10: any mention of period-lock/close controls, reopening workflow, or audit trail preventing prior-period edits.

   ⚑ flag

2. accountantRun a month-end close against a checklist that tracks reconciliations, accruals, and review sign-offs

   weight 3 · round to Pilot
   QuickBooks Online—none0/10

   Evidence shows QuickBooks Online offers bank reconciliation tools, reconciliation reports, and accountant access, but there is no evidence of a dedicated month-end close checklist that tracks reconciliations, accruals, and review sign-offs as an integrated workflow. Community evidence even notes QBO lacks feature parity with desktop, and no close-management or sign-off workflow is documented.

   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “Give your accountant direct access to your books so she can find the reports and information she needs when questions arise.”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's monthly bookkeeping service closes books and lets customers communicate on 'outstanding items needed to finalize your books every month' via a portal, implying some close-tracking process, but there is no evidence of an actual checklist artifact tracking reconciliations, accruals, and review sign-offs as distinct trackable steps. missing for 10: explicit reconciliation checklist UI, accrual tracking, and sign-off/approval workflow evidence.

   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Collaboration

1. founderInvite my external accountant or bookkeeper with role-scoped access to review and adjust the books

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed6/10

   QuickBooks explicitly markets giving accountants direct access to books and custom role-based access controls (up to 25 users on Advanced), which directly supports inviting an external accountant with scoped permissions. However, evidence lacks specifics on how granular the role-scoping is for an accountant-specific invite (e.g., accountant-only view vs. full custom roles) or independent confirmation of this workflow in practice. Missing for 10: detailed documentation of accountant-specific invite flow and role granularity, and independent/hands-on corroboration of the accountant access experience.

   • [claimed-docs] “Give your accountant direct access to your books so she can find the reports and information she needs when questions arise.”
   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”
   • [claimed-docs] “Grow confidently with custom access for up to 25 users, Priority Circle expert support, and backup and restore to undo mistakes instantly an…”
   • [claimed-docs] “Move your whole firm to Intuit Accountant Suite—no data migration, no switching costs, no starting over.”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence describes its own bookkeeping team communicating with the founder via a portal (docs-18, docs-26) and lets customers keep QuickBooks data so any tax preparer can access it (docs-24), but there is no evidence of a feature to invite an external accountant/bookkeeper into Pilot's own system with role-scoped permissions to review or adjust books. missing for 10: any documentation of user/role invitation, permission scoping, or external collaborator access controls within Pilot's platform.

   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Data access

1. developerPull the full general ledger and trial balance through a documented API in open formats

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialprobed5/10

   QuickBooks Online exposes a REST API (V3) with SDKs (PHP, Node OAuth client) and an MCP server covering 29 entity types and 11 financial reports including Balance Sheet, P&L, and Cash Flow, which implies GL/trial-balance-like data can be retrieved programmatically. However, there is no direct evidence of a documented endpoint explicitly returning a full general ledger or trial balance report, nor confirmation of open/standard export formats (e.g., CSV/JSON schema for GL); OpenAPI/llms.txt probes returned 404s, reducing discoverability of a formal spec. missing for 10: explicit trial balance/GL report endpoint documentation, confirmed open-format (CSV/JSON) export schema, publicly accessible OpenAPI spec.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of a documented API for pulling general ledger or trial balance data; probes for OpenAPI/docs endpoints returned 404s and no API documentation is mentioned anywhere in the evidence pack.

   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

Integrations

1. founderConnect my banking, payments, and payroll systems so their activity flows into the ledger automatically

   weight 2 · round drawn
   QuickBooks Online✓fullcommunity8/10

   QuickBooks Online documents direct bank/credit card/PayPal/Square connections with automatic transaction import and matching, plus payments and payroll AI automation (time/attendance data flowing into payroll), and an 800+ app integration ecosystem including PayPal/Square/Shopify connectors. Community evidence confirms rule-based auto-categorization works in practice, corroborating the automated ledger flow. Missing for 10: independent hands-on verification of payroll-to-ledger automation specifically and no direct evidence of setup friction/reliability for these bank feeds beyond general reliability complaints unrelated to this axis.

   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “When customers pay through QuickBooks invoices, we’ll record and match it for you.”
   • [claimed-docs] “Import all your PayPal transactions into QuickBooks Online”
   • [claimed-docs] “PayPal Connector by QuickBooks”
   • [claimed-docs] “Square Connector by QuickBooks”
   • [claimed-docs] “QuickBooks integrates with over 800 popular business apps.”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”

   proof ↗⚑ flag

   Pilot✓fullcommunity8/10

   Pilot explicitly integrates with banking, payments, and payroll systems (e.g. Bill.com, Stripe, Gusto, 10k+ integrations) to feed real-time transaction data into the ledger, and community testimonials confirm bank/card/payment integrations auto-handle transaction classification with minimal founder effort. missing for 10: no explicit first-party detail on the breadth/setup process of bank feed connections beyond named partners, no independent audit of integration reliability at scale.

   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “10k+ Integrations”
   • [claimed-docs] “If you use Gusto, we’ve partnered with Gusto to automatically apply the credit, saving you time.”
   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Migration

1. founderMigrate historical books from another accounting system without losing transaction detail

   weight 1 · round to Pilot
   QuickBooks Online—none0/10

   No evidence describes any migration/import tooling for bringing historical transaction-level data from another accounting system into QuickBooks Online; the only migration-adjacent item (quickbooks-docs-27) refers to moving firms between Intuit's own products, not importing from competitors, and community evidence even notes QBO lacks feature parity with desktop QuickBooks. Missing for 10: any documented data-migration/import wizard, third-party system conversion tool, or evidence that transaction-level detail is preserved when switching from another platform.

   • [claimed-docs] “Move your whole firm to Intuit Accountant Suite—no data migration, no switching costs, no starting over.”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Pilot~partialclaimed5/10

   Pilot markets that switching providers is supported and mentions keeping existing QuickBooks account and historical data, implying migration support, but there's no detail on how historical transaction-level detail is preserved or migrated from other systems (e.g., Xero, Wave, spreadsheets) beyond QuickBooks. missing for 10: documented migration process, evidence of no data/detail loss, support for non-QuickBooks source systems, independent confirmation of successful migrations.

   • [claimed-docs] “Whether you’re starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding, underst…”
   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Whether you're starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding, underst…”
   • [claimed-docs] “Whether you’re starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding”

   proof ↗⚑ flag

Invoicing

1. founderCreate and send invoices with online payment options and see when they are viewed and paid

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed9/10

   Docs directly cover invoice creation (templates/logo), online payment button on invoices, view/paid tracking, and automated reminders — matching every element of the story. Missing for 10: independent/hands-on corroboration beyond vendor docs.

   • [claimed-docs] “Your invoices reflect your business. With our free invoice templates, add your logo and colors and create tailored professional invoices wit…”
   • [claimed-docs] “Send your invoice, know exactly when it’s viewed, and get notified when it’s paid.”
   • [claimed-docs] “Enable online payments to add a button to invoices for your customers to pay instantly online.”
   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “Get paid 4 days faster on average when you send invoice reminders with your Payments AI.”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence only shows Pilot offers 'full accounts receivable' as a bookkeeping service item, but there is no mention of self-serve invoice creation, online payment collection, or view/paid tracking features for founders—Pilot is a done-for-you bookkeeping service, not an invoicing tool. Missing for 10: invoice creation UI, online payment processing, read-receipt/paid-status tracking evidence.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

2. founderSet up recurring invoices and automatic payment reminders for overdue customers

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed6/10

   Automatic payment reminders for overdue customers are well documented (statement reminders, automated payment reminders, faster payment via reminders), but the evidence pack never explicitly describes a recurring/repeating invoice setup feature. Missing for 10: explicit documentation of recurring invoice scheduling/templates, and independent confirmation that reminders/recurring invoices work reliably in practice.

   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “In just a few clicks you can send statement reminders to customers that are late paying you.”
   • [claimed-docs] “Get paid 4 days faster on average when you send invoice reminders with your Payments AI.”
   • [claimed-docs] “QuickBooks helps you manage accounts receivable by tracking invoices, payments, and identifying your delinquent accounts.”
   • [claimed-docs] “QuickBooks makes it easy to run the A/R aging report to see which customers are late with their payments”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence mentions 'Full accounts receivable' as a service but nothing about recurring invoicing or automated overdue payment reminders specifically. Pilot is positioned as a bookkeeping/accounting service, not an invoicing tool with these automation features documented anywhere in the pack.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

Receivables

1. accountantTrack accounts receivable with aging reports and per-customer balances

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed8/10

   QuickBooks docs explicitly describe A/R aging reports ('run the A/R aging report to see which customers are late with their payments') and per-customer tracking of invoices, payments, and delinquent accounts, plus statement reminders for late-paying customers. Missing for 10: independent/hands-on corroboration of the aging report's accuracy or depth, and no sample screenshot/detail on per-customer balance breakdown beyond marketing copy.

   • [claimed-docs] “QuickBooks makes it easy to run the A/R aging report to see which customers are late with their payments”
   • [claimed-docs] “QuickBooks helps you manage accounts receivable by tracking invoices, payments, and identifying your delinquent accounts.”
   • [claimed-docs] “In just a few clicks you can send statement reminders to customers that are late paying you.”
   • [claimed-docs] “Enable online payments to add a button to invoices for your customers to pay instantly online.”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot's pricing page lists 'Full accounts receivable' as a service offering, confirming AR management is part of the product, but there is no evidence of specific features like aging reports or per-customer balance tracking/reporting in the evidence pack. missing for 10: documentation of aging reports, per-customer balance views, AR-specific dashboards or reports, and independent/hands-on confirmation of these features.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

Ai ledger

1. ai-native userHave an agent draft and post journal entries via the API and leave them in a review queue for my accountant

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed4/10

   QuickBooks does expose journal-entry CRUD via its official API/MCP server (29 entity types with full CRUD and write-safety toggles like QUICKBOOKS_DISABLE_WRITE), so an agent could draft and post entries programmatically, and accountants can be given direct book access. However, there is no evidence of a dedicated 'review queue' or draft/pending-approval state for journal entries awaiting accountant sign-off before posting. Missing for 10: documented draft/pending status for journal entries, an approval workflow tying agent-created entries to accountant review, and any UI/API concept of a review queue.

   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [claimed-docs] “Give your accountant direct access to your books so she can find the reports and information she needs when questions arise.”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of any API, agent integration, or journal entry review queue functionality; Pilot is a human-service bookkeeping/accounting company with no documented API (openapi probes 404). Missing for 10: any API existence, journal entry draft/post capability, review queue workflow, agent-facing endpoints.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE llms.txt: HTTP 200 at https://pilot.com/llms.txt # Pilot [Entity: Pilot] [Category: Professional Services] [Subcategory: Acco…”

   proof ↗⚑ flag

Chart of accounts

1. accountantCustomize the chart of accounts with account types, sub-accounts, and class or tag dimensions

   weight 3 · round drawn
   QuickBooks Online—none0/10

   The evidence pack contains no mention of chart of accounts, account types, sub-accounts, or class/tag tracking dimensions anywhere in the docs, GitHub, or community items. Without any documented evidence of this capability, it cannot be credited despite being a plausible axis for an accounting product.

   ⚑ flag

   Pilot—none0/10

   Pilot is a done-for-you bookkeeping/accounting service, so ledger customization is a fair question, but the evidence pack only mentions generic 'custom workflows and reporting' with no mention of chart of accounts structure, account types, sub-accounts, or class/tag dimensions. Missing for 10: any documentation of COA setup, account type hierarchy, sub-account creation, or class/tag dimension tagging controlled by the accountant.

   • [claimed-docs] “Custom workflows and reporting”

   proof ↗⚑ flag

Journal entries

1. accountantPost manual journal entries with balanced debits, credits, and supporting memos

   weight 3 · round drawn
   QuickBooks Online—none0/10

   The evidence pack covers invoicing, reconciliation, A/R, integrations, and AI features but contains no mention of manual journal entries, debit/credit entry screens, or memo fields for adjusting entries. Since journal entries are a core, applicable ledger capability for accounting software, absence of any supporting evidence means this is 'none' rather than 'na'.

   ⚑ flag

   Pilot—none0/10

   Pilot's evidence describes a done-for-you bookkeeping/CFO service built on QuickBooks with dedicated experts handling books, but there is no mention of any interface for accountants to post manual journal entries with debits/credits and memos. Missing for 10: any UI or workflow for manual JE creation, debit/credit balancing, or memo attachment.

   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”

   proof ↗⚑ flag

Ai audit

1. ai-native userHave an agent monitor the ledger and flag anomalies in spend or duplicate transactions before the close

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   QuickBooks documents an 'Intuit Intelligence' chat AI that can 'help resolve anomalies' and generate reports, plus a Reconciliation Discrepancy Report for spotting book discrepancies, and ships an official MCP server exposing 145 tools/CRUD and 11 financial reports that an external agent could use to monitor the ledger. However, none of this evidence specifically describes automated, proactive flagging of spend anomalies or duplicate transactions ahead of month-end close, and there's no independent or hands-on confirmation of this working as an agentic monitoring workflow. Missing for 10: dedicated duplicate-transaction/anomaly detection feature documentation, evidence of pre-close automated alerting, and third-party validation of anomaly detection accuracy.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence covers bookkeeping, tax, CFO services, and AI Q&A on transactions, but there is no mention of an autonomous agent that monitors the ledger, flags spend anomalies, or detects duplicate transactions before close. missing for 10: anomaly-detection feature, duplicate-transaction flagging, any agentic monitoring capability, pre-close audit workflow evidence.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Track company expenses in real time Find the $2,000/month you didn't know you were wasting.”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”

   proof ↗⚑ flag

Audit trail

1. accountantSee a complete audit trail of who changed what and when across the entire ledger

   weight 3 · round drawn
   QuickBooks Online—none0/10

   The axis clearly applies to accounting software, but no evidence item mentions an audit trail, activity log, or change-history feature — closest matches (custom roles/permissions, backup & restore) address access control and data recovery, not a record of who changed what and when. Missing for 10: any documentation of an Audit Log/Audit Trail report, user-action history, or field-level change tracking across the ledger.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack describes any audit trail, change history, or user-activity logging feature within Pilot's platform; the material focuses on bookkeeping services, integrations, CFO advisory, and tax credits. Missing for 10: any mention of audit logs, change tracking, user attribution, or timestamped edit history across the ledger.

   ⚑ flag

Multi entity

1. accountantManage multiple legal entities and produce consolidated financials across them

   weight 2 · round to Pilot
   QuickBooks Online—none0/10

   No evidence pack item mentions multi-entity management, inter-company eliminations, or consolidated financial reporting across separate legal entities; QuickBooks Online appears architected as single-company-per-subscription (Advanced tier only mentions up to 25 users, not multi-entity consolidation). Community notes even flag missing desktop features vs QBO, reinforcing the gap. missing for 10: any mention of multi-entity/subsidiary management, consolidated reporting across companies, or inter-entity eliminations.

   • [claimed-docs] “Grow confidently with custom access for up to 25 users, Priority Circle expert support, and backup and restore to undo mistakes instantly an…”
   • [claimed-docs] “Get 13-week cash flow and P&L forecasting powered by historical data. Compare forecast vs. actual data, share inputs in real time”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot's FAQ mentions it can provide consolidated reporting for US entities with foreign subsidiaries, but there is no evidence of multi-entity management for domestic entities, no detail on consolidation methodology, and no independent/hands-on corroboration of this feature. missing for 10: multi-entity dashboard/management capability, domestic multi-entity consolidation support, detailed consolidation workflow, independent verification.

   • [claimed-docs] “We can also provide US entities with foreign subsidiaries with consolidated reporting.”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialprobed6/10

   Intuit's official API/SDKs and the official QuickBooks Online MCP server (145 tools, full CRUD for 29 entity types, 11 financial reports) show broad, deliberate API coverage of core accounting objects, and sandbox/production + write-safety toggles indicate agent-friendly design (quickbooks-gh-3, quickbooks-gh-4, quickbooks-gh-6, quickbooks-supp-mcp-sandbox). However, there's no evidence that UI-specific features like GPS mileage capture, invoice template customization, bank-feed matching UX, or the Intuit Intelligence chat assistant itself are exposed via the API, and OpenAPI/llms.txt discovery probes 404'd, suggesting incomplete self-describing API docs. Missing for 10: confirmation that non-core UI features (mileage, invoice branding, AI chat actions) are API-reachable, and a first-party OpenAPI spec or llms.txt for full discoverability.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of any public API for Pilot; probes for OpenAPI/swagger endpoints all returned 404, and all documentation describes only the human portal/UI and service offerings. missing for 10: any documented API, API parity claims, or developer endpoints.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialprobed3/10

   There is no documented native 'export all data' feature in open formats (like a full CSV/Excel/QBO-file export) in the evidence pack, but the presence of REST APIs, SDKs, and an official MCP server with full CRUD access to 29 entity types and 11 financial reports (quickbooks-gh-3, quickbooks-gh-4, quickbooks-gh-5) suggests a technical path for an AI-native user to programmatically pull out their data via API. Missing for 10: an explicit bulk data export tool, documented file formats (CSV/JSON/XML) for full account export, and any first-party 'migrate out' or backup-to-open-standard feature.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot—none0/10

   While Pilot mentions QuickBooks compatibility and tax-preparer portability, there is no evidence of a dedicated data export feature, open-format export (CSV/JSON/API), or a documented process to fully extract and leave with all financial data; probes even show no public API/OpenAPI spec.

   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   QuickBooks Online—none0/10

   No evidence in the pack addresses data residency, regional data storage options, or data locality controls for QuickBooks Online; the evidence covers features like invoicing, reconciliation, integrations, and MCP tooling but nothing about where customer data is physically stored or user choice over data region.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack addresses data residency, region selection, or storage location controls; Pilot is an accounting/bookkeeping service with no mention of infrastructure or data-residency options. Missing for 10: any documentation of data storage regions, residency guarantees, or configurable data location.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   QuickBooks Online—none0/10

   No evidence in the pack addresses AI training data opt-out or data-usage controls for AI model training; QuickBooks docs focus on bookkeeping, invoicing, integrations, and MCP/API tooling but never mention privacy controls over AI training use of customer data.

   ⚑ flag

   Pilot—none0/10

   Pilot is an accounting/bookkeeping service; the evidence pack contains no privacy policy statements, opt-out controls, or AI-training data usage terms addressing whether customer financial data is used to train AI models. This is a fair question given Pilot advertises 'AI answers' features, but no evidence confirms any data-training opt-out or exclusion mechanism. Missing for 10: privacy policy/ToS language on AI training data usage, an opt-out mechanism, or any statement on data handling for AI features.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence shows CRUD 'Delete' operations exist for business records via API/SDK and MCP write-toggles, but nothing addresses account-level data retention policies, AI training data deletion, or privacy-oriented data lifecycle controls that an AI-native user would need to manage. No documentation on retention periods, deletion of AI-processed data, or privacy dashboard controls is present.

   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy settings for Pilot's AI features or data; the pack only covers accounting, bookkeeping, and tax service offerings. Missing for 10: any documentation of data retention/deletion controls, privacy settings, or data handling policies for AI or customer data.

   ⚑ flag

Ai insights

1. ai-native userAsk an agent "can we afford X?" and get an answer grounded in live ledger data pulled through the API

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialprobed6/10

   QuickBooks has an official MCP server exposing 145 tools with full CRUD across 29 entities and 11 financial reports (Balance Sheet, P&L, Cash Flow), which could ground an agent's answer to affordability questions in live ledger data, and Intuit Intelligence chat markets natural-language Q&A like 'What's driving my profit?'. However, there's no first-party documentation showing an agent actually reasoning through a cash-flow/affordability question end-to-end, and probes show no public OpenAPI/llms.txt discoverability layer, and no independent/hands-on evidence confirms real-time accuracy of agent-grounded answers. missing for 10: a documented example of an agent answering an affordability-style question using live API data, public OpenAPI/llms.txt for easy agent discovery, and independent verification that answers are accurately grounded rather than hallucinated.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Pilot~partialprobed4/10

   Pilot advertises an in-app AI feature offering 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' which aligns with the 'can we afford X' query use case, but there is no evidence this is exposed via an API for external agents to query — the openapi probe returned 404s and no API/agent-integration docs exist. missing for 10: evidence of a public API/endpoint an external AI agent could call, documentation of grounding in live ledger data via API, and any independent confirmation the AI answer feature works as described.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Model cash flow scenarios Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Know if you can afford new hires well before you make the offers.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

Custom reports

1. accountantBuild custom reports filtered and grouped by class, location, or tag dimensions

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack contains no mention of class, location, or tag tracking, nor of custom report building filtered/grouped by these dimensions — only generic mentions of custom roles/access, invoicing, and integrations. One community note even claims QBO lacks many reports found in desktop QuickBooks, but nothing confirms or denies this specific capability.

   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence only mentions generic 'custom workflows and reporting' (pilot-docs-10) with no mention of class, location, or tag dimension filtering/grouping capabilities typical of QuickBooks-style reports; missing for 10: any documentation of dimension-based (class/location/tag) filtering or grouping in reports.

   • [claimed-docs] “Custom workflows and reporting”

   proof ↗⚑ flag

Statements

1. founderGenerate an accurate P&L, balance sheet, and cash-flow statement for any period on demand

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullcommunity7/10

   The official QuickBooks Online MCP server explicitly lists '11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more' with full API coverage, and QBO Advanced marketing cites 13-week cash-flow/P&L forecasting and instant on-demand reporting via Intuit Intelligence chat. This confirms the three core statements are generatable on demand for any period. Missing for 10: a dedicated first-party reports-center walkthrough showing period selection UI, and independent hands-on verification of statement accuracy (community feedback notes QBO is 'not feature complete' vs desktop for some reports).

   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [claimed-docs] “Get 13-week cash flow and P&L forecasting powered by historical data. Compare forecast vs. actual data, share inputs in real time”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “I chose QuickBooks Online Advanced, because I have the real-time data at my fingertips, and I'm able to easily forecast what the next three …”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Pilot~partialcommunity5/10

   Pilot's bookkeeping and CFO service pages reference real-time account data, custom workflows/reporting, and budget-vs-actuals/scenario planning, implying standard financial statements are produced as part of monthly bookkeeping, and community reviews confirm books are kept accurate and up to date. However, no evidence explicitly confirms generation of a P&L, balance sheet, and cash-flow statement for any arbitrary period on demand. Missing for 10: explicit documentation of the three core statements, confirmation of on-demand/any-period generation (vs. standard monthly close), and independent verification of statement accuracy/timeliness.

   • [claimed-docs] “Custom workflows and reporting”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Custom financial model with strategic insights Budget vs actuals variance analysis Scenario planning model”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”
   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [community] “Pilot customer here; they are amazing. It's pretty different from a regular bookkeeper largely in that Pilot is super accurate and timely. M…”

   proof ↗⚑ flag