QuickBooks Online vs Bench

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialprobed4/10

   llms.txt explicitly returns 404 (no dedicated agent-readable docs file), and no OpenAPI spec was found at standard locations either. However, Intuit does document an official MCP server for QuickBooks Online (developer.intuit.com/.../mcp and a GitHub repo with 145 tools/29 entities), which constitutes agent-oriented documentation an AI agent could be pointed at instead of llms.txt. Missing for 10: an actual llms.txt or equivalent single agent-readable manifest, and independent confirmation the MCP docs page is comprehensive/discoverable rather than a niche developer page.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping service, not a dev tool/platform, but the axis still applies since any web product could publish agent-oriented docs; probes explicitly show llms.txt returns 404, docs-as-markdown 404, and no OpenAPI spec found. There is no evidence of any agent-oriented documentation surface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   QuickBooks Online exposes a REST API with official OAuth SDKs (Node.js, PHP) and an official MCP server with 145 tools covering CRUD across 29 entities and 11 reports, all of which can be scripted/automated without a UI — and a sandbox environment plus write-safety toggles (QUICKBOOKS_DISABLE_WRITE/UPDATE) support automated, non-interactive testing akin to CI use. However, there is no explicit documentation of a CLI, CI pipeline integration, or headless-run instructions/examples specifically for automation pipelines. Missing for 10: explicit CI/pipeline documentation or examples, a dedicated CLI for scripted automation, and independent evidence of successful headless/CI usage in practice.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

3. ai-native userConnect an agent via an official MCP server

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   Intuit publishes an official MCP server (github.com/intuit/quickbooks-online-mcp-server) with 145 tools covering 29 entity types and 11 financial reports, full CRUD, sandbox/production environment switching, and write-safety toggles for scoping agent actions, and Intuit's developer docs also list the MCP server under official docs. Missing for 10: independent/community hands-on validation of the MCP server itself (only vendor/GitHub-authored evidence) and clearer production-readiness signals (e.g., versioning/maturity status).

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

4. ai-native userDrive the product through a documented public API

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   QuickBooks Online exposes a documented public REST API with official OAuth2 SDKs (Node.js, PHP) supporting full CRUD across many entity types, plus a sandbox environment for safe integration testing, and an official MCP server with 145 tools covering 29 entities and 11 reports for agentic access. Probes show no discoverable llms.txt or OpenAPI spec at expected paths, and no independent third-party corroboration of API robustness beyond vendor docs. missing for 10: publicly discoverable OpenAPI/llms.txt spec, independent developer reviews of the API's completeness/reliability.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “QuickBooks Fault object parsing for detailed validation errors”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “OAuth 2.0 authentication flow”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/accounting service with no evidence of a documented public API; direct probes for llms.txt, docs.md, and OpenAPI/swagger endpoints all returned 404, and no docs mention an API for AI-native integration.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

5. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   Intuit's official MCP server exposes environment variables (QUICKBOOKS_DISABLE_WRITE, QUICKBOOKS_DISABLE_UPDATE) and lets you restrict which tool categories are registered, and the OAuth client supports a sandbox/production split—giving some coarse-grained, least-privilege-style control over what an agent can do. However this is app-level config rather than true per-agent scoped OAuth credentials/roles, and there's no documented fine-grained scope system (e.g., read-only vs specific entity scopes) issued per credential. Missing for 10: granular OAuth scope definitions, role-based API key issuance per agent, and independent confirmation these toggles are enforced server-side rather than just client config.

   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

6. ai-native userBuild against official SDKs

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   Intuit maintains official SDKs (oauth-jsclient for Node.js, QuickBooks-V3-PHP-SDK for PHP) with documented OAuth flows, CRUD examples, and sandbox/production environment switches for safe development, plus an official MCP server exposing 145 tools across 29 entity types and 11 financial reports with write-safety toggles — directly enabling AI-native/agentic development against QuickBooks Online. missing for 10: no discoverable OpenAPI/swagger spec or llms.txt (both probed 404), and no independent developer corroboration of SDK/MCP quality beyond first-party docs.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “QuickBooks Fault object parsing for detailed validation errors”
   • [claimed-docs] “OAuth 2.0 authentication flow”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [claimed-docs] “OAuth 2.0 authentication flow - Token management and refresh”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/tax service with no evidence of any public SDK, API, or developer library; probes for llms.txt, docs-md, and OpenAPI specs all returned 404. Missing for 10: any official SDK, API documentation, or developer integration surface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

7. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack contains no mention of webhooks, event subscriptions, or push notifications anywhere in QuickBooks' docs, GitHub SDKs, or MCP server materials — only OAuth clients, REST CRUD operations, and polling-style API access are documented. Webhook subscription is a plausible capability for an API-driven accounting platform, but no evidence shows QuickBooks Online supports it.

   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Bench—none0/10

   No evidence of any webhook subscription mechanism, API, or event system; probes for llms.txt, docs-md, and OpenAPI specs all return 404, and Bench is a human-plus-software bookkeeping service with no developer/webhook offering documented.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed8/10

   QuickBooks documents Intuit Intelligence/AI features that generate insights directly from user data: an AI chat that answers questions like "What's driving my profit?" and "How are my invoices doing this month?", instant reports on top expenses/sales trends/industry benchmarking, AI-driven anomaly resolution and tax savings estimation, and Payroll AI that spots inconsistencies proactively. These are first-party vendor claims without independent hands-on corroboration. Missing for 10: independent/community validation that these AI insights work as described, and detail on accuracy/reliability of the suggestions.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”
   • [claimed-docs] “See funding options based on your real-time financials, understand what affects your approval odds for a QuickBooks Term Loan or QuickBooks …”

   proof ↗⚑ flag

   Bench—none0/10

   Bench's evidence describes automation (data entry, categorization) and human bookkeeper support, but nothing describes AI-generated insights, recommendations, or suggestions surfaced to the user from their data — 'smart automation' refers to categorization mechanics, not generative analysis or advisory insights. Missing for 10: any mention of AI-generated commentary, anomaly detection, forecasting, or proactive suggestions derived from financial data.

   • [claimed-docs] “Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialcommunity6/10

   QuickBooks ships several rule-based automations (bank-rule categorization, automated payment reminders, automatic bank-feed import, automatic reconciliation reports) and Intuit Intelligence/Payroll AI that proactively monitor data and flag issues, plus an official MCP server exposing 145 tools across 29 entities and financial reports for agent-driven access with sandbox and write-safety toggles. However, these are mostly triggered rules or on-demand AI chat interactions rather than a documented capability for a user to configure agents that run continuously/autonomously in the background without external orchestration; the MCP server itself is a tool interface for agents built by developers, not a built-in scheduler. missing for 10: native scheduling/trigger builder for persistent background automations, evidence of fully autonomous unattended agent runs, independent corroboration of agentic automation reliability.

   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”
   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed7/10

   QuickBooks has a built-in AI assistant ("Intuit Intelligence") that users can chat with to create invoices, resolve anomalies, run payroll, generate reports, and get instant contextual answers — a direct in-product delegation experience, not a separate tool. missing for 10: independent/hands-on verification of the assistant's reliability and scope beyond vendor marketing copy.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”

   proof ↗⚑ flag

   Bench—none0/10

   Bench offers human bookkeepers plus automation for data entry and categorization, but there is no evidence of a built-in AI assistant that a user can delegate tasks to conversationally — communication is described as messaging with a human team, not an AI agent. Missing for 10: any mention of an AI assistant/chat feature, agentic task delegation, or AI-driven interaction surface within the product.

   • [claimed-docs] “Effortless messaging with your Bench team for unlimited support or advice, anytime, anywhere”
   • [claimed-docs] “Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed6/10

   QuickBooks offers 'Intuit Intelligence' chat where users can issue natural-language commands to create invoices, run payroll, generate reports, and get answers to questions like 'What's driving my profit?' — this directly supports natural-language operation. However, this is a limited chat assistant layered on top of the core UI rather than full natural-language control of all product functions, and there's no independent/hands-on evidence corroborating its reliability or scope beyond vendor claims. Missing for 10: independent verification of the chat's command coverage/reliability, evidence of natural-language control beyond the listed use cases, and hands-on user reports confirming it works as described.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”

   proof ↗⚑ flag

   Bench—none0/10

   Bench offers human-support messaging and a client dashboard, but there is no evidence of a natural-language command interface (chat-driven actions, NL query of financial data, etc.); probes for llms.txt, docs-md, and OpenAPI all 404, indicating no AI-native interface layer. missing for 10: any natural-language command/chat-to-action capability, NL query support, or API/agent interface evidence.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”
   • [claimed-docs] “Effortless messaging with your Bench team for unlimited support or advice, anytime, anywhere”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence includes only static SDK README code snippets (PHP/Node OAuth examples) and explicit probes showing the developer site lacks an interactive OpenAPI/Swagger explorer (openapi.json 404) and no llms.txt, with no mention of a live, runnable API explorer or sandbox console. missing for 10: interactive browser-based API reference, runnable request/response console, discoverable OpenAPI spec.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/accounting service with no API, no interactive API reference, and no runnable examples; probes for llms.txt, docs.md, and OpenAPI specs all returned 404. missing for 10: any API reference, interactive docs, runnable code examples.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Direct probes for an OpenAPI/swagger spec on Intuit's developer domain returned 404s at all standard locations, and no other evidence shows a downloadable machine-readable API spec; the MCP server and SDKs (Node/PHP) are wrapper tools, not an OpenAPI spec itself.

   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [github] “A Node.js client for Intuit's OAuth 2.0 implementation.”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”

   proof ↗⚑ flag

   Bench—none0/10

   Probes explicitly show llms.txt, docs.md, and all openapi/swagger candidate paths return 404, and no docs mention any API spec; Bench is a bookkeeping service with no evidence of a machine-readable API for AI agents.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

3. ai-native userTest against a sandbox environment without touching production data

   weight 1 · round to QuickBooks Online
   QuickBooks Online✓fullprobed8/10

   Intuit's official OAuth client and MCP server docs explicitly document a sandbox/production environment split, with sandbox using isolated company data and localhost redirect URIs, plus write-safety toggles for agent scoping. This directly supports AI-native testing against sandbox without touching production. Missing for 10: independent/hands-on confirmation of sandbox parity with production and no evidence of persistent sandbox data limitations or resets.

   • [claimed-docs] “Intuit's official OAuth client documents a first-class sandbox environment: the client is constructed with "environment: 'sandbox', // or 'p…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [github] “restrict which tool categories are registered (default: all enabled)”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

4. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence shows QuickBooks has a versioned REST API (V3 SDK, OAuth client) and even an official MCP server, but nothing in the pack documents a deprecation policy, versioning cadence, or sunset timeline for API versions; probes for openapi/llms.txt docs both 404, suggesting no discoverable machine-readable API reference either. Missing for 10: explicit deprecation policy documentation, version lifecycle/support windows, and any changelog or sunset notice practice.

   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/tax service with no evidence of a public API at all — probes for OpenAPI specs, docs, and llms.txt all returned 404. No mention of versioning or a deprecation policy anywhere in the evidence pack. Missing for 10: any public API, version numbers, changelog, or deprecation policy documentation.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence shows QuickBooks Online supports per-entity CRUD via API/MCP server (29 entity types, 11 reports) and vague mentions of 'syncing data in spreadsheets' for Advanced tier, but nowhere is a genuine bulk/batch operation (e.g., a batch API endpoint or agent tool for acting on many records in one call) documented. Missing for 10: explicit bulk/batch API documentation, MCP tool for multi-item operations, or hands-on evidence of processing many items in a single automated action.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “QuickBooks Online Advanced can sync data in spreadsheets to reduce your manual work.”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a human-plus-software bookkeeping service focused on categorization, reporting, and tax filing for individual accounts; no evidence describes any bulk/batch operation capability across many items (e.g., bulk transaction edits, bulk uploads, batch API operations) for AI-native or power users. Probes also show no API/docs surface for programmatic bulk actions.

   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialcommunity5/10

   QuickBooks Online ships built-in 'bank rules' for automatic transaction categorization (confirmed independently in community discussion), plus automated payment reminders and auto-generated reconciliation reports, and docs mention custom workflows/roles as an Advanced feature — all of which are rule-based, event-triggered actions. However, these are narrow, product-specific automations (categorization, reminders, reconciliation) rather than a general-purpose, user-definable rules/triggers engine that an AI-native user could configure to fire arbitrary actions on arbitrary events; the MCP server exposes CRUD tools but no explicit rule-trigger framework. Missing for 10: a generalized event-condition-action rule builder, evidence of AI/MCP-driven custom automation creation, and independent hands-on confirmation of workflow automation beyond categorization.

   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”
   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/accounting service with backend automation for categorization and reminders, but there is no evidence of a user-facing rule engine where AI-native users can define custom triggers/actions on events; the automation described is fixed internal workflow, not configurable rules.

   ⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack details QuickBooks' MCP server (145 tools, CRUD across 29 entities, sandbox/production split, write-safety toggles) but nowhere describes a mechanism for scheduling recurring jobs or workflows via API/MCP—no cron-like triggers, recurring-transaction API, or workflow scheduler for AI agents is documented. Mentions of 'automated payment reminders' or automatic bank imports are built-in consumer features, not an AI-native scheduling/automation primitive exposed to agents.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [claimed-docs] “Avoid late payments with automated payment reminders.”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

Ai reconciliation

1. ai-native userHave an agent reconcile a month end-to-end, matching transactions, flagging exceptions, and preparing the close for human review

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   QuickBooks ships real building blocks an agent could use—bank-feed transaction matching and reconciliation reports (quickbooks-docs-6/7/8/9), an official MCP server exposing 29 entity types, 11 financial reports, and full CRUD for agent integrations (quickbooks-gh-3/4/5/6/7), plus an 'Intuit Intelligence' chat that claims to 'help resolve anomalies' (quickbooks-docs-19). However, there is no documented tool or workflow that performs the reconciliation itself autonomously, flags exceptions, and packages a close for human review as one orchestrated task; reconciliation is presented as a human-driven feature ('Reconcile bank statements in minutes') and the MCP server's docs list generic CRUD/report access rather than a reconcile-specific or exception-flagging capability. Missing for 10: an explicit agent-driven reconciliation/close workflow tool, documented exception-flagging logic, and evidence of an agent actually completing an end-to-end month-end close.

   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”

   proof ↗⚑ flag

   Bench—none0/10

   Bench's evidence describes automated data entry/categorization plus human bookkeepers preparing reports, not an autonomous agent that reconciles a month end-to-end, flags exceptions, and stages a close for human review. No documentation of exception-flagging logic, agent-driven reconciliation workflow, or AI-native interface exists in the pack. Missing for 10: evidence of automated exception detection, an agentic reconciliation workflow, and any API/agent interface for month-end close.

   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

Bank feeds

1. founderConnect bank and credit-card accounts so transactions import automatically every day

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullcommunity8/10

   QuickBooks docs directly state bank/credit-card/PayPal/Square connections auto-import transactions daily, plus existing rule-based categorization is corroborated by a community comment, and reconciliation reports confirm ongoing automated matching. Missing for 10: independent hands-on verification of daily-sync reliability and no direct evidence addressing sync frequency/outage issues raised in community comments about QBO reliability.

   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”

   proof ↗⚑ flag

   Bench✓fullclaimed7/10

   Bench's docs explicitly describe connecting all financial accounts to automate daily data entry and transaction categorization, which directly matches the story of automatic daily import via connected bank/credit card accounts. Missing for 10: no independent/hands-on corroboration of connection reliability, no detail on supported bank list or sync frequency specifics beyond marketing copy.

   • [claimed-docs] “Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”

   proof ↗⚑ flag

Categorization

1. founderGet automatic categorization suggestions for imported transactions that learn from my corrections

   weight 2 · round drawn
   QuickBooks Online~partialcommunity4/10

   QuickBooks docs mention auto-sorting expenses (quickbooks-docs-28) and community evidence confirms built-in automatic categorization rules (quickbooks-comm-3), but neither source explicitly describes a machine-learning mechanism that adapts based on the founder's manual corrections. Missing for 10: explicit documentation of ML-based re-categorization suggestions, first-party confirmation that the system improves from user corrections, and independent hands-on validation of this adaptive behavior.

   • [claimed-docs] “Automatically sort expenses to stay ready for tax time”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”

   proof ↗⚑ flag

   Bench~partialclaimed4/10

   Bench documents automated, 'smart automation' transaction categorization with 'instant guidance' (bench-docs-4, bench-supp-automation), which covers the core categorization-suggestion capability, but since Bench is a human-plus-software bookkeeping service, human bookkeepers—not the software—typically apply corrections, and there is no evidence describing a feedback loop where the system learns from founder corrections. Missing for 10: any documentation of a correction-learning mechanism, founder-facing feedback UI, or improvement in suggestion accuracy over time.

   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

Reconciliation

1. accountantReconcile each bank account against the ledger with matched, unmatched, and duplicate transactions surfaced for review

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed7/10

   QuickBooks Online docs explicitly describe connecting bank/credit-card feeds, automatic transaction import and matching, a reconciliation workflow, an auto-generated reconciliation report, and discrepancy-focused reports (Reconciliation Discrepancy Report, Missing Checks Report, Transaction Detail Report) that help surface unmatched/duplicate items for review, directly matching the accountant story. Missing for 10: explicit documentation of a distinct 'duplicate transaction' flag/UI and independent hands-on verification of the reconciliation workflow's accuracy (community evidence is generic and not reconciliation-specific).

   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “When customers pay through QuickBooks invoices, we’ll record and match it for you.”

   proof ↗⚑ flag

   Bench—none0/10

   Bench's evidence covers account connection, automated categorization, and reporting, but no citation describes a reconciliation workflow that surfaces matched, unmatched, and duplicate transactions for accountant review. missing for 10: explicit reconciliation UI/workflow, matched/unmatched transaction views, duplicate detection and review surface.

   • [claimed-docs] “Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Bill management

1. accountantCapture vendor bills, route them for approval, and schedule payments from one workflow

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack covers invoicing, A/R, bank reconciliation, and generic 'custom roles/workflows' language, but contains no documentation of vendor bill capture, bill approval routing, or scheduled bill payments — the core AP workflow described in the story. Missing for 10: bill capture/entry feature, approval workflow for bills, scheduled/bill-pay payment functionality, any hands-on or docs evidence of an AP module.

   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/tax service focused on categorization, reporting, and human bookkeeper support; no evidence of bill capture (AP inbox/OCR), approval routing, or scheduled bill payment workflows anywhere in the docs, pricing, or banking pages.

   • [claimed-docs] “Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “"Banking by Mainstreet — Get dedicated business accounts, debit cards, and automated financial management tools that integrate seamlessly wi…”
   • [claimed-docs] “Published service pricing: Bookkeeping Grow from $199/month ("An accessible, lighter-touch plan—built for lean businesses seeking financial …”

   proof ↗⚑ flag

Payables

1. accountantSee accounts payable aging and vendor balances at any point in time

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack documents an A/R aging report and accounts-receivable tracking (quickbooks-docs-18, quickbooks-docs-37) but contains no mention of an accounts payable aging report or vendor balance reporting; the MCP server's financial reports list (Balance Sheet, P&L, Cash Flow) does not name AP aging either.

   ⚑ flag

   Bench—none0/10

   Bench's evidence covers bookkeeping automation, categorization, income statement/balance sheet reporting, banking and tax prep, but nowhere mentions accounts payable aging, vendor balances, or bill-tracking reports at a point in time. Bench appears to focus on income statement/balance sheet reporting rather than AP-specific aging reports.

   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”

   proof ↗⚑ flag

Close process

1. accountantLock closed periods so prior-period numbers cannot change without an explicit reopening

   weight 2 · round drawn
   QuickBooks Online—none0/10

   No evidence pack item mentions closing periods, closing dates, or locking prior-period transactions from edits — QuickBooks Online does have a known 'closing date' feature in general knowledge, but nothing in this evidence pack documents it, so per the rules absence of evidence must be judged 'none'.

   ⚑ flag

   Bench—none0/10

   No evidence describes period locking, close controls, or reopening workflows; Bench is presented as a human-plus-software bookkeeping service with reporting/downloads, not a ledger system with period-lock controls exposed to the accountant/customer. missing for 10: any mention of period closing, locking prior periods, or explicit reopening controls.

   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”

   proof ↗⚑ flag

2. accountantRun a month-end close against a checklist that tracks reconciliations, accruals, and review sign-offs

   weight 3 · round drawn
   QuickBooks Online—none0/10

   Evidence shows QuickBooks Online offers bank reconciliation tools, reconciliation reports, and accountant access, but there is no evidence of a dedicated month-end close checklist that tracks reconciliations, accruals, and review sign-offs as an integrated workflow. Community evidence even notes QBO lacks feature parity with desktop, and no close-management or sign-off workflow is documented.

   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “When you finish reconciling accounts, QuickBooks automatically generates a reconciliation report.”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “Give your accountant direct access to your books so she can find the reports and information she needs when questions arise.”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Bench—none0/10

   Bench markets itself as a done-for-you bookkeeping/tax service with messaging, document upload, categorization, and real-time reports, but nothing in the evidence describes a month-end close checklist tracking reconciliations, accruals, or review sign-offs — only generic 'timely reminders' are mentioned, which is not the same as a structured close workflow.

   • [claimed-docs] “Get timely reminders to stay on top of your financial tasks and deadlines”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Collaboration

1. founderInvite my external accountant or bookkeeper with role-scoped access to review and adjust the books

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed6/10

   QuickBooks explicitly markets giving accountants direct access to books and custom role-based access controls (up to 25 users on Advanced), which directly supports inviting an external accountant with scoped permissions. However, evidence lacks specifics on how granular the role-scoping is for an accountant-specific invite (e.g., accountant-only view vs. full custom roles) or independent confirmation of this workflow in practice. Missing for 10: detailed documentation of accountant-specific invite flow and role granularity, and independent/hands-on corroboration of the accountant access experience.

   • [claimed-docs] “Give your accountant direct access to your books so she can find the reports and information she needs when questions arise.”
   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”
   • [claimed-docs] “Grow confidently with custom access for up to 25 users, Priority Circle expert support, and backup and restore to undo mistakes instantly an…”
   • [claimed-docs] “Move your whole firm to Intuit Accountant Suite—no data migration, no switching costs, no starting over.”

   proof ↗⚑ flag

   Bench—none0/10

   Bench's evidence describes a done-for-you bookkeeping service where Bench's own staff manage the books and communicate with the founder, with no mention of inviting an external accountant/bookkeeper as a role-scoped collaborator with adjustable permissions inside a shared ledger. The 'Add a bookkeeper to your team' claim refers to Bench's own hire-a-bookkeeper offering working inside the founder's existing systems, not the founder granting scoped access to their own outside accountant.

   • [claimed-docs] “Add a bookkeeper to your team who works with your existing systems”
   • [claimed-docs] “Published service pricing: Bookkeeping Grow from $199/month ("An accessible, lighter-touch plan—built for lean businesses seeking financial …”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

Data access

1. developerPull the full general ledger and trial balance through a documented API in open formats

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialprobed5/10

   QuickBooks Online exposes a REST API (V3) with SDKs (PHP, Node OAuth client) and an MCP server covering 29 entity types and 11 financial reports including Balance Sheet, P&L, and Cash Flow, which implies GL/trial-balance-like data can be retrieved programmatically. However, there is no direct evidence of a documented endpoint explicitly returning a full general ledger or trial balance report, nor confirmation of open/standard export formats (e.g., CSV/JSON schema for GL); OpenAPI/llms.txt probes returned 404s, reducing discoverability of a formal spec. missing for 10: explicit trial balance/GL report endpoint documentation, confirmed open-format (CSV/JSON) export schema, publicly accessible OpenAPI spec.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “PHP client for connecting to the QuickBooks Online V3 REST API.”
   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   Bench only offers report viewing/downloads (income statement, balance sheet) via its web app; there is no documented API, no OpenAPI/Swagger spec, and probes for llms.txt, markdown docs, and OpenAPI endpoints all returned 404s, so developers have no documented way to pull the GL or trial balance in open formats.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Integrations

1. founderConnect my banking, payments, and payroll systems so their activity flows into the ledger automatically

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullcommunity8/10

   QuickBooks Online documents direct bank/credit card/PayPal/Square connections with automatic transaction import and matching, plus payments and payroll AI automation (time/attendance data flowing into payroll), and an 800+ app integration ecosystem including PayPal/Square/Shopify connectors. Community evidence confirms rule-based auto-categorization works in practice, corroborating the automated ledger flow. Missing for 10: independent hands-on verification of payroll-to-ledger automation specifically and no direct evidence of setup friction/reliability for these bank feeds beyond general reliability complaints unrelated to this axis.

   • [claimed-docs] “Connect QuickBooks to your bank, credit cards, PayPal, Square, and more1 and we’ll import your transactions for you.”
   • [claimed-docs] “Reconcile bank statements in minutes with QuickBooks.”
   • [claimed-docs] “When customers pay through QuickBooks invoices, we’ll record and match it for you.”
   • [claimed-docs] “Import all your PayPal transactions into QuickBooks Online”
   • [claimed-docs] “PayPal Connector by QuickBooks”
   • [claimed-docs] “Square Connector by QuickBooks”
   • [claimed-docs] “QuickBooks integrates with over 800 popular business apps.”
   • [claimed-docs] “Payroll AI proactively collects time and attendance data from your employees, spots inconsistencies, and texts your admin updates—so you can…”
   • [community] “"For the obvious ones, I already have automatic rules build right into QuickBooks Online." - noting existing rule-based transaction categori…”

   proof ↗⚑ flag

   Bench~partialclaimed6/10

   Bench's docs claim customers can 'connect all your financial accounts to automate data entry' and offers integrated banking (Banking by Bench/Mainstreet), which supports bank/payment account linking flowing into bookkeeping. However, payroll integration is never explicitly mentioned, and the ledger itself is not customer-facing/editable — it's a human-plus-software service producing reports rather than a live self-serve ledger. missing for 10: explicit payroll system integration, technical detail on connection breadth (which banks/payment processors), independent/hands-on confirmation of automated data flow reliability.

   • [claimed-docs] “Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “Get dedicated business accounts, debit cards, and automated financial management tools that integrate seamlessly with your bookkeeping opera…”
   • [claimed-docs] “"Banking by Mainstreet — Get dedicated business accounts, debit cards, and automated financial management tools that integrate seamlessly wi…”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Migration

1. founderMigrate historical books from another accounting system without losing transaction detail

   weight 1 · round to Bench
   QuickBooks Online—none0/10

   No evidence describes any migration/import tooling for bringing historical transaction-level data from another accounting system into QuickBooks Online; the only migration-adjacent item (quickbooks-docs-27) refers to moving firms between Intuit's own products, not importing from competitors, and community evidence even notes QBO lacks feature parity with desktop QuickBooks. Missing for 10: any documented data-migration/import wizard, third-party system conversion tool, or evidence that transaction-level detail is preserved when switching from another platform.

   • [claimed-docs] “Move your whole firm to Intuit Accountant Suite—no data migration, no switching costs, no starting over.”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Bench~partialclaimed5/10

   Bench explicitly offers 'Catch Up Bookkeeping' for businesses behind on their books, implying it can reconstruct/backfill historical transaction data, and its human-bookkeeper model suggests manual handling of past records. However, there is no explicit documentation of migrating data from another accounting system (e.g., QuickBooks, Xero) with transaction-level fidelity preserved, no import tooling, and no evidence addressing loss/retention of transaction detail during migration. Missing for 10: explicit migration/import process from other platforms, evidence of transaction-level data preservation, any tooling or API for historical data transfer.

   • [claimed-docs] “Catch up bookkeeping services for small businesses, no matter how far behind they are”
   • [claimed-docs] “Add a bookkeeper to your team who works with your existing systems”
   • [claimed-docs] “The buying motion is demo-led for service fit: "Book a demo with our friendly team of experts. Not sure where to start or which accounting s…”

   proof ↗⚑ flag

Invoicing

1. founderCreate and send invoices with online payment options and see when they are viewed and paid

   weight 3 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed9/10

   Docs directly cover invoice creation (templates/logo), online payment button on invoices, view/paid tracking, and automated reminders — matching every element of the story. Missing for 10: independent/hands-on corroboration beyond vendor docs.

   • [claimed-docs] “Your invoices reflect your business. With our free invoice templates, add your logo and colors and create tailored professional invoices wit…”
   • [claimed-docs] “Send your invoice, know exactly when it’s viewed, and get notified when it’s paid.”
   • [claimed-docs] “Enable online payments to add a button to invoices for your customers to pay instantly online.”
   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “Get paid 4 days faster on average when you send invoice reminders with your Payments AI.”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

2. founderSet up recurring invoices and automatic payment reminders for overdue customers

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialclaimed6/10

   Automatic payment reminders for overdue customers are well documented (statement reminders, automated payment reminders, faster payment via reminders), but the evidence pack never explicitly describes a recurring/repeating invoice setup feature. Missing for 10: explicit documentation of recurring invoice scheduling/templates, and independent confirmation that reminders/recurring invoices work reliably in practice.

   • [claimed-docs] “Avoid late payments with automated payment reminders.”
   • [claimed-docs] “In just a few clicks you can send statement reminders to customers that are late paying you.”
   • [claimed-docs] “Get paid 4 days faster on average when you send invoice reminders with your Payments AI.”
   • [claimed-docs] “QuickBooks helps you manage accounts receivable by tracking invoices, payments, and identifying your delinquent accounts.”
   • [claimed-docs] “QuickBooks makes it easy to run the A/R aging report to see which customers are late with their payments”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/tax service focused on categorization, reporting, and tax filing; there is no mention of invoicing, accounts receivable, recurring invoices, or customer payment reminders anywhere in the evidence pack.

   ⚑ flag

Receivables

1. accountantTrack accounts receivable with aging reports and per-customer balances

   weight 2 · round to QuickBooks Online
   QuickBooks Online✓fullclaimed8/10

   QuickBooks docs explicitly describe A/R aging reports ('run the A/R aging report to see which customers are late with their payments') and per-customer tracking of invoices, payments, and delinquent accounts, plus statement reminders for late-paying customers. Missing for 10: independent/hands-on corroboration of the aging report's accuracy or depth, and no sample screenshot/detail on per-customer balance breakdown beyond marketing copy.

   • [claimed-docs] “QuickBooks makes it easy to run the A/R aging report to see which customers are late with their payments”
   • [claimed-docs] “QuickBooks helps you manage accounts receivable by tracking invoices, payments, and identifying your delinquent accounts.”
   • [claimed-docs] “In just a few clicks you can send statement reminders to customers that are late paying you.”
   • [claimed-docs] “Enable online payments to add a button to invoices for your customers to pay instantly online.”

   proof ↗⚑ flag

   Bench—none0/10

   Bench's evidence covers reporting (income statement, balance sheet), categorization, and banking, but there is no mention of accounts receivable aging reports or per-customer balance tracking anywhere in the docs or probes. Missing for 10: any AR aging report feature, per-customer balance tracking, invoicing/AR module documentation.

   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Ai ledger

1. ai-native userHave an agent draft and post journal entries via the API and leave them in a review queue for my accountant

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed4/10

   QuickBooks does expose journal-entry CRUD via its official API/MCP server (29 entity types with full CRUD and write-safety toggles like QUICKBOOKS_DISABLE_WRITE), so an agent could draft and post entries programmatically, and accountants can be given direct book access. However, there is no evidence of a dedicated 'review queue' or draft/pending-approval state for journal entries awaiting accountant sign-off before posting. Missing for 10: documented draft/pending status for journal entries, an approval workflow tying agent-created entries to accountant review, and any UI/API concept of a review queue.

   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [claimed-docs] “Give your accountant direct access to your books so she can find the reports and information she needs when questions arise.”

   proof ↗⚑ flag

   Bench—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

Chart of accounts

1. accountantCustomize the chart of accounts with account types, sub-accounts, and class or tag dimensions

   weight 3 · round drawn
   QuickBooks Online—none0/10

   The evidence pack contains no mention of chart of accounts, account types, sub-accounts, or class/tag tracking dimensions anywhere in the docs, GitHub, or community items. Without any documented evidence of this capability, it cannot be credited despite being a plausible axis for an accounting product.

   ⚑ flag

   Bench—none0/10

   Bench is a done-for-you bookkeeping service where a human bookkeeper manages the books; the evidence pack shows no self-serve chart-of-accounts customization, account types, sub-accounts, or class/tag dimension configuration exposed to the accountant/customer. The client-facing surface is reports and downloads, not ledger/CoA editing. Missing for 10: any mention of CoA management, account type/sub-account creation, or class/tag dimension tagging capability.

   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

Journal entries

1. accountantPost manual journal entries with balanced debits, credits, and supporting memos

   weight 3 · round drawn
   QuickBooks Online—none0/10

   The evidence pack covers invoicing, reconciliation, A/R, integrations, and AI features but contains no mention of manual journal entries, debit/credit entry screens, or memo fields for adjusting entries. Since journal entries are a core, applicable ledger capability for accounting software, absence of any supporting evidence means this is 'none' rather than 'na'.

   ⚑ flag

   Bench—none0/10

   Bench is a done-for-you bookkeeping service where Bench's own staff (not the customer) manage the books; evidence explicitly states the client-facing surface is reports/downloads, 'not a ledger the customer posts to' (bench-supp-reporting), with no mention of a journal-entry interface, debit/credit balancing, or memo fields for accountant users. Missing for 10: any UI or workflow for entering/posting journal entries, debit/credit validation, and memo/supporting-documentation attachment on entries.

   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

Ai audit

1. ai-native userHave an agent monitor the ledger and flag anomalies in spend or duplicate transactions before the close

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialclaimed5/10

   QuickBooks documents an 'Intuit Intelligence' chat AI that can 'help resolve anomalies' and generate reports, plus a Reconciliation Discrepancy Report for spotting book discrepancies, and ships an official MCP server exposing 145 tools/CRUD and 11 financial reports that an external agent could use to monitor the ledger. However, none of this evidence specifically describes automated, proactive flagging of spend anomalies or duplicate transactions ahead of month-end close, and there's no independent or hands-on confirmation of this working as an agentic monitoring workflow. Missing for 10: dedicated duplicate-transaction/anomaly detection feature documentation, evidence of pre-close automated alerting, and third-party validation of anomaly detection accuracy.

   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [claimed-docs] “There are several reports – such as the The Reconciliation Discrepancy Report, the Missing Checks Report, and the Transaction Detail Report …”
   • [claimed-docs] “Your Payroll AI proactively collects time and attendance data from your employees and spots inconsistencies, allowing you to run payroll mor…”
   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a human-plus-software bookkeeping service with automated categorization and real-time reporting, but there is no evidence of an AI agent that actively monitors the ledger for anomalies or duplicate transactions ahead of close; the closest capability is human bookkeeper review and periodic reminders. missing for 10: agent-based anomaly detection, duplicate-transaction flagging, any pre-close audit automation.

   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Audit trail

1. accountantSee a complete audit trail of who changed what and when across the entire ledger

   weight 3 · round drawn
   QuickBooks Online—none0/10

   The axis clearly applies to accounting software, but no evidence item mentions an audit trail, activity log, or change-history feature — closest matches (custom roles/permissions, backup & restore) address access control and data recovery, not a record of who changed what and when. Missing for 10: any documentation of an Audit Log/Audit Trail report, user-action history, or field-level change tracking across the ledger.

   ⚑ flag

   Bench—none0/10

   Bench is a service where a human bookkeeper does the books, and the client-facing surface is reports/downloads rather than a ledger with visible change history; no evidence of any audit-trail, version history, or user-attribution feature is present anywhere in the pack, and probes confirm no docs/API surfacing such capability. missing for 10: any mention of audit logs, change tracking, user attribution, or timestamped edit history across the ledger.

   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

Multi entity

1. accountantManage multiple legal entities and produce consolidated financials across them

   weight 2 · round drawn
   QuickBooks Online—none0/10

   No evidence pack item mentions multi-entity management, inter-company eliminations, or consolidated financial reporting across separate legal entities; QuickBooks Online appears architected as single-company-per-subscription (Advanced tier only mentions up to 25 users, not multi-entity consolidation). Community notes even flag missing desktop features vs QBO, reinforcing the gap. missing for 10: any mention of multi-entity/subsidiary management, consolidated reporting across companies, or inter-entity eliminations.

   • [claimed-docs] “Grow confidently with custom access for up to 25 users, Priority Circle expert support, and backup and restore to undo mistakes instantly an…”
   • [claimed-docs] “Get 13-week cash flow and P&L forecasting powered by historical data. Compare forecast vs. actual data, share inputs in real time”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a single-entity small-business bookkeeping/tax service; nothing in the evidence mentions multi-entity management, consolidation, or intercompany eliminations. Missing for 10: multi-entity account structure, consolidated financial statements across entities, intercompany reconciliation/eliminations.

   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to QuickBooks Online
   QuickBooks Online~partialprobed6/10

   Intuit's official API/SDKs and the official QuickBooks Online MCP server (145 tools, full CRUD for 29 entity types, 11 financial reports) show broad, deliberate API coverage of core accounting objects, and sandbox/production + write-safety toggles indicate agent-friendly design (quickbooks-gh-3, quickbooks-gh-4, quickbooks-gh-6, quickbooks-supp-mcp-sandbox). However, there's no evidence that UI-specific features like GPS mileage capture, invoice template customization, bank-feed matching UX, or the Intuit Intelligence chat assistant itself are exposed via the API, and OpenAPI/llms.txt discovery probes 404'd, suggesting incomplete self-describing API docs. Missing for 10: confirmation that non-core UI features (mileage, invoice branding, AI chat actions) are API-reachable, and a first-party OpenAPI spec or llms.txt for full discoverability.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “Intuit's official QuickBooks Online MCP server README documents the same sandbox/production environment split for agent integrations: "Sandb…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”

   proof ↗⚑ flag

   Bench—none0/10

   No API, OpenAPI spec, or developer documentation exists; probes for llms.txt, docs.md, and openapi.json all return 404s, and all evidence describes a UI/human-service product with no programmatic access surface.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialprobed3/10

   There is no documented native 'export all data' feature in open formats (like a full CSV/Excel/QBO-file export) in the evidence pack, but the presence of REST APIs, SDKs, and an official MCP server with full CRUD access to 29 entity types and 11 financial reports (quickbooks-gh-3, quickbooks-gh-4, quickbooks-gh-5) suggests a technical path for an AI-native user to programmatically pull out their data via API. Missing for 10: an explicit bulk data export tool, documented file formats (CSV/JSON/XML) for full account export, and any first-party 'migrate out' or backup-to-open-standard feature.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   No evidence of data export in open/portable formats or account portability; reporting is limited to viewing/downloading income statements or balance sheets, not a full data export mechanism, and probes for llms.txt/openapi/docs all 404. missing for 10: explicit data export feature (CSV/QBO/API), documented data portability policy, evidence of ability to leave with full underlying data.

   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   QuickBooks Online—none0/10

   No evidence in the pack addresses data residency, regional data storage options, or data locality controls for QuickBooks Online; the evidence covers features like invoicing, reconciliation, integrations, and MCP tooling but nothing about where customer data is physically stored or user choice over data region.

   ⚑ flag

   Bench—none0/10

   No evidence in the pack mentions data residency, region selection, or storage location controls; Bench's marketing focuses on bookkeeping automation, tax, and banking, with no data-residency documentation and 404s on technical/API probes that might have revealed such settings.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   QuickBooks Online—none0/10

   No evidence in the pack addresses AI training data opt-out or data-usage controls for AI model training; QuickBooks docs focus on bookkeeping, invoicing, integrations, and MCP/API tooling but never mention privacy controls over AI training use of customer data.

   ⚑ flag

   Bench—none0/10

   Bench is a bookkeeping/accounting service and no evidence pack item mentions AI training data usage, opt-out controls, or any privacy policy addressing model training; this is an applicable privacy-posture axis for any modern SaaS handling customer data, but no supporting or contradicting evidence exists. Missing for 10: any privacy policy statement, opt-out mechanism, or terms-of-service language regarding AI/ML training on customer data.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   QuickBooks Online—none0/10

   Evidence shows CRUD 'Delete' operations exist for business records via API/SDK and MCP write-toggles, but nothing addresses account-level data retention policies, AI training data deletion, or privacy-oriented data lifecycle controls that an AI-native user would need to manage. No documentation on retention periods, deletion of AI-processed data, or privacy dashboard controls is present.

   • [claimed-docs] “Create, Update, Read, and Delete Examples”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [github] “restrict which tool categories are registered (default: all enabled)”

   proof ↗⚑ flag

   Bench—none0/10

   Bench is a human-plus-software bookkeeping service; no evidence in the pack addresses data retention policies, deletion controls, or export/delete-your-data mechanisms for AI-native users. Probes for docs/llms.txt/openapi all 404, and no privacy/retention page is cited. missing for 10: retention policy documentation, data deletion/export controls, privacy posture disclosures, any AI-specific data handling terms.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”

   proof ↗⚑ flag

Ai insights

1. ai-native userAsk an agent "can we afford X?" and get an answer grounded in live ledger data pulled through the API

   weight 3 · round to QuickBooks Online
   QuickBooks Online~partialprobed6/10

   QuickBooks has an official MCP server exposing 145 tools with full CRUD across 29 entities and 11 financial reports (Balance Sheet, P&L, Cash Flow), which could ground an agent's answer to affordability questions in live ledger data, and Intuit Intelligence chat markets natural-language Q&A like 'What's driving my profit?'. However, there's no first-party documentation showing an agent actually reasoning through a cash-flow/affordability question end-to-end, and probes show no public OpenAPI/llms.txt discoverability layer, and no independent/hands-on evidence confirms real-time accuracy of agent-grounded answers. missing for 10: a documented example of an agent answering an affordability-style question using live API data, public OpenAPI/llms.txt for easy agent discovery, and independent verification that answers are accurately grounded rather than hallucinated.

   • [github] “145 Total Tools - Complete coverage of QuickBooks Online API”
   • [github] “It includes full CRUD operations for 29 entity types and 11 financial reports, giving you comprehensive access to QuickBooks Online function…”
   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [github] “29 Entity Types - Full CRUD operations (Create, Read, Update, Delete, Search)”
   • [claimed-docs] “Ask anything—from “What’s driving my profit?” to “How are my invoices doing this month?”—and get instant, contextual answers in clear, conci…”
   • [claimed-docs] “Speed up business by telling Intuit Intelligence chat to create invoices, help resolve anomalies, run payroll, generate reports, estimate ta…”
   • [probe] “PROBE llms.txt: HTTP 404 at https://developer.intuit.com/llms.txt”
   • [probe] “PROBE openapi: all candidate paths 404 (https://developer.intuit.com/openapi.json, https://developer.intuit.com/swagger.json, https://develo…”
   • [probe] “official MCP server documented at https://developer.intuit.com/app/developer/qbo/docs/develop/mcp”

   proof ↗⚑ flag

   Bench—none0/10

   No evidence of any public API, MCP server, or AI-agent integration exposing ledger data; probes for llms.txt, docs-md, and OpenAPI all returned 404s, and reporting is described as human-facing downloads/dashboards, not programmatic access. missing for 10: any API/endpoint for ledger data, agent integration, documented query interface for financial questions.

   • [probe] “PROBE llms.txt: HTTP 404 at https://www.bench.co/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://www.bench.co/how-it-works.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://www.bench.co/openapi.json, https://www.bench.co/swagger.json, https://www.bench.co/api/opena…”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Custom reports

1. accountantBuild custom reports filtered and grouped by class, location, or tag dimensions

   weight 2 · round drawn
   QuickBooks Online—none0/10

   The evidence pack contains no mention of class, location, or tag tracking, nor of custom report building filtered/grouped by these dimensions — only generic mentions of custom roles/access, invoicing, and integrations. One community note even claims QBO lacks many reports found in desktop QuickBooks, but nothing confirms or denies this specific capability.

   • [claimed-docs] “Manage what others can see and set custom roles, workflows, and fields to find more efficiency.”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Bench—none0/10

   Evidence only shows basic reporting (income statement, balance sheet) delivered as static downloads/reports, with no mention of custom report building or filtering/grouping by class, location, or tag dimensions. Bench is positioned as a done-for-you bookkeeping service, not a self-serve reporting tool with dimensional tagging capabilities.

   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”

   proof ↗⚑ flag

Statements

1. founderGenerate an accurate P&L, balance sheet, and cash-flow statement for any period on demand

   weight 3 · round to Bench
   QuickBooks Online✓fullcommunity7/10

   The official QuickBooks Online MCP server explicitly lists '11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more' with full API coverage, and QBO Advanced marketing cites 13-week cash-flow/P&L forecasting and instant on-demand reporting via Intuit Intelligence chat. This confirms the three core statements are generatable on demand for any period. Missing for 10: a dedicated first-party reports-center walkthrough showing period selection UI, and independent hands-on verification of statement accuracy (community feedback notes QBO is 'not feature complete' vs desktop for some reports).

   • [github] “11 Financial Reports - Balance Sheet, P&L, Cash Flow, and more”
   • [claimed-docs] “Get 13-week cash flow and P&L forecasting powered by historical data. Compare forecast vs. actual data, share inputs in real time”
   • [claimed-docs] “Ask for the reports that matter most to your business—top expenses, sales trends, industry benchmarking—and get them instantly.”
   • [claimed-docs] “I chose QuickBooks Online Advanced, because I have the real-time data at my fingertips, and I'm able to easily forecast what the next three …”
   • [community] “"Quickbooks online also had some significant quirkyness... QuickBooks online is not feature complete when compared to QuickBooks desktop - h…”

   proof ↗⚑ flag

   Bench✓fullclaimed8/10

   Bench explicitly markets real-time reporting with income statement (P&L) and balance sheet access/download at all times, backed by automated categorization and human bookkeeper review for accuracy. Cash-flow statement generation is not explicitly named, and there's no independent/hands-on corroboration of accuracy beyond vendor claims. Missing for 10: explicit mention of cash-flow statement as a deliverable report, and third-party or user corroboration of report accuracy.

   • [claimed-docs] “Real-time reporting. Access or download your updated income statement or balance sheet at all times”
   • [claimed-docs] “"Real-time reporting. Access or download your updated income statement or balance sheet at all times" — the client-facing surface is reports…”
   • [claimed-docs] “Accurate transaction categorization, powered by smart automation with instant guidance”
   • [claimed-docs] “"Connect all your financial accounts to automate data entry, speed up your books, reduce errors and save time", with "Accurate transaction c…”
   • [claimed-docs] “Bench is a human-plus-software service, now under new ownership: "Bench simplifies your small business accounting by combining intuitive sof…”

   proof ↗⚑ flag