Puzzle vs Pilot

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to Puzzle
   Puzzle✓fullprobed8/10

   A live probe confirms Puzzle's help center serves a valid llms.txt file at help.puzzle.io/llms.txt (HTTP 200) with structured markdown links to docs, directly satisfying the ability to point an agent at agent-oriented docs. Missing for 10: independent/community confirmation of agents successfully consuming this file, and broader agent-doc formats (e.g., per-page .md mirrors, which probes show 404).

   • [probe] “PROBE llms.txt: HTTP 200 at https://help.puzzle.io/llms.txt # Puzzle Help Center > Help center for Puzzle ## Puzzle Overview - [Quick Sta…”
   • [probe] “PROBE docs-md: HTTP 404 at https://help.puzzle.io/en/.md”

   proof ↗⚑ flag

   Pilot~partialprobed4/10

   A probe confirms Pilot serves an llms.txt file at HTTP 200, so an agent can indeed be pointed at it — but the content shown is minimal (just entity/category metadata, no structured docs or API references), and other agent-doc formats (docs-md, openapi) return 404. Missing for 10: substantive llms.txt content beyond basic metadata, markdown docs mirror, and any first-party statement about agent-oriented documentation strategy.

   • [probe] “PROBE llms.txt: HTTP 200 at https://pilot.com/llms.txt # Pilot [Entity: Pilot] [Category: Professional Services] [Subcategory: Acco…”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round drawn
   Puzzle—none0/10

   Puzzle's evidence only shows marketing language about an 'API' for embedding accounting into platforms and an MCP integration for Claude chat — neither documents headless CLI operation, CI pipeline usage, or automation-oriented tooling. No SDK, auth flow, or CI examples are present, so there's no evidence of headless/CI automation support.

   • [claimed-docs] “With Puzzle's Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “With Puzzle’s Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “your platform gets automated AI bookkeeping, real-time financial insights, and a clean data foundation built to scale”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

3. ai-native userConnect an agent via an official MCP server

   weight 3 · round to Puzzle
   Puzzle✓fullclaimed7/10

   Puzzle documents an official MCP server integration that connects Puzzle accounts to Claude for natural-language access to financial data, with a dedicated setup guide (puzzle-docs-2, puzzle-docs-22, puzzle-docs-33). This is a first-party, product-level MCP server offering, fitting the axis for a non-agent SaaS product. Missing for 10: independent/hands-on confirmation that the MCP server works as documented, and technical details on supported tool calls/scopes.

   • [claimed-docs] “How to setup your Puzzle MCP”
   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”
   • [claimed-docs] “lets you connect your Puzzle account directly to Claude, giving you instant access to your financial data through natural conversation — no …”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any MCP server offering; docs mention integrations (Bill.com, Stripe, Gusto) but nothing about AI agent connectivity via MCP, and API/openapi probes returned 404s.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”

   proof ↗⚑ flag

4. ai-native userDrive the product through a documented public API

   weight 3 · round to Puzzle
   Puzzle~partialprobed4/10

   Puzzle markets an 'Embedded Accounting' API and has a help article on 'API Access in Puzzle' describing platform-to-platform integration intent, suggesting a documented public API exists. However, probes for actual API reference material (OpenAPI/swagger specs, docs-md) returned 404s, and no evidence pack item shows endpoint-level documentation, auth flow, or SDKs. Missing for 10: a public API reference/spec, authentication and endpoint documentation, and independent confirmation that AI-native users can programmatically drive the product via this API.

   • [claimed-docs] “With Puzzle's Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “With Puzzle’s Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of a public API for Pilot; OpenAPI/swagger probes all returned 404 and no docs mention an API for driving the product programmatically. Pilot is a human-service accounting/bookkeeping product with integrations, not an API-driven platform.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

5. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round drawn
   Puzzle—none0/10

   Evidence shows Puzzle has an API and MCP integration for connecting agents (e.g., Claude) to account data, but there is no mention of issuing scoped, least-privilege API credentials, permission scopes, or granular token controls for agents. missing for 10: scoped API key/token generation, permission/role-based credential scoping, documentation of least-privilege access controls for agent integrations.

   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [claimed-docs] “lets you connect your Puzzle account directly to Claude, giving you instant access to your financial data through natural conversation — no …”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

6. ai-native userBuild against official SDKs

   weight 2 · round to Puzzle
   Puzzle~partialprobed5/10

   Puzzle offers a documented API for embedded accounting and an MCP integration for Claude, showing some official developer surfaces, but there's no evidence of a formal SDK (client libraries, language bindings) or OpenAPI spec — probes for openapi.json all returned 404. missing for 10: official SDK/client libraries in specific languages, published OpenAPI/API reference spec, independent developer corroboration of building against the API.

   • [claimed-docs] “With Puzzle's Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “With Puzzle’s Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”
   • [claimed-docs] “lets you connect your Puzzle account directly to Claude, giving you instant access to your financial data through natural conversation — no …”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any official SDKs; probes for API/OpenAPI specs returned 404s, and no docs mention developer SDKs.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

7. ai-native userSubscribe to events via webhooks

   weight 2 · round drawn
   Puzzle—none0/10

   No evidence of webhook subscription capability anywhere in the pack; Puzzle offers an API and MCP integration for querying data, but nothing about event-driven webhooks.

   ⚑ flag

   Pilot—none0/10

   No evidence of any webhook subscription capability or event API; Pilot is an accounting/bookkeeping service and probes show no OpenAPI or developer API surface exists.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to Puzzle
   Puzzle✓fullclaimed8/10

   Puzzle offers a conversational 'ask anything' insights feature (cash trending, profitability, fundraising readiness) plus AI Close agents that surface discrepancies, AI-driven categorization suggestions, and MCP integration for natural-language querying of financial data via Claude — all directly delivering AI-generated insights/suggestions from the user's own data. Missing for 10: independent hands-on verification of insight accuracy/quality beyond marketing copy and only one general community mention unrelated to this specific feature.

   • [claimed-docs] “Ask anything about your business, instantly, in plain English. "How's my cash trending?" "Am I ready to raise?" "Which months am I actually …”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “A user can click on a button and “ask AI” for help in categorizing a transaction —without context switching between tools.”
   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “Hand off the busywork. Finding software subscriptions, matching invoices to payments, pulling together what your accountant needs — describe…”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot's marketing mentions 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead' (pilot-docs-7), which points to some AI-generated insight capability inside the product, and scenario/cash-flow modeling features (pilot-docs-8, pilot-docs-21) suggest similar analytical output, though these are framed as human CFO-delivered rather than explicitly AI-driven. There is no independent/hands-on corroboration of the AI feature actually working, and community reviews focus on bookkeeping accuracy/time savings rather than AI insights. Missing for 10: detailed documentation of the AI feature's scope/accuracy, independent user testimony specifically about the AI insights, and clarity on whether insights are AI-generated vs. human-analyst-generated.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Model cash flow scenarios Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Track company expenses in real time Find the $2,000/month you didn't know you were wasting.”
   • [claimed-docs] “Find the $2,000/month you didn't know you were wasting.”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Puzzle
   Puzzle~partialclaimed6/10

   Puzzle documents concrete background automations — 'AI Close' agents that autonomously reconcile accounts, review transactions and surface discrepancies during month-end, plus custom categorization rules and batch auto-categorization (up to 98%) that run without manual triggering. However these are fixed, accounting-specific automations rather than a general-purpose 'set up your own automation' framework, and there's no independent/hands-on evidence confirming reliability of unattended runs. Missing for 10: user-configurable triggers/schedules for arbitrary automations, evidence of true autonomy without review gates, and independent verification of background execution.

   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “Creating custom rules”
   • [claimed-docs] “Batch Categorize Transactions”
   • [claimed-docs] “Up to 98% auto-categorization”

   proof ↗⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Puzzle
   Puzzle✓fullclaimed8/10

   Puzzle ships built-in AI features (AI Close, Accounting AI) described as using 'AI agents to reconcile accounts, review transactions, and surface discrepancies,' plus an 'Ask AI' button for categorization help and natural-language financial queries — all within the product itself, not an external agent. Missing for 10: independent/hands-on verification of these AI features actually completing delegated tasks, and clearer detail on autonomy vs human-review boundaries.

   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “A user can click on a button and “ask AI” for help in categorizing a transaction —without context switching between tools.”
   • [claimed-docs] “Accounting AI runs prompts on top of your general ledger. The output reflects your existing accounts and categories.”
   • [claimed-docs] “How to import a PDF or CSV using Accounting AI”
   • [claimed-docs] “Ask anything about your business, instantly, in plain English. "How's my cash trending?" "Am I ready to raise?" "Which months am I actually …”
   • [claimed-docs] “Hand off the busywork. Finding software subscriptions, matching invoices to payments, pulling together what your accountant needs — describe…”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's pricing page mentions an AI feature offering 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' which is a thin, single-mention hint of an in-product AI assistant capable of some task-like actions (scenario modeling). There's no further documentation on scope, autonomy, or how tasks are delegated to it, and community evidence focuses on human bookkeepers/CFOs rather than the AI assistant. Missing for 10: detailed documentation of the AI assistant's task-delegation capabilities, independent/hands-on corroboration of it actually performing delegated tasks, and clarity on its scope beyond Q&A.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Puzzle
   Puzzle✓fullclaimed7/10

   Puzzle documents natural-language interaction via its MCP integration with Claude ('instant access to your financial data through natural conversation') and multiple AI features letting users 'ask anything about your business in plain English' or 'ask AI' to categorize transactions, plus AI Close agents automating close tasks from natural prompts. Missing for 10: independent/hands-on verification that NL commands can trigger broader actions (not just queries) and third-party corroboration of the MCP/Claude workflow in practice.

   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”
   • [claimed-docs] “lets you connect your Puzzle account directly to Claude, giving you instant access to your financial data through natural conversation — no …”
   • [claimed-docs] “Ask anything about your business, instantly, in plain English. "How's my cash trending?" "Am I ready to raise?" "Which months am I actually …”
   • [claimed-docs] “A user can click on a button and “ask AI” for help in categorizing a transaction —without context switching between tools.”
   • [claimed-docs] “Accounting AI runs prompts on top of your general ledger. The output reflects your existing accounts and categories.”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's marketing mentions 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' implying some natural-language Q&A interface, but there's no evidence of broader natural-language command execution (e.g., initiating actions, workflows) or any API/CLI to support it. missing for 10: evidence of NL commands beyond Q&A, independent/hands-on corroboration, technical documentation of the AI interface, API or programmatic access.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

Api quality

1. ai-native userExplore an interactive API reference with runnable examples

   weight 2 · round drawn
   Puzzle—none0/10

   Puzzle documents an API (puzzle.io/api) and an MCP integration, but there is no evidence of an interactive API reference or runnable examples; probes for OpenAPI/Swagger specs at expected paths all returned 404, suggesting no such interactive reference exists.

   • [claimed-docs] “With Puzzle's Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”
   • [probe] “PROBE docs-md: HTTP 404 at https://help.puzzle.io/en/.md”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is an accounting/bookkeeping service with no evidence of any developer API reference or runnable examples; probes for OpenAPI/docs-md all returned 404, and no evidence pack items mention an API reference.

   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Puzzle—none0/10

   Puzzle has an API and mentions API access docs, but the probe explicitly found no OpenAPI/swagger spec at any candidate path, and no evidence pack item references a downloadable machine-readable spec.

   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”

   proof ↗⚑ flag

   Pilot—none0/10

   Probe explicitly checked common OpenAPI/swagger endpoints and all returned 404, and no documentation mentions a machine-readable API spec. Missing for 10: any published OpenAPI/Swagger spec, API documentation, or developer portal.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

3. ai-native userTest against a sandbox environment without touching production data

   weight 1 · round drawn
   Puzzle—none0/10

   No evidence in the pack mentions a sandbox, test, or staging environment for Puzzle's API or product that would let a user test without touching production financial data; only production-focused API and bookkeeping features are documented.

   ⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

4. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   Puzzle—none0/10

   The evidence pack shows Puzzle has an API and MCP integration (puzzle-docs-42, puzzle-docs-21) but contains no mention of API versioning scheme or a documented deprecation policy; probes for OpenAPI specs all returned 404. Missing for 10: any versioning scheme documentation, changelog, or deprecation/sunset policy.

   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [claimed-docs] “With Puzzle’s Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with no evidence of any public API, versioning scheme, or deprecation policy; probes for OpenAPI specs all returned 404s. missing for 10: any public API documentation, versioning scheme, deprecation policy, or developer-facing API references.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Puzzle
   Puzzle~partialclaimed6/10

   Puzzle documents concrete bulk-operation features—batch categorizing transactions, bulk CSV import of manual journal entries, and bulk CSV upload of the Chart of Accounts—plus rule-based automation for categorization, all first-party docs. However, these bulk mechanisms are CSV/rule-based rather than explicitly exposed through the AI/API/MCP layer for an 'AI-native' agent to invoke programmatically at scale. Missing for 10: explicit evidence that the API or MCP integration itself supports issuing bulk operations (not just UI/CSV uploads), and independent/hands-on confirmation of bulk-op reliability at scale.

   • [claimed-docs] “Batch Categorize Transactions”
   • [claimed-docs] “Need to post more than one manual journal entry at a time? Instead of adding them one by one, you can upload a batch of entries all at once …”
   • [claimed-docs] “If you need to bulk add or edit your Chart of Accounts in Puzzle, you can do so by uploading a CSV file directly from your Company Settings.”
   • [claimed-docs] “Creating custom rules”
   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service; no evidence describes any bulk-operation or batch-processing capability across items (transactions, invoices, etc.) for AI-native automation. Missing for 10: any mention of bulk edit/import/export tools, batch API operations, or automation-scale item processing.

   ⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to Puzzle
   Puzzle~partialclaimed5/10

   Puzzle documents 'Creating custom rules' for transaction categorization, letting users define rules that automatically trigger categorization when transactions occur, and AI Close agents that automate reconciliation on close events — concrete evidence of rule-based automation tied to events. However, this is scoped narrowly to bookkeeping categorization/close workflows rather than a general-purpose rules engine spanning arbitrary triggers and actions. Missing for 10: evidence of a broader, user-configurable trigger-action framework beyond categorization/close (e.g., custom webhooks, conditional workflows across modules), and independent confirmation of rule behavior in practice.

   • [claimed-docs] “Creating custom rules”
   • [claimed-docs] “Batch Categorize Transactions”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a bookkeeping/accounting service with dedicated human experts and integrations, but there is no evidence of a rules engine or automation-trigger system letting users define event-based automated actions; features described are AI Q&A and integrations, not user-defined trigger/action rules.

   ⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   Puzzle—none0/10

   Puzzle documents AI-driven automation for close, categorization, and reconciliation, but there is no evidence of any capability to schedule recurring jobs or workflows (e.g., recurring invoices, scheduled reports, or timed automation triggers).

   ⚑ flag

   Pilot—none0/10

   The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

   ⚑ flag

Ai reconciliation

1. ai-native userHave an agent reconcile a month end-to-end, matching transactions, flagging exceptions, and preparing the close for human review

   weight 3 · round to Puzzle
   Puzzle~partialclaimed6/10

   Puzzle's AI Close feature explicitly uses AI agents to reconcile accounts, review transactions, and surface discrepancies for month-end close, directly matching the story's core ask (puzzle-docs-24, puzzle-docs-39, puzzle-docs-5). However, evidence doesn't confirm full end-to-end autonomy or explicit 'preparation for human review' handoff workflow beyond general review-before-final claims, and there's no independent/hands-on validation of the AI Close agent's reconciliation accuracy or exception-flagging in practice. missing for 10: independent/hands-on verification of AI Close performance, detailed documentation of exception-flagging logic, explicit human-review handoff/approval workflow, and evidence of full end-to-end (not just partial/batch) reconciliation coverage.

   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “Month-End close with AI Close”
   • [claimed-docs] “Hand off the busywork. Finding software subscriptions, matching invoices to payments, pulling together what your accountant needs — describe…”
   • [claimed-docs] “performing a reconciliation is the best way to ensure every single transaction is accounted for and matches your bank statement exactly—givi…”

   proof ↗⚑ flag

   Pilot~partialcommunity3/10

   Pilot's evidence shows human bookkeepers finalize monthly books with integration-driven transaction classification (pilot-comm-1, pilot-docs-18, pilot-docs-26), which is directionally toward automated reconciliation, but there is no evidence of an autonomous agent matching transactions, flagging exceptions, and preparing a close package end-to-end without human bookkeeper involvement. Missing for 10: explicit agentic exception-flagging workflow, evidence of AI (not human staff) doing the matching/reconciliation, and documentation of an automated close-prep output for review.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Bank feeds

1. founderConnect bank and credit-card accounts so transactions import automatically every day

   weight 3 · round drawn
   Puzzle✓fullclaimed7/10

   Puzzle's docs describe connecting bank/credit-card accounts and third-party sources (Brex, Ramp, Stripe) with automated categorization (98% categorized) and reconciliation workflows, which directly supports the daily-import banking-reconciliation story (puzzle-docs-29, -15, -14, -13, -18, -19). However, there's no explicit statement about daily import cadence or independent verification of reliability. Missing for 10: explicit 'daily auto-sync' language, third-party/hands-on confirmation of import frequency and accuracy.

   • [claimed-docs] “performing a reconciliation is the best way to ensure every single transaction is accounted for and matches your bank statement exactly—givi…”
   • [claimed-docs] “98% transactions categorized When you connect Brex with Puzzle”
   • [claimed-docs] “2x faster to close books When you connect Ramp with Puzzle”
   • [claimed-docs] “3 min to reconcile revenue When you connect Stripe with Puzzle”
   • [claimed-docs] “Up to 98% auto-categorization”
   • [claimed-docs] “Puzzle customers who fully onboard and connect supported integrations can reduce the time required to complete their monthly close by 50% or…”

   proof ↗⚑ flag

   Pilot✓fullcommunity7/10

   Pilot's docs and a first-hand customer testimonial confirm bank/credit-card/expense integrations automatically feed transaction data for classification, with real-time account data in the portal, eliminating manual founder bookkeeping work. missing for 10: no explicit list of supported banks, no detail on daily-sync frequency or setup flow, and no independent technical documentation beyond marketing/community claims.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Categorization

1. founderGet automatic categorization suggestions for imported transactions that learn from my corrections

   weight 2 · round to Puzzle
   Puzzle~partialclaimed6/10

   Puzzle clearly ships automatic transaction categorization with high accuracy claims (up to 98%), custom rules, batch categorization, and an 'ask AI' assist button, showing an active categorization engine tied to user-configurable rules. However, there is no explicit documentation describing a feedback loop where the AI model learns from user corrections over time (as opposed to static rules the user manually creates). missing for 10: explicit description of ML/AI learning from user corrections, evidence of improved suggestion accuracy after corrections, independent confirmation of this adaptive behavior.

   • [claimed-docs] “Creating custom rules”
   • [claimed-docs] “Batch Categorize Transactions”
   • [claimed-docs] “Up to 98% auto-categorization”
   • [claimed-docs] “A user can click on a button and “ask AI” for help in categorizing a transaction —without context switching between tools.”
   • [claimed-docs] “98% transactions categorized When you connect Brex with Puzzle”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence shows Pilot's transaction classification is handled by integrations plus human bookkeepers/accountants (pilot-comm-1, pilot-docs-17), not by an AI categorization engine that learns from founder corrections. No documentation describes a self-serve ML suggestion-and-correction loop. Missing for 10: any mention of an AI/ML categorization suggestion feature, evidence of a correction/feedback loop, or founder-facing UI for adjusting categorizations.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Reconciliation

1. accountantReconcile each bank account against the ledger with matched, unmatched, and duplicate transactions surfaced for review

   weight 3 · round to Puzzle
   Puzzle✓fullclaimed7/10

   Puzzle has a dedicated reconciliation feature for bank/credit card accounts explicitly designed to ensure every transaction is accounted for and matches the bank statement (puzzle-docs-29), plus AI Close automates reconciling accounts, reviewing transactions, and surfacing discrepancies (puzzle-docs-24, puzzle-docs-39). This covers the core reconcile-and-surface-for-review workflow an accountant needs. Missing for 10: explicit documentation of distinct 'matched/unmatched/duplicate' transaction states or UI surfacing terminology, and independent/hands-on validation beyond vendor docs.

   • [claimed-docs] “performing a reconciliation is the best way to ensure every single transaction is accounted for and matches your bank statement exactly—givi…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence describes bank/tool integrations and automated transaction classification (pilot-comm-1, pilot-docs-17) but never describes a reconciliation workflow that surfaces matched, unmatched, and duplicate transactions for accountant review. Missing for 10: any documentation or user report of a reconciliation screen or matched/unmatched/duplicate transaction handling.

   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Bill management

1. accountantCapture vendor bills, route them for approval, and schedule payments from one workflow

   weight 2 · round to Pilot
   Puzzle—none0/10

   The evidence pack covers bookkeeping, categorization, close automation, invoicing (AR), and reporting, but contains no mention of vendor bill capture, approval routing, or payment scheduling (AP workflow) anywhere in the docs or help center listings.

   ⚑ flag

   Pilot~partialclaimed3/10

   Pilot's pricing page lists 'Full accounts payable' as a service line item and mentions integration with Bill.com, implying vendor bill handling, but there is no documented detail on bill capture, approval routing, or payment scheduling mechanics within a single workflow — AP appears to be a done-for-you service rather than a described self-serve workflow. Missing for 10: bill capture/OCR details, approval routing configuration, payment scheduling functionality, and any hands-on/independent confirmation of the AP workflow.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”
   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”

   proof ↗⚑ flag

Payables

1. accountantSee accounts payable aging and vendor balances at any point in time

   weight 2 · round to Pilot
   Puzzle—none0/10

   The evidence pack covers bookkeeping, categorization, month-end close, invoicing (AR), reconciliation, and reporting exports, but contains no mention of accounts payable, vendor bills, bill tracking, or AP aging reports. Missing for 10: any documentation of a bills/AP module, vendor balance tracking, or an AP aging report feature.

   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “Yes, you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “Puzzle's invoice editor lets you build a professional, branded invoice and see exactly how it will look as you go!”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot advertises 'Full accounts payable' as a service feature and real-time account data access via its portal, implying some visibility into AP status, but there is no specific mention of AP aging reports or vendor balance tracking at a point in time. missing for 10: explicit AP aging report feature, vendor balance detail/history, point-in-time reporting capability, screenshots or hands-on evidence of AP aging views.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Close process

1. accountantLock closed periods so prior-period numbers cannot change without an explicit reopening

   weight 2 · round drawn
   Puzzle—none0/10

   The evidence covers AI-assisted month-end close, reconciliation, and journal entry reversals, but nowhere mentions locking closed periods or requiring an explicit reopening step to prevent prior-period changes. This is a standard, applicable accounting-software axis, but no documentation or community evidence confirms it exists in Puzzle.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack mentions period locking, closing periods, or preventing retroactive changes to prior-period financials; the evidence only covers bookkeeping, tax, CFO, and integration features. Missing for 10: any mention of period-lock/close controls, reopening workflow, or audit trail preventing prior-period edits.

   ⚑ flag

2. accountantRun a month-end close against a checklist that tracks reconciliations, accruals, and review sign-offs

   weight 3 · round to Puzzle
   Puzzle~partialclaimed5/10

   Puzzle's 'AI Close' explicitly automates month-end close by reconciling accounts, reviewing transactions, and surfacing discrepancies (puzzle-docs-24/39), and separate reconciliation docs describe matching bank/credit card transactions (puzzle-docs-29). Cash and accrual accounting are supported (puzzle-docs-20), but there's no evidence of a structured checklist UI, accrual-specific tasks, or multi-person review/sign-off workflow tracking. Missing for 10: explicit checklist/task-list feature, accrual entry tracking, and reviewer sign-off/approval workflow evidence.

   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “performing a reconciliation is the best way to ensure every single transaction is accounted for and matches your bank statement exactly—givi…”
   • [claimed-docs] “Cash **_and_** accrual accounting”
   • [claimed-docs] “Month-End close with AI Close”

   proof ↗⚑ flag

   Pilot~partialclaimed3/10

   Pilot's monthly bookkeeping service closes books and lets customers communicate on 'outstanding items needed to finalize your books every month' via a portal, implying some close-tracking process, but there is no evidence of an actual checklist artifact tracking reconciliations, accruals, and review sign-offs as distinct trackable steps. missing for 10: explicit reconciliation checklist UI, accrual tracking, and sign-off/approval workflow evidence.

   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Collaboration

1. founderInvite my external accountant or bookkeeper with role-scoped access to review and adjust the books

   weight 3 · round drawn
   Puzzle—none0/10

   Puzzle markets an accountant-facing page (migration, real-time reports, startup metrics) but no evidence describes actual user invitation, permission levels, or role-scoped access controls for external collaborators. Missing for 10: explicit invite flow, role/permission settings, and any documentation of accountant-specific access restrictions.

   • [claimed-docs] “Migrate from QuickBooks without lifting a finger or losing your client's data”
   • [claimed-docs] “Instantly see startup metrics like ARR, burn, & runway”
   • [claimed-docs] “Get real-time financial reports with one click”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence describes its own bookkeeping team communicating with the founder via a portal (docs-18, docs-26) and lets customers keep QuickBooks data so any tax preparer can access it (docs-24), but there is no evidence of a feature to invite an external accountant/bookkeeper into Pilot's own system with role-scoped permissions to review or adjust books. missing for 10: any documentation of user/role invitation, permission scoping, or external collaborator access controls within Pilot's platform.

   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”

   proof ↗⚑ flag

Data access

1. developerPull the full general ledger and trial balance through a documented API in open formats

   weight 3 · round to Puzzle
   Puzzle~partialprobed4/10

   Puzzle documents that users can export a full general ledger and financial statements (cash or accrual) in Excel, CSV, and PDF (open formats), and separately references an API 'architected for deep platform-to-platform integrations,' but no evidence ties GL/trial-balance export specifically to the documented API — exports appear to be a UI feature, and probes for OpenAPI/API docs (openapi.json, swagger.json) all returned 404, suggesting no publicly discoverable API reference. Missing for 10: explicit API endpoint/documentation for pulling GL and trial balance, confirmation of trial balance as a report type, and a working/discoverable OpenAPI spec.

   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats”
   • [claimed-docs] “Yes, you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of a documented API for pulling general ledger or trial balance data; probes for OpenAPI/docs endpoints returned 404s and no API documentation is mentioned anywhere in the evidence pack.

   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

Integrations

1. founderConnect my banking, payments, and payroll systems so their activity flows into the ledger automatically

   weight 2 · round to Pilot
   Puzzle~partialclaimed6/10

   Puzzle documents direct connections to banking/payment platforms like Stripe, Ramp, and Brex with concrete automation stats (transaction categorization, faster close, revenue reconciliation) and general bank/credit card reconciliation flows, showing banking and payments activity flows into the ledger automatically. However, no evidence names a payroll system integration (e.g., Gusto, Rippling) or shows payroll data flowing into the ledger. Missing for 10: explicit payroll system integrations, independent/hands-on confirmation of banking+payroll auto-sync working end-to-end.

   • [claimed-docs] “3 min to reconcile revenue When you connect Stripe with Puzzle”
   • [claimed-docs] “2x faster to close books When you connect Ramp with Puzzle”
   • [claimed-docs] “98% transactions categorized When you connect Brex with Puzzle”
   • [claimed-docs] “Is my revenue automatically ASC 606 compliant in Puzzle?”
   • [claimed-docs] “performing a reconciliation is the best way to ensure every single transaction is accounted for and matches your bank statement exactly—givi…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”

   proof ↗⚑ flag

   Pilot✓fullcommunity8/10

   Pilot explicitly integrates with banking, payments, and payroll systems (e.g. Bill.com, Stripe, Gusto, 10k+ integrations) to feed real-time transaction data into the ledger, and community testimonials confirm bank/card/payment integrations auto-handle transaction classification with minimal founder effort. missing for 10: no explicit first-party detail on the breadth/setup process of bank feed connections beyond named partners, no independent audit of integration reliability at scale.

   • [claimed-docs] “We integrate with hundreds of tools like Bill.com, Stripe, and Gusto.”
   • [claimed-docs] “10k+ Integrations”
   • [claimed-docs] “If you use Gusto, we’ve partnered with Gusto to automatically apply the credit, saving you time.”
   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”

   proof ↗⚑ flag

Migration

1. founderMigrate historical books from another accounting system without losing transaction detail

   weight 1 · round to Puzzle
   Puzzle✓fullclaimed6/10

   Puzzle explicitly markets QuickBooks migration ('Migrate from QuickBooks without lifting a finger or losing your client's data', 'Switch in minutes. Free migration.'), directly addressing historical books migration without data loss for founders switching accounting systems. Missing for 10: independent/hands-on verification of transaction-level fidelity during migration, detail on which source systems beyond QuickBooks are supported, and documented handling of complex historical data edge cases (multi-entity, custom categories).

   • [claimed-docs] “Migrate from QuickBooks without lifting a finger or losing your client's data”
   • [claimed-docs] “Switch in minutes. Free migration.”

   proof ↗⚑ flag

   Pilot~partialclaimed5/10

   Pilot markets that switching providers is supported and mentions keeping existing QuickBooks account and historical data, implying migration support, but there's no detail on how historical transaction-level detail is preserved or migrated from other systems (e.g., Xero, Wave, spreadsheets) beyond QuickBooks. missing for 10: documented migration process, evidence of no data/detail loss, support for non-QuickBooks source systems, independent confirmation of successful migrations.

   • [claimed-docs] “Whether you’re starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding, underst…”
   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Whether you're starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding, underst…”
   • [claimed-docs] “Whether you’re starting fresh or switching providers, your dedicated accounting expert is with you from day one handling onboarding”

   proof ↗⚑ flag

Invoicing

1. founderCreate and send invoices with online payment options and see when they are viewed and paid

   weight 3 · round to Puzzle
   Puzzle~partialclaimed4/10

   Puzzle has a documented invoice creation/customization feature with live preview and branded PDFs/emails (puzzle-docs-28, 40, 47), but there is no evidence of built-in online payment collection or of invoice view/paid status tracking, which are core parts of this story. Missing for 10: online payment processing integration for invoices, and view/paid status notifications or dashboards.

   • [claimed-docs] “The editor opens in a split view: the form on the left, a live preview on the right that updates as you type — so you always know what your …”
   • [claimed-docs] “Puzzle's invoice editor lets you build a professional, branded invoice and see exactly how it will look as you go!”
   • [claimed-docs] “Adding your logo and brand color takes just a few steps and applies everywhere your invoice appears — the live preview, downloaded PDFs, and…”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence only shows Pilot offers 'full accounts receivable' as a bookkeeping service item, but there is no mention of self-serve invoice creation, online payment collection, or view/paid tracking features for founders—Pilot is a done-for-you bookkeeping service, not an invoicing tool. Missing for 10: invoice creation UI, online payment processing, read-receipt/paid-status tracking evidence.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

2. founderSet up recurring invoices and automatic payment reminders for overdue customers

   weight 2 · round drawn
   Puzzle—none0/10

   Evidence confirms Puzzle has an invoice creation/customization editor (branding, live preview) but no documentation mentions recurring/scheduled invoices or automatic overdue payment reminders. Missing for 10: any mention of recurring invoice scheduling, dunning/reminder automation, or overdue-tracking workflows.

   • [claimed-docs] “The editor opens in a split view: the form on the left, a live preview on the right that updates as you type — so you always know what your …”
   • [claimed-docs] “Puzzle's invoice editor lets you build a professional, branded invoice and see exactly how it will look as you go!”
   • [claimed-docs] “Adding your logo and brand color takes just a few steps and applies everywhere your invoice appears — the live preview, downloaded PDFs, and…”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence mentions 'Full accounts receivable' as a service but nothing about recurring invoicing or automated overdue payment reminders specifically. Pilot is positioned as a bookkeeping/accounting service, not an invoicing tool with these automation features documented anywhere in the pack.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

Receivables

1. accountantTrack accounts receivable with aging reports and per-customer balances

   weight 2 · round to Pilot
   Puzzle~partialclaimed3/10

   Puzzle documents invoice creation/customization (docs-28, docs-40, docs-47) and general ledger/financial statement exports (docs-26, docs-37, docs-45), which are adjacent to AR tracking, but no evidence explicitly describes an aging report or per-customer balance view. missing for 10: explicit AR aging report feature, per-customer balance/statement view, documentation tying invoicing to AR tracking workflows.

   • [claimed-docs] “The editor opens in a split view: the form on the left, a live preview on the right that updates as you type — so you always know what your …”
   • [claimed-docs] “Puzzle's invoice editor lets you build a professional, branded invoice and see exactly how it will look as you go!”
   • [claimed-docs] “Adding your logo and brand color takes just a few steps and applies everywhere your invoice appears — the live preview, downloaded PDFs, and…”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot's pricing page lists 'Full accounts receivable' as a service offering, confirming AR management is part of the product, but there is no evidence of specific features like aging reports or per-customer balance tracking/reporting in the evidence pack. missing for 10: documentation of aging reports, per-customer balance views, AR-specific dashboards or reports, and independent/hands-on confirmation of these features.

   • [claimed-docs] “Full accounts receivable Full accounts payable Payroll administration”
   • [claimed-docs] “Full accounts receivable Full accounts payable”

   proof ↗⚑ flag

Ai ledger

1. ai-native userHave an agent draft and post journal entries via the API and leave them in a review queue for my accountant

   weight 3 · round to Puzzle
   Puzzle~partialclaimed4/10

   Puzzle's API supports platform-to-platform integration and journal entries can be created/edited/imported (docs-42, docs-43, docs-31/35), and AI Close uses agents to reconcile and 'review transactions' (docs-24/39), suggesting some agent-assisted, human-reviewed workflow exists. However, there is no documented API endpoint or feature specifically for an agent to draft a journal entry and place it into a distinct 'review queue' state pending accountant approval — the evidence only shows batch/manual entry creation and general AI-close reconciliation, not a draft-and-queue mechanism. Missing for 10: explicit API support for draft/pending journal entry status, a documented review-queue or approval workflow accessible to accountants, and confirmation that AI-drafted entries route through this queue rather than posting directly.

   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [claimed-docs] “Need to post more than one manual journal entry at a time? Instead of adding them one by one, you can upload a batch of entries all at once …”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “Puzzle automatically creates a voiding (reversing) journal entry for the original and posts a new entry reflecting your changes.”
   • [claimed-docs] “Puzzle automatically creates a voiding (reversing) journal entry for the original and posts a new entry reflecting your changes”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of any API, agent integration, or journal entry review queue functionality; Pilot is a human-service bookkeeping/accounting company with no documented API (openapi probes 404). Missing for 10: any API existence, journal entry draft/post capability, review queue workflow, agent-facing endpoints.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE llms.txt: HTTP 200 at https://pilot.com/llms.txt # Pilot [Entity: Pilot] [Category: Professional Services] [Subcategory: Acco…”

   proof ↗⚑ flag

Chart of accounts

1. accountantCustomize the chart of accounts with account types, sub-accounts, and class or tag dimensions

   weight 3 · round to Puzzle
   Puzzle~partialclaimed6/10

   Puzzle docs confirm chart-of-accounts customization via bulk CSV upload/edit and a flexible Classes dimension with unlimited groups, supporting tag/class-based segmentation. However there's no explicit evidence of configuring account types or creating sub-accounts within the CoA structure. Missing for 10: explicit sub-account hierarchy support, account-type customization details, independent/hands-on corroboration.

   • [claimed-docs] “If you need to bulk add or edit your Chart of Accounts in Puzzle, you can do so by uploading a CSV file directly from your Company Settings.”
   • [claimed-docs] “a user can create an unlimited number of Groups for Classes”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot is a done-for-you bookkeeping/accounting service, so ledger customization is a fair question, but the evidence pack only mentions generic 'custom workflows and reporting' with no mention of chart of accounts structure, account types, sub-accounts, or class/tag dimensions. Missing for 10: any documentation of COA setup, account type hierarchy, sub-account creation, or class/tag dimension tagging controlled by the accountant.

   • [claimed-docs] “Custom workflows and reporting”

   proof ↗⚑ flag

Journal entries

1. accountantPost manual journal entries with balanced debits, credits, and supporting memos

   weight 3 · round to Puzzle
   Puzzle~partialclaimed7/10

   Puzzle explicitly supports posting manual journal entries, including bulk CSV import for multiple entries and automatic reversing entries when editing an existing entry, indicating standard double-entry JE functionality with edit history. However, there is no explicit documentation confirming enforced debit/credit balancing validation or a dedicated memo/notes field on entries. missing for 10: explicit debit=credit validation, documented memo/description field support.

   • [claimed-docs] “Puzzle automatically creates a voiding (reversing) journal entry for the original and posts a new entry reflecting your changes.”
   • [claimed-docs] “Puzzle automatically creates a voiding (reversing) journal entry for the original and posts a new entry reflecting your changes”
   • [claimed-docs] “Need to post more than one manual journal entry at a time? Instead of adding them one by one, you can upload a batch of entries all at once …”
   • [claimed-docs] “If you need to bulk add or edit your Chart of Accounts in Puzzle, you can do so by uploading a CSV file directly from your Company Settings.”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence describes a done-for-you bookkeeping/CFO service built on QuickBooks with dedicated experts handling books, but there is no mention of any interface for accountants to post manual journal entries with debits/credits and memos. Missing for 10: any UI or workflow for manual JE creation, debit/credit balancing, or memo attachment.

   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”

   proof ↗⚑ flag

Ai audit

1. ai-native userHave an agent monitor the ledger and flag anomalies in spend or duplicate transactions before the close

   weight 3 · round to Puzzle
   Puzzle✓fullclaimed7/10

   Puzzle's AI Close feature explicitly uses AI agents to 'reconcile accounts, review transactions, and surface discrepancies' as part of the month-end close workflow, directly matching the anomaly-flagging story, and reconciliation docs confirm matching transactions against bank statements to catch mismatches. Missing for 10: explicit mention of duplicate-transaction detection specifically, and independent/hands-on corroboration beyond vendor docs.

   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “AI Close helps you automate and accelerate your month-end process using AI agents to reconcile accounts, review transactions, and surface di…”
   • [claimed-docs] “Month-End close with AI Close”
   • [claimed-docs] “performing a reconciliation is the best way to ensure every single transaction is accounted for and matches your bank statement exactly—givi…”

   proof ↗⚑ flag

   Pilot—none0/10

   Pilot's evidence covers bookkeeping, tax, CFO services, and AI Q&A on transactions, but there is no mention of an autonomous agent that monitors the ledger, flags spend anomalies, or detects duplicate transactions before close. missing for 10: anomaly-detection feature, duplicate-transaction flagging, any agentic monitoring capability, pre-close audit workflow evidence.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Track company expenses in real time Find the $2,000/month you didn't know you were wasting.”
   • [claimed-docs] “Communicate directly with your team through our user-friendly portal, where you can ask questions and provide feedback on any outstanding it…”

   proof ↗⚑ flag

Audit trail

1. accountantSee a complete audit trail of who changed what and when across the entire ledger

   weight 3 · round drawn
   Puzzle—none0/10

   No evidence describes an audit trail, change log, or user-attributed history of edits across the ledger. The closest related item (docs-31/35) only shows that editing a journal entry creates a reversing entry rather than in-place edits, which is not the same as a queryable audit trail of who changed what and when.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack describes any audit trail, change history, or user-activity logging feature within Pilot's platform; the material focuses on bookkeeping services, integrations, CFO advisory, and tax credits. Missing for 10: any mention of audit logs, change tracking, user attribution, or timestamped edit history across the ledger.

   ⚑ flag

Multi entity

1. accountantManage multiple legal entities and produce consolidated financials across them

   weight 2 · round to Puzzle
   Puzzle~partialclaimed5/10

   Puzzle explicitly supports managing multiple companies/entities under one login, and documents a Joiin integration specifically for 'Multi-Entity Reporting', showing entity management and a path to consolidated reporting exist. However, true consolidated financials appear to require a third-party integration (Joiin) rather than a native consolidation engine, and there's no evidence of native cross-entity elimination, intercompany accounting, or a built-in consolidated financial statement generator. Missing for 10: native consolidation/elimination features, evidence of intercompany transaction handling, and independent confirmation the Joiin integration fully satisfies audit-grade consolidated reporting.

   • [claimed-docs] “Puzzle supports managing multiple companies (entities) under one login.”
   • [claimed-docs] “Puzzle supports managing **multiple companies (entities)** under one login.”
   • [claimed-docs] “Puzzle + Joiin Integration: Multi-Entity Reporting”

   proof ↗⚑ flag

   Pilot~partialclaimed4/10

   Pilot's FAQ mentions it can provide consolidated reporting for US entities with foreign subsidiaries, but there is no evidence of multi-entity management for domestic entities, no detail on consolidation methodology, and no independent/hands-on corroboration of this feature. missing for 10: multi-entity dashboard/management capability, domestic multi-entity consolidation support, detailed consolidation workflow, independent verification.

   • [claimed-docs] “We can also provide US entities with foreign subsidiaries with consolidated reporting.”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Puzzle
   Puzzle~partialprobed3/10

   Puzzle exposes an API for embedded accounting and bookkeeping data (puzzle-docs-1, puzzle-docs-42) plus CSV/journal bulk import tools, but there is no documentation claiming or demonstrating that every UI action (invoicing, reconciliation, categorization rules, AI Close workflows) is exposed via the API, and a probe for an OpenAPI/swagger spec returned 404s, suggesting the API surface is not fully public or documented. missing for 10: explicit API-UI parity documentation, public OpenAPI spec, evidence of invoice creation/reconciliation/AI Close being API-accessible.

   • [claimed-docs] “With Puzzle's Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”
   • [claimed-docs] “Need to post more than one manual journal entry at a time? Instead of adding them one by one, you can upload a batch of entries all at once …”
   • [claimed-docs] “If you need to bulk add or edit your Chart of Accounts in Puzzle, you can do so by uploading a CSV file directly from your Company Settings.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://help.puzzle.io/openapi.json, https://help.puzzle.io/swagger.json, https://help.puzzle.io/api…”

   proof ↗⚑ flag

   Pilot—none0/10

   No evidence of any public API for Pilot; probes for OpenAPI/swagger endpoints all returned 404, and all documentation describes only the human portal/UI and service offerings. missing for 10: any documented API, API parity claims, or developer endpoints.

   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to Puzzle
   Puzzle~partialclaimed7/10

   Puzzle documents exporting a full general ledger and financial statements in open formats (Excel, CSV, PDF) for both cash and accrual basis, which supports the core 'export and leave' requirement for financial data. missing for 10: evidence of exporting full account configuration/rules/invoice templates/all metadata, independent user corroboration of the export process, and no explicit data-portability/deletion guarantee.

   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats”
   • [claimed-docs] “Yes, you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”

   proof ↗⚑ flag

   Pilot—none0/10

   While Pilot mentions QuickBooks compatibility and tax-preparer portability, there is no evidence of a dedicated data export feature, open-format export (CSV/JSON/API), or a documented process to fully extract and leave with all financial data; probes even show no public API/OpenAPI spec.

   • [claimed-docs] “Keep your existing QuickBooks account and historical data”
   • [claimed-docs] “Virtually every tax preparer in the US knows how to work with QuickBooks. You’ll have the freedom to choose any tax preparer you want.”
   • [probe] “PROBE docs-md: HTTP 404 at https://pilot.com/faq.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   Puzzle—none0/10

   No evidence pack item mentions data residency, regional storage options, or any control over where customer data is hosted; Puzzle is an accounting SaaS and this is a fair question for a data platform, but nothing documents such a capability.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack addresses data residency, region selection, or storage location controls; Pilot is an accounting/bookkeeping service with no mention of infrastructure or data-residency options. Missing for 10: any documentation of data storage regions, residency guarantees, or configurable data location.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   Puzzle—none0/10

   No evidence in the pack addresses data-training opt-out, privacy policy commitments, or AI model training exclusions for Puzzle's data; the evidence only covers accounting/AI-bookkeeping features.

   ⚑ flag

   Pilot—none0/10

   Pilot is an accounting/bookkeeping service; the evidence pack contains no privacy policy statements, opt-out controls, or AI-training data usage terms addressing whether customer financial data is used to train AI models. This is a fair question given Pilot advertises 'AI answers' features, but no evidence confirms any data-training opt-out or exclusion mechanism. Missing for 10: privacy policy/ToS language on AI training data usage, an opt-out mechanism, or any statement on data handling for AI features.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”

   proof ↗⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   Puzzle—none0/10

   No evidence pack items address data retention policies, deletion controls, or data lifecycle management for user/financial data; the evidence covers accounting features, AI Close, exports, and MCP integration but nothing on retention/deletion controls.

   ⚑ flag

   Pilot—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy settings for Pilot's AI features or data; the pack only covers accounting, bookkeeping, and tax service offerings. Missing for 10: any documentation of data retention/deletion controls, privacy settings, or data handling policies for AI or customer data.

   ⚑ flag

Ai insights

1. ai-native userAsk an agent "can we afford X?" and get an answer grounded in live ledger data pulled through the API

   weight 3 · round to Puzzle
   Puzzle✓fullclaimed7/10

   Puzzle's MCP integration explicitly connects an AI agent (Claude) to live financial data 'through natural conversation—no exports, no copy-pasting,' and Puzzle's broader API/AI messaging promotes asking plain-English questions like 'Am I ready to raise?' or 'Which months am I actually profitable?' grounded in the ledger. This directly matches the ai-native 'can we afford X' use case backed by live API data. Missing for 10: independent/hands-on verification of accuracy for financial affordability queries, and no explicit example matching the exact 'can we afford X' phrasing.

   • [claimed-docs] “Puzzle's MCP (Model Context Protocol) integration lets you connect your Puzzle account directly to Claude, giving you instant access to your…”
   • [claimed-docs] “lets you connect your Puzzle account directly to Claude, giving you instant access to your financial data through natural conversation — no …”
   • [claimed-docs] “Ask anything about your business, instantly, in plain English. "How's my cash trending?" "Am I ready to raise?" "Which months am I actually …”
   • [claimed-docs] “With Puzzle's Embedded Accounting—powered by our API, your platform gets automated AI bookkeeping, real-time financial insights, and a clean…”
   • [claimed-docs] “Our API was originally architected for deep platform-to-platform integrations.”

   proof ↗⚑ flag

   Pilot~partialprobed4/10

   Pilot advertises an in-app AI feature offering 'Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead,' which aligns with the 'can we afford X' query use case, but there is no evidence this is exposed via an API for external agents to query — the openapi probe returned 404s and no API/agent-integration docs exist. missing for 10: evidence of a public API/endpoint an external AI agent could call, documentation of grounding in live ledger data via API, and any independent confirmation the AI answer feature works as described.

   • [claimed-docs] “Instant AI answers about past transactions and current cash flow, plus run scenarios to plan ahead”
   • [claimed-docs] “Model cash flow scenarios Know if you can afford new hires well before you make the offers.”
   • [claimed-docs] “Know if you can afford new hires well before you make the offers.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://pilot.com/openapi.json, https://pilot.com/swagger.json, https://pilot.com/api/openapi.json, …”

   proof ↗⚑ flag

Custom reports

1. accountantBuild custom reports filtered and grouped by class, location, or tag dimensions

   weight 2 · round to Puzzle
   Puzzle~partialclaimed5/10

   Puzzle supports Classes with Groups (puzzle-docs-36) and general ledger/financial statement export in cash or accrual basis (puzzle-docs-26/37/45), plus multi-entity management (puzzle-docs-38/44), but there is no direct evidence of a custom report builder that lets accountants filter/group specifically by class, location, or tag dimensions together. missing for 10: explicit custom report builder UI, evidence of 'location' and 'tag' dimensions (only 'class' is documented), and confirmation that reports can be filtered/grouped by these dimensions simultaneously.

   • [claimed-docs] “a user can create an unlimited number of Groups for Classes”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats”
   • [claimed-docs] “Yes, you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “Puzzle supports managing multiple companies (entities) under one login.”

   proof ↗⚑ flag

   Pilot—none0/10

   Evidence only mentions generic 'custom workflows and reporting' (pilot-docs-10) with no mention of class, location, or tag dimension filtering/grouping capabilities typical of QuickBooks-style reports; missing for 10: any documentation of dimension-based (class/location/tag) filtering or grouping in reports.

   • [claimed-docs] “Custom workflows and reporting”

   proof ↗⚑ flag

Statements

1. founderGenerate an accurate P&L, balance sheet, and cash-flow statement for any period on demand

   weight 3 · round to Puzzle
   Puzzle✓fullclaimed7/10

   Puzzle explicitly supports generating and exporting full general ledger and financial statements (cash or accrual basis) in Excel/CSV/PDF on demand, plus real-time reporting and startup metrics like ARR/burn/runway, which directly serves the founder's need for on-demand P&L/balance sheet/cash-flow reporting. Missing for 10: explicit naming of 'balance sheet' and 'cash-flow statement' as distinct statement types, and independent/hands-on verification of statement accuracy beyond vendor docs.

   • [claimed-docs] “Get real-time financial reports with one click”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats”
   • [claimed-docs] “Yes, you can export a full general ledger and financial statements on either cash or accrual basis in excel, csv, and pdf formats.”
   • [claimed-docs] “Cash **_and_** accrual accounting”
   • [claimed-docs] “Instantly see startup metrics like ARR, burn, & runway”

   proof ↗⚑ flag

   Pilot~partialcommunity5/10

   Pilot's bookkeeping and CFO service pages reference real-time account data, custom workflows/reporting, and budget-vs-actuals/scenario planning, implying standard financial statements are produced as part of monthly bookkeeping, and community reviews confirm books are kept accurate and up to date. However, no evidence explicitly confirms generation of a P&L, balance sheet, and cash-flow statement for any arbitrary period on demand. Missing for 10: explicit documentation of the three core statements, confirmation of on-demand/any-period generation (vs. standard monthly close), and independent verification of statement accuracy/timeliness.

   • [claimed-docs] “Custom workflows and reporting”
   • [claimed-docs] “stay up to date with real time account data directly in the portal”
   • [claimed-docs] “Custom financial model with strategic insights Budget vs actuals variance analysis Scenario planning model”
   • [claimed-docs] “Plus stay up to date with real time account data directly in the portal.”
   • [community] “I'm a Pilot customer... Pilot basically solved that problem. I just do my normal business and their integrations with my banks, expensify, c…”
   • [community] “Pilot customer here; they are amazing. It's pretty different from a regular bookkeeper largely in that Pilot is super accurate and timely. M…”

   proof ↗⚑ flag