AI Customer Support Agents arenaAI Customer Support Agents
AI customer support agents — autonomous agents that resolve customer conversations end-to-end, the first agent category with real enterprise revenue and auditable resolution-rate claims — judged on knowledge grounding (help-center/docs/past-ticket ingestion with cited answers and auto-sync), genuine end-to-end resolution versus mere deflection, personalized answers from live customer data, safe escalation and human handoff with full context, channel and language coverage (chat, email, voice, Slack, WhatsApp), real API actions like refunds and account changes, procedure/SOP builders, hallucination guardrails and supervised modes, pre-launch simulation testing and ongoing QA, resolution analytics, helpdesk-platform integrations, and outcome-based per-resolution pricing. The arena where "resolution rate" marketing meets the evidence standard: vendors are judged on what their agents verifiably do, not what their case studies claim.
53 user stories · 318 judged cells · updated 2026-09-16 · Evidence as of 2026-09-16
Leaderboard — every product ranked by evidenceLeaderboard
Rank by
| 1 | Lorikeet usage-based vs Pylon ↗ | 40/100 | 68/100 | 6/100 | 10/100 | 39/100 | npm 5.4k/wk | 5/36 verified | 0/100 integrity | ||
| 2 | Pylon subscription-per-seat vs Lorikeet ↗ | 51/100 | 51/100 | 3/100 | 9/100 | 38/100 | 11/34 verified | 21/100 integrity | |||
| 3 | Parahelp usage-based vs Lorikeet ↗ | 24/100 | 65/100 | 4/100 | 12/100 | 61/100 | 4/31 verified | 13/100 integrity | |||
| 4 | Fin usage-based vs Lorikeet ↗ | 50/100 | 51/100 | 3/100 | 17/100 | 18/100 | ★ 390▲ 33/yrnpm 246.6k/wkpypi 62.6k/wk | 11/39 verified | 21/100 integrity | ||
| 5 | Sierra usage-based vs Lorikeet ↗ | 10/100 | 53/100 | 4/100 | 0/100 | 15/100 | 14/29 verified | 36/100 integrity | |||
| 6 | Decagon enterprise-custom vs Lorikeet ↗ | 9/100 | 44/100 | 4/100 | 0/100 | 14/100 | npm 40/wk | 1/30 verified | 0/100 integrity |
Best by user type — persona-weighted winnersBest by user type
Per persona, the product with the highest persona-weighted coverage over just that persona's stories — not the same ranking as the overall PA Score leaderboard above.
Story matrix — every product × every judged storyStory matrix
53/53 stories shown · legend
Agent actions — stories about agent actions in this arenaAgent actions
Actions
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Agent actions — stories about agent actions in this arenaThe agent takes real actions through my APIs — refunds, order changes, subscription updates — with scoped auth per action | developer | partialC 6/10 | partialC 6/10 | partialX 5/10 | partialT⚿ 5/10 | fullC 7/10 | fullC 7/10 |
Procedures
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Agent actions — stories about agent actions in this arenaI encode standard operating procedures the agent follows step-by-step for known issue types, with deterministic branching | support-ops | fullC 8/10 | fullC 7/10 | fullX 8/10 | partialC 6/10 | fullC 7/10 | partialC 6/10 |
Agenticness — how well agents can access and operate the productAgenticness
Agent access
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Agenticness — how well agents can access and operate the productPoint an agent at llms.txt or agent-oriented docs | ai-native | fullT 8/10 | partialT 6/10 | none 0/10 | fullT 8/10 | fullT 9/10 | fullT 9/10 |
| Agenticness — how well agents can access and operate the productRun the product headlessly / in CI for automation | ai-native | partialC 6/10 | none 0/10 | partialT 4/10 | partialT⚿ 5/10 | n/a | partialT 7/10 |
| Agenticness — how well agents can access and operate the productPlug MCP servers into this product so it can use their tools | ai-native | fullC 7/10 | partialC 3/10 | none 0/10 | partialC 5/10 | partialC 5/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productConnect an agent via an official MCP server | ai-native | fullT 8/10 | none 0/10 | n/a | fullT⚿ 9/10 | fullT 7/10 | n/a |
| Agenticness — how well agents can access and operate the productUse an official CLI | ai-native | none 0/10 | n/a | none 0/10 | none 0/10 | none 0/10 | n/a |
| Agenticness — how well agents can access and operate the productDrive the product through a documented public API | ai-native | partialT 7/10 | none 0/10 | partialT 4/10 | fullT⚿ 8/10 | fullT 8/10 | partialT 7/10 |
| Agenticness — how well agents can access and operate the productIssue scoped/least-privilege API credentials for an agent | ai-native | none 0/10 | partialC 4/10 | none 0/10 | partialT⚿ 4/10 | partialC 3/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productBuild against official SDKs | ai-native | partialT 6/10 | none 0/10 | partialT 5/10 | partialT⚿ 6/10 | none 0/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productSubscribe to events via webhooks | ai-native | fullC 8/10 | none 0/10 | none 0/10 | fullC 7/10 | none 0/10 | none 0/10 |
Agentic features
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Agenticness — how well agents can access and operate the productGet AI-generated insights and suggestions from my data inside the product | ai-native | partialC 6/10 | fullC 8/10 | fullX 8/10 | partialC 6/10 | fullC 8/10 | partialC 6/10 |
| Agenticness — how well agents can access and operate the productSet up automations that run autonomously in the background | ai-native | partialX 6/10 | partialC 6/10 | partialX 6/10 | partialC 6/10 | partialC 7/10 | fullC 8/10 |
| Agenticness — how well agents can access and operate the productDelegate tasks to a built-in AI assistant inside the product | ai-native | fullX 8/10 | partialC 5/10 | partialC 6/10 | fullC 8/10 | fullC 7/10 | fullC 7/10 |
| Agenticness — how well agents can access and operate the productOperate the product with natural-language commands | ai-native | partialC 6/10 | partialC 6/10 | fullX 7/10 | partialT⚿ 6/10 | fullT 8/10 | fullC 7/10 |
Api quality
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Agenticness — how well agents can access and operate the productExplore an interactive API reference with runnable examples | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | n/a | none 0/10 |
| Agenticness — how well agents can access and operate the productDownload a machine-readable API spec (OpenAPI or equivalent) | ai-native | none 0/10 | none 0/10 | none 0/10 | none⚿ 0/10 | none 0/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productTest against a sandbox environment without touching production data | ai-native | partialC 4/10 | partialC 5/10 | partialC 5/10 | partialC 3/10 | partialC 5/10 | partialC 5/10 |
| Agenticness — how well agents can access and operate the productRely on versioned APIs with a documented deprecation policy | ai-native | none 0/10 | none 0/10 | none 0/10 | none⚿ 0/10 | none 0/10 | none 0/10 |
Automation depth — how much of the product can run unattendedAutomation depth
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Automation depth — how much of the product can run unattendedPerform bulk operations across many items at once | ai-native | partialC 3/10 | none 0/10 | none 0/10 | partialT⚿ 5/10 | fullC 7/10 | partialC 4/10 |
| Automation depth — how much of the product can run unattendedDefine rules that trigger actions automatically on events | ai-native | partialC 6/10 | partialC 5/10 | partialC 5/10 | fullT⚿ 8/10 | partialC 6/10 | fullC 8/10 |
| Automation depth — how much of the product can run unattendedSchedule recurring jobs or workflows | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | partialC 3/10 | fullC 8/10 |
| Automation depth — how much of the product can run unattendedVersion, review, and roll back my automations | ai-native | none 0/10 | partialC 4/10 | partialT 5/10 | none 0/10 | partialC 4/10 | partialC 6/10 |
Channels languages — stories about channels languages in this arenaChannels languages
Channels
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Channels languages — stories about channels languages in this arenaOne agent covers chat, email, and in-app, plus the channels my customers actually use — Slack, WhatsApp, social | support-leader | fullC 7/10 | partialC 5/10 | partialC 5/10 | partialC 5/10 | partialC 6/10 | partialC 5/10 |
Languages
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Channels languages — stories about channels languages in this arenaThe agent supports customers in many languages, even where my knowledge base exists only in English | support-leader | fullC 7/10 | partialC 4/10 | partialC 6/10 | none 0/10 | none 0/10 | none 0/10 |
Voice
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Channels languages — stories about channels languages in this arenaThe agent handles phone calls — speech in, speech out — with the same knowledge and actions as chat | support-leader | fullC 7/10 | partialC 6/10 | fullC 8/10 | none 0/10 | partialC 4/10 | none 0/10 |
Escalation handoff — stories about escalation handoff in this arenaEscalation handoff
Handoff
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Escalation handoff — stories about escalation handoff in this arenaWhen the agent escalates, the human gets the full conversation, a summary, and collected details — the customer never repeats themselves | support-leader | partialC 6/10 | none 0/10 | partialC 6/10 | partialC 5/10 | partialC 6/10 | partialC 5/10 |
Rules
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Escalation handoff — stories about escalation handoff in this arenaI configure when the agent must hand off — by topic, sentiment, customer tier, or explicit request — and it reliably obeys | support-ops | partialC 6/10 | partialC 4/10 | partialC 3/10 | partialC 4/10 | partialC 5/10 | partialC 6/10 |
Guardrails safety — stories about guardrails safety in this arenaGuardrails safety
Hallucination
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Guardrails safety — stories about guardrails safety in this arenaGuardrails stop the agent from inventing policies, prices, or promises — off-knowledge questions get a safe decline, not a guess | ai-native | partialC 6/10 | partialC 4/10 | partialC 4/10 | partialC 3/10 | fullC 8/10 | partialC 4/10 |
Supervision
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Guardrails safety — stories about guardrails safety in this arenaLaunch in a supervised mode where the agent drafts replies for human approval before anything reaches a customer | support-ops | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 | fullC 8/10 |
Topic controls
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Guardrails safety — stories about guardrails safety in this arenaI mark topics as human-only — legal threats, cancellations, security — and the agent never freelances on them | support-ops | partialC 6/10 | partialC 5/10 | none 0/10 | partialC 4/10 | partialC 5/10 | partialC 6/10 |
Insights analytics — stories about insights analytics in this arenaInsights analytics
Analytics
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Insights analytics — stories about insights analytics in this arenaDashboards show resolution rate, CSAT, handoff rate, and cost per resolution — the numbers I report to my exec team | support-leader | partialC 4/10 | partialC 5/10 | partialC 5/10 | partialC 5/10 | partialC 5/10 | none 0/10 |
Insights
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Insights analytics — stories about insights analytics in this arenaThe platform clusters conversations by topic and surfaces emerging product issues before they spike ticket volume | support-leader | partialC 6/10 | partialC 7/10 | partialC 6/10 | none 0/10 | none 0/10 | none 0/10 |
Integrations platform — stories about integrations platform in this arenaIntegrations platform
Helpdesk
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Integrations platform — stories about integrations platform in this arenaThe agent runs inside my existing helpdesk — Zendesk, Salesforce, Intercom — or standalone, syncing tickets and context both ways | developer | fullC 8/10 | partialC 4/10 | none 0/10 | partialC 3/10 | partialC 5/10 | fullC 8/10 |
Knowledge grounding — stories about knowledge grounding in this arenaKnowledge grounding
Freshness
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Knowledge grounding — stories about knowledge grounding in this arenaKnowledge stays current automatically — the agent re-syncs sources on a schedule or on change, not via manual re-uploads | support-ops | partialC 5/10 | none 0/10 | none 0/10 | partialC 4/10 | none 0/10 | partialC 3/10 |
Gaps
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Knowledge grounding — stories about knowledge grounding in this arenaThe platform surfaces knowledge gaps and conflicting content that cause the agent to miss or fumble questions | support-ops | partialC 4/10 | fullC 7/10 | partialC 5/10 | none 0/10 | fullC 8/10 | partialC 6/10 |
Grounding
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Knowledge grounding — stories about knowledge grounding in this arenaEvery answer is grounded in my own content and shows which article or source it drew from | ai-native | partialC 5/10 | none 0/10 | fullC 7/10 | partialC 5/10 | none 0/10 | none 0/10 |
Ingestion
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Knowledge grounding — stories about knowledge grounding in this arenaThe agent ingests my help center, docs, past tickets, and internal wikis as knowledge sources without manual re-authoring | support-ops | fullC 8/10 | partialC 4/10 | partialT 6/10 | partialC 5/10 | fullC 7/10 | partialC 5/10 |
Openness — open source, data portability, and self-hosting storiesOpenness
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Openness — open source, data portability, and self-hosting storiesDo everything through the API that I can do in the UI | ai-native | partialT 4/10 | none 0/10 | none 0/10 | partialT⚿ 5/10 | partialT 6/10 | partialT 5/10 |
| Openness — open source, data portability, and self-hosting storiesExport all of my data in open formats and leave | ai-native | partialC 2/10 | none 0/10 | none 0/10 | none⚿ 0/10 | none 0/10 | none 0/10 |
| Openness — open source, data portability, and self-hosting storiesRead the product's source under an open license | ai-native | n/a | n/a | none 0/10 | none 0/10 | none 0/10 | n/a |
| Openness — open source, data portability, and self-hosting storiesSelf-host the core product | ai-native | n/a | n/a | none 0/10 | n/a⚿ | n/a | n/a |
Pricing economics — stories about pricing economics in this arenaPricing economics
Pricing
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Pricing economics — stories about pricing economics in this arenaPricing is outcome-based and published — I pay per resolution with caps and controls, not an opaque enterprise quote | support-leader | partialX 4/10 | none 0/10 | none 0/10 | none 0/10 | partialC 3/10 | none 0/10 |
Privacy posture — data-handling and privacy storiesPrivacy posture
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Privacy posture — data-handling and privacy storiesChoose where my data is stored (region/residency) | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
| Privacy posture — data-handling and privacy storiesPrevent my data from being used to train AI models | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | fullC 7/10 | partialC 4/10 |
| Privacy posture — data-handling and privacy storiesControl data retention and deletion | ai-native | none 0/10 | partialC 3/10 | none 0/10 | none 0/10 | partialC 4/10 | partialC 6/10 |
| Privacy posture — data-handling and privacy storiesOpt out of telemetry and usage tracking | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
Resolution quality — stories about resolution quality in this arenaResolution quality
Personalization
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Resolution quality — stories about resolution quality in this arenaAnswers use the customer's live data — plan, order status, account history — not just generic help articles | support-leader | fullT 7/10 | partialC 6/10 | partialX 7/10 | partialC 6/10 | fullC 7/10 | partialC 6/10 |
Reasoning
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Resolution quality — stories about resolution quality in this arenaThe agent asks clarifying questions and works through multi-step troubleshooting instead of dumping one canned answer | support-leader | partialX 6/10 | partialC 5/10 | partialX 6/10 | partialC 5/10 | partialC 6/10 | none 0/10 |
Resolution
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Resolution quality — stories about resolution quality in this arenaThe agent fully resolves a meaningful share of conversations end-to-end — measured as resolutions, not mere deflections or bounces | support-leader | fullX 7/10 | partialC 4/10 | partialT 6/10 | partialC 3/10 | partialC 6/10 | partialC 3/10 |
Voice
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Resolution quality — stories about resolution quality in this arenaI control the agent's tone and brand voice, and it stays consistent across topics and languages | support-leader | partialC 6/10 | partialC 7/10 | partialC 7/10 | partialC 3/10 | partialC 6/10 | none 0/10 |
Testing qa — stories about testing qa in this arenaTesting qa
Qa
| Story | Persona | Fin | Decagon | Sierra | Pylon | Lorikeet | Parahelp |
|---|---|---|---|---|---|---|---|
| Testing qa — stories about testing qa in this arenaAI conversations get ongoing QA — scored samples, flagged failures, and a review loop that feeds fixes back into the agent | support-ops | fullC 7/10 | fullC 8/10 | partialC 7/10 | partialC 5/10 | fullC 8/10 | partialC 5/10 |
Verdict✓ fullclear evidence~ partialwith caveats! disputedevidence conflicts— noneno evidence foundn/aquestion doesn't apply to this kind of product
ProofT probedtested by usX communityusers back itC claimedvendor claim onlyD contradictedevidence disagrees⚿ auth-gatedprobe hit a live sign-in wall — verified reachable, untestable keylessly
quality 0–10 · PA Score /100 · A–D = evidence confidence · full guideAdjacent arenas — categories often shopped togetherAdjacent arenas
Shopping this category often means shopping these too.