Skip to content

How Cekura’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score36/100

Agent-ready 58.0 × 0.30 = 17.40

API quality 36.9 × 0.20 = 7.38

Openness 8.4 × 0.20 = 1.68

Built-in AI 24.0 × 0.15 = 3.60

Automation 42.3 × 0.15 = 6.34

(17.40 + 7.38 + 1.68 + 3.60 + 6.34) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 36.40 ÷ 1.00 = 36.4

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready58.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.cekura.ai/llms.txtPROBE llms.txt: HTTP 200 at https://docs.cekura.ai/llms.txt # Cekura > Cekura is the testing and observability platform for voice AI agents. Run simulated conversations, evaluate
  • [probe] https://docs.cekura.ai/documentation/introduction.mdPROBE docs-md: HTTP 200 at https://docs.cekura.ai/documentation/introduction.md > ## Documentation Index > Fetch the complete documentation index at: https://docs.cekura.ai/llms.txt > Use this file to
  • [claimed-docs] https://docs.cekura.ai/documentation/introductioncreate a comprehensive plan to integrate cekura observability

Run the product headlessly / in CI for automationweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/sdk.mdProgrammatic access to Cekura — sync and async clients for application code
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/cronjob.mdLearn how to set up and manage automated cron jobs for your AI agent testing and evaluation workflows.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/github-actions-ci-cd.mdLearn how to set up GitHub Actions workflows to automatically test your agents with each change
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.
  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [probe] https://docs.cekura.ai/cli-sdk/cliofficial CLI documented at https://docs.cekura.ai/cli-sdk/cli

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.cekura.ai/mcp/overview.mdInstall Cekura Skills and MCP so your AI assistant can design, run, and improve voice-agent evaluations.
  • [probe] https://docs.cekura.ai/mcp/overviewofficial MCP server documented at https://docs.cekura.ai/mcp/overview

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.cekura.ai/mcp/overview.mdInstall Cekura Skills and MCP so your AI assistant can design, run, and improve voice-agent evaluations.
  • [probe] https://docs.cekura.ai/mcp/overviewofficial MCP server documented at https://docs.cekura.ai/mcp/overview

Use an official CLIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [probe] https://docs.cekura.ai/cli-sdk/cliofficial CLI documented at https://docs.cekura.ai/cli-sdk/cli

Drive the product through a documented public APIweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/sdk.mdProgrammatic access to Cekura — sync and async clients for application code
  • [claimed-docs] https://docs.cekura.ai/api-reference/observability/send-calls.mdYour agent (or its provider's post-call webhook) POSTs here with the transcript, recording URL, and metadata; Cekura stores it as a `CallLog`, schedules metric evaluation
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [probe] https://docs.cekura.ai/cli-sdk/cliofficial CLI documented at https://docs.cekura.ai/cli-sdk/cli

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/sdk.mdProgrammatic access to Cekura — sync and async clients for application code
  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [probe] https://docs.cekura.ai/cli-sdk/cliofficial CLI documented at https://docs.cekura.ai/cli-sdk/cli
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.cekura.ai/api-reference/observability/send-calls.mdYour agent (or its provider's post-call webhook) POSTs here with the transcript, recording URL, and metadata; Cekura stores it as a `CallLog`, schedules metric evaluation

Agent-ready = 121.8 ÷ 210 × 100 = 58.0

API quality36.9/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.cekura.ai/api-reference/observability/send-calls.mdYour agent (or its provider's post-call webhook) POSTs here with the transcript, recording URL, and metadata; Cekura stores it as a `CallLog`, schedules metric evaluation
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.cekura.ai/api-reference/observability/send-calls.mdYour agent (or its provider's post-call webhook) POSTs here with the transcript, recording URL, and metadata; Cekura stores it as a `CallLog`, schedules metric evaluation
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max

  • [claimed-docs] https://docs.cekura.ai/documentation/guides/testing-agents/overview.mdLearn how to quickly create and test voice agents on Cekura without requiring any external API keys or integrations.
  • [claimed-docs] https://www.cekura.aiRun thousands of synthetic conversations before go-live.
  • [claimed-docs] https://www.cekura.aiRun the same scenarios across platforms and models. Pick the one that actually performs.

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.

API quality = 25.8 ÷ 70 × 100 = 36.9

Openness8.4/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/sdk.mdProgrammatic access to Cekura — sync and async clients for application code
  • [claimed-docs] https://docs.cekura.ai/api-reference/observability/send-calls.mdYour agent (or its provider's post-call webhook) POSTs here with the transcript, recording URL, and metadata; Cekura stores it as a `CallLog`, schedules metric evaluation
  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.
  • [probe] https://docs.cekura.ai/openapi.jsonPROBE openapi: HTTP 200 at https://docs.cekura.ai/openapi.json — contains "openapi" key
  • [probe] https://docs.cekura.ai/cli-sdk/cliofficial CLI documented at https://docs.cekura.ai/cli-sdk/cli
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/dashboards.mdBuild custom dashboards with widgets to visualize and analyze your call data, metrics, and metadata.

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.cekura.ai/api-reference/user/create-api-key.mdCreate a new API key. When using API key authentication, only project-level API keys can be created.
  • [claimed-docs] https://docs.cekura.ai/documentation/introductioncreate a comprehensive plan to integrate cekura observability
  • [probe] https://docs.cekura.ai/llms.txtPROBE llms.txt: HTTP 200 at https://docs.cekura.ai/llms.txt # Cekura > Cekura is the testing and observability platform for voice AI agents. Run simulated conversations, evaluate

Openness = 8.4 ÷ 100 × 100 = 8.4

Built-in AI24.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.cekura.ai/documentation/key-concepts/metrics/llm-judge-metric.mdEvaluate AI voice agent calls using natural language criteria with LLM-powered judging
  • [claimed-docs] https://www.cekura.aiLive drift detection across every call.
  • [claimed-docs] https://www.cekura.aiCekura flags issues → reproduces in simulation → suggests fixes automatically.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/dashboards.mdBuild custom dashboards with widgets to visualize and analyze your call data, metrics, and metadata.

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.cekura.ai/documentation/guides/cronjob.mdLearn how to set up and manage automated cron jobs for your AI agent testing and evaluation workflows.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/github-actions-ci-cd.mdLearn how to set up GitHub Actions workflows to automatically test your agents with each change
  • [claimed-docs] https://www.cekura.aiLive drift detection across every call.
  • [claimed-docs] https://www.cekura.aiCekura flags issues → reproduces in simulation → suggests fixes automatically.
  • [claimed-docs] https://docs.cekura.ai/api-reference/observability/send-calls.mdYour agent (or its provider's post-call webhook) POSTs here with the transcript, recording URL, and metadata; Cekura stores it as a `CallLog`, schedules metric evaluation

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://www.cekura.aiCekura flags issues → reproduces in simulation → suggests fixes automatically.
  • [claimed-docs] https://docs.cekura.ai/mcp/overview.mdInstall Cekura Skills and MCP so your AI assistant can design, run, and improve voice-agent evaluations.
  • [claimed-docs] https://docs.cekura.ai/documentation/introductionnpx skills add cekura-ai/cekura-skills --all

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.cekura.ai/documentation/introductionnpx skills add cekura-ai/cekura-skills --all
  • [claimed-docs] https://docs.cekura.ai/mcp/overview.mdInstall Cekura Skills and MCP so your AI assistant can design, run, and improve voice-agent evaluations.
  • [github] https://github.com/cekura-ai/cekura-skills13 Skills, 14 Commands in one plugin
  • [claimed-docs] https://docs.cekura.ai/documentation/key-concepts/metrics/llm-judge-metric.mdEvaluate AI voice agent calls using natural language criteria with LLM-powered judging
  • [probe] https://docs.cekura.ai/mcp/overviewofficial MCP server documented at https://docs.cekura.ai/mcp/overview

Built-in AI = 21.6 ÷ 90 × 100 = 24.0

Automation42.3/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://www.cekura.aiRun thousands of synthetic conversations before go-live.
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/sdk.mdProgrammatic access to Cekura — sync and async clients for application code
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/cronjob.mdLearn how to set up and manage automated cron jobs for your AI agent testing and evaluation workflows.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/github-actions-ci-cd.mdLearn how to set up GitHub Actions workflows to automatically test your agents with each change

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://docs.cekura.ai/documentation/guides/cronjob.mdLearn how to set up and manage automated cron jobs for your AI agent testing and evaluation workflows.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/github-actions-ci-cd.mdLearn how to set up GitHub Actions workflows to automatically test your agents with each change
  • [claimed-docs] https://www.cekura.aiCekura flags issues → reproduces in simulation → suggests fixes automatically.
  • [claimed-docs] https://www.cekura.aiLive drift detection across every call.

Schedule recurring jobs or workflowsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.cekura.ai/documentation/guides/cronjob.mdLearn how to set up and manage automated cron jobs for your AI agent testing and evaluation workflows.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/github-actions-ci-cd.mdLearn how to set up GitHub Actions workflows to automatically test your agents with each change
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/cli.mdManage agents, scenarios, runs, and call data from your terminal
  • [claimed-docs] https://docs.cekura.ai/cli-sdk/sdk.mdProgrammatic access to Cekura — sync and async clients for application code

Version, review, and roll back my automationsweight 1

1 (weight) × 3 (quality) × 0.6 (partial) = 1.8 of 10 max

  • [claimed-docs] https://docs.cekura.ai/documentation/guides/testing-agents/ab-testing.mdCompare two versions of your agent side-by-side to measure prompt, model, or configuration changes.
  • [claimed-docs] https://docs.cekura.ai/documentation/guides/dashboards.mdBuild custom dashboards with widgets to visualize and analyze your call data, metrics, and metadata.

Automation = 33.8 ÷ 80 × 100 = 42.3