How Temporal’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score43/100
Agent-ready 59.9 × 0.30 = 17.97
API quality 10.0 × 0.20 = 2.00
Openness 55.6 × 0.20 = 11.12
Built-in AI 26.7 × 0.15 = 4.00
Automation 51.0 × 0.15 = 7.65
(17.97 + 2.00 + 11.12 + 4.00 + 7.65) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 42.74 ÷ 1.00 = 42.7
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready59.9/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [probe] https://docs.temporal.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.temporal.io/llms.txt # Temporal Platform Documentation > This file is a structured index of Temporal's documentation, following the llmstxt.”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/ai“a Workflow resumes automatically after a crash, a network timeout, or a multi-day wait for a human to approve a step”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.temporal.io/cli“The CLI includes a local Temporal development service for fast feedback while building or testing your application.”
- [claimed-docs] https://docs.temporal.io/cli/setup-cli“The CLI is available for macOS, Linux, and Windows, or as a Docker image.”
- [github] https://github.com/temporalio/temporal“temporal server start-dev”
- [claimed-docs] https://docs.temporal.io/develop/typescript/testing-suite“Because the test server supports skipping time, use the test server for both end-to-end and integration tests with Workers.”
- [claimed-docs] https://docs.temporal.io/cli“The Temporal CLI (`temporal`) provides direct access to a Temporal Service via the terminal. Use it to manage, monitor, and debug Temporal applications”
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“This starts a complete Temporal Service with Web UI on your local machine.”
Plug MCP servers into this product so it can use their toolsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Connect an agent via an official MCP serverweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Use an official CLIweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.temporal.io/cli“The CLI includes a local Temporal development service for fast feedback while building or testing your application.”
- [claimed-docs] https://docs.temporal.io/cli/setup-cli“The CLI is available for macOS, Linux, and Windows, or as a Docker image.”
- [claimed-docs] https://docs.temporal.io/cli“The Temporal CLI (`temporal`) provides direct access to a Temporal Service via the terminal. Use it to manage, monitor, and debug Temporal applications”
- [claimed-docs] https://docs.temporal.io/cli/batch“Show the progress of an ongoing batch job. Pass a valid job ID to display its information”
- [github] https://github.com/temporalio/temporal“temporal server start-dev”
- [probe] https://docs.temporal.io/cli“official CLI documented at https://docs.temporal.io/cli”
Drive the product through a documented public APIweight 3
3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max
- [claimed-docs] https://docs.temporal.io/encyclopedia/temporal-client.md“Start a Workflow Execution - Get the result of Workflow Execution - List Workflow Executions - Query a Workflow Execution - Signal a Workflow Execution”
- [claimed-docs] https://docs.temporal.io/cli“The Temporal CLI (`temporal`) provides direct access to a Temporal Service via the terminal. Use it to manage, monitor, and debug Temporal applications”
- [claimed-docs] https://docs.temporal.io/develop/typescript“a short walkthrough of how to use the Temporal primitives (Activities, Workflows, and Workers) to build and run a Temporal application”
- [probe] https://docs.temporal.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.temporal.io/llms.txt # Temporal Platform Documentation > This file is a structured index of Temporal's documentation, following the llmstxt.”
- [probe] https://docs.temporal.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.temporal.io/openapi.json, https://docs.temporal.io/swagger.json, https://docs.temporal.io/api/openapi.json, https://docs.temporal.io/.well-known/openapi.json)”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max
- [claimed-docs] https://temporal.io/pricing“99.9% SLA, 99.99% HA options Multi-Cloud & Multi-Region User Roles Service Accounts & API Keys Audit Logging”
- [claimed-docs] https://temporal.io/pricing“User Roles * Service Accounts & API Keys * Audit Logging * Workflow Management * Workflow Availability”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“model calls are executed as Activities, so they retry durably and are not repeated during Workflow replay. Your agents survive Worker restarts and can run for extended periods without losing state.”
- [claimed-docs] https://docs.temporal.io/ai/cookbook“Build a durable agentic loop in Python with Claude tool calling and Temporal.”
Build against official SDKsweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/develop/typescript“a short walkthrough of how to use the Temporal primitives (Activities, Workflows, and Workers) to build and run a Temporal application”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“model calls are executed as Activities, so they retry durably and are not repeated during Workflow replay. Your agents survive Worker restarts and can run for extended periods without losing state.”
- [claimed-docs] https://docs.temporal.io/ai/cookbook“Build a durable agentic loop in Python with Claude tool calling and Temporal.”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“Temporal's integration with the OpenAI Agents SDK for Python lets you run agents as Temporal Workflows.”
- [claimed-docs] https://docs.temporal.io/ai/cookbook“Call an LLM from a durable Temporal Workflow in Python using the OpenAI API library.”
- [claimed-docs] https://docs.temporal.io/activities“An Activity is a normal function or method that executes a single, well-defined action (either short or long running), such as calling another service, transcoding a media file, or sending an email message.”
- [claimed-docs] https://docs.temporal.io/encyclopedia/retry-policies“Temporal's default behavior is to automatically retry an Activity that fails, so transient or intermittent failures require no action on your part.”
Subscribe to events via webhooksweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Agent-ready = 89.8 ÷ 150 × 100 = 59.9
API quality10.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.temporal.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.temporal.io/openapi.json, https://docs.temporal.io/swagger.json, https://docs.temporal.io/api/openapi.json, https://docs.temporal.io/.well-known/openapi.json)”
- [claimed-docs] https://docs.temporal.io/develop/typescript“a short walkthrough of how to use the Temporal primitives (Activities, Workflows, and Workers) to build and run a Temporal application”
- [probe] https://docs.temporal.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.temporal.io/llms.txt # Temporal Platform Documentation > This file is a structured index of Temporal's documentation, following the llmstxt.”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.temporal.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.temporal.io/openapi.json, https://docs.temporal.io/swagger.json, https://docs.temporal.io/api/openapi.json, https://docs.temporal.io/.well-known/openapi.json)”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 7 (quality) × 1.0 (full) = 7.0 of 10 max
- [claimed-docs] https://docs.temporal.io/cli“The CLI includes a local Temporal development service for fast feedback while building or testing your application.”
- [claimed-docs] https://docs.temporal.io/develop/typescript/testing-suite“Because the test server supports skipping time, use the test server for both end-to-end and integration tests with Workers.”
- [claimed-docs] https://docs.temporal.io/develop/typescript/testing-suite“Because the test server supports skipping time, use the t”
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“This starts a complete Temporal Service with Web UI on your local machine.”
- [github] https://github.com/temporalio/temporal“temporal server start-dev”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.temporal.io/worker-versioning“You can declare each Workflow type to have a Versioning Behavior, either Pinned or Auto-Upgrade, in your Workflow config”
- [claimed-docs] https://docs.temporal.io/worker-versioning“This page defines some of the underlying concepts used in Worker Versioning ... Worker Deployments ... Worker Deployment Versions ... Versioning Behaviors”
- [probe] https://docs.temporal.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.temporal.io/openapi.json, https://docs.temporal.io/swagger.json, https://docs.temporal.io/api/openapi.json, https://docs.temporal.io/.well-known/openapi.json)”
API quality = 7.0 ÷ 70 × 100 = 10.0
Openness55.6/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.temporal.io/encyclopedia/temporal-client.md“Start a Workflow Execution - Get the result of Workflow Execution - List Workflow Executions - Query a Workflow Execution - Signal a Workflow Execution”
- [claimed-docs] https://docs.temporal.io/cli“The Temporal CLI (`temporal`) provides direct access to a Temporal Service via the terminal. Use it to manage, monitor, and debug Temporal applications”
- [claimed-docs] https://docs.temporal.io/web-ui“The Temporal Web UI provides users with Workflow Execution state and metadata for debugging purposes.”
- [claimed-docs] https://docs.temporal.io/web-ui“The Temporal Web UI provides users with Workflow Execution state and metadata for debugging purposes. It ships with every Temporal CLI release”
- [probe] https://docs.temporal.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.temporal.io/openapi.json, https://docs.temporal.io/swagger.json, https://docs.temporal.io/api/openapi.json, https://docs.temporal.io/.well-known/openapi.json)”
- [claimed-docs] https://temporal.io/pricing“User Roles * Service Accounts & API Keys * Audit Logging * Workflow Management * Workflow Availability”
Export all of my data in open formats and leaveweight 3
3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“Deployment: Choose a deployment approach (Docker, Kubernetes, or manual) and set up a production-ready Temporal Service.”
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“This starts a complete Temporal Service with Web UI on your local machine.”
- [github] https://github.com/temporalio/temporal“temporal server start-dev”
Read the product's source under an open licenseweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [github] https://github.com/temporalio/temporal“temporal server start-dev”
- [github] https://github.com/temporalio/temporal“Temporal—durable execution platform”
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“This guide shows you how to self-host open source infrastructure software that orchestrates your durable applications.”
Self-host the core productweight 3
3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“This guide shows you how to self-host open source infrastructure software that orchestrates your durable applications.”
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“Deployment: Choose a deployment approach (Docker, Kubernetes, or manual) and set up a production-ready Temporal Service.”
- [claimed-docs] https://docs.temporal.io/self-hosted-guide“This starts a complete Temporal Service with Web UI on your local machine.”
- [github] https://github.com/temporalio/temporal“temporal server start-dev”
- [github] https://github.com/temporalio/temporal“Temporal—durable execution platform”
- [claimed-docs] https://docs.temporal.io/cli/setup-cli“The CLI is available for macOS, Linux, and Windows, or as a Docker image.”
Openness = 55.6 ÷ 100 × 100 = 55.6
Built-in AI26.7/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.temporal.io/web-ui“The Temporal Web UI provides users with Workflow Execution state and metadata for debugging purposes.”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/ai/cookbook“Build a durable agentic loop in Python with Claude tool calling and Temporal.”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.temporal.io/schedule“A Schedule contains instructions for starting a Workflow Execution at specific times.”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/ai“a Workflow resumes automatically after a crash, a network timeout, or a multi-day wait for a human to approve a step”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“model calls are executed as Activities, so they retry durably and are not repeated during Workflow replay. Your agents survive Worker restarts and can run for extended periods without losing state.”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“Temporal's integration with the OpenAI Agents SDK for Python lets you run agents as Temporal Workflows.”
- [claimed-docs] https://docs.temporal.io/ai/cookbook“Build a durable agentic loop in Python with Claude tool calling and Temporal.”
- [claimed-docs] https://docs.temporal.io“Temporal delivers crash-proof execution by guaranteeing that applications resume exactly where they left off after crashes, network failures, or infrastructure outages”
- [claimed-docs] https://docs.temporal.io/encyclopedia/retry-policies“Temporal's default behavior is to automatically retry an Activity that fails, so transient or intermittent failures require no action on your part.”
- [community] https://hn.algolia.com/api/v1/items/40287341“No, the whole point of Temporal is to distribute work across machines without worrying too much about orchestration. You can retry any unit easily on failure and specify non-retryable errors. What it requires in exchange is full determinism. Source: I'm a user since over a year ago.”
- [community] https://hn.algolia.com/api/v1/items/40287341“Temporal is completely above and beyond Asyncio. It's a full scheduling of work and queues that's cross-machine, cross-language, and very transparent. I'm doing a lot of work with alert handling and provisioning systems using Temporal.”
Delegate tasks to a built-in AI assistant inside the productweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Operate the product with natural-language commandsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.temporal.io/cli“The Temporal CLI (`temporal`) provides direct access to a Temporal Service via the terminal. Use it to manage, monitor, and debug Temporal applications”
- [claimed-docs] https://docs.temporal.io/web-ui“The Temporal Web UI provides users with Workflow Execution state and metadata for debugging purposes.”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“model calls are executed as Activities, so they retry durably and are not repeated during Workflow replay. Your agents survive Worker restarts and can run for extended periods without losing state.”
Built-in AI = 16.0 ÷ 60 × 100 = 26.7
Automation51.0/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.temporal.io/cli/batch“Show the progress of an ongoing batch job. Pass a valid job ID to display its information”
- [claimed-docs] https://docs.temporal.io/encyclopedia/temporal-client.md“Start a Workflow Execution - Get the result of Workflow Execution - List Workflow Executions - Query a Workflow Execution - Signal a Workflow Execution”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 7 (quality) × 0.6 (partial) = 12.6 of 30 max
- [claimed-docs] https://docs.temporal.io/schedule“A Schedule contains instructions for starting a Workflow Execution at specific times.”
- [claimed-docs] https://docs.temporal.io/encyclopedia/workflow-message-passing“Temporal supports three types of messages: Signals, Queries, and Updates”
- [claimed-docs] https://docs.temporal.io/encyclopedia/retry-policies“Temporal's default behavior is to automatically retry an Activity that fails, so transient or intermittent failures require no action on your part.”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/ai“a Workflow resumes automatically after a crash, a network timeout, or a multi-day wait for a human to approve a step”
- [claimed-docs] https://docs.temporal.io/encyclopedia/workflow-message-passing“Workflows can be thought of as stateful web services that can receive messages. The Workflow can have message handlers, akin to endpoints”
Schedule recurring jobs or workflowsweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [claimed-docs] https://docs.temporal.io/schedule“A Schedule contains instructions for starting a Workflow Execution at specific times.”
- [claimed-docs] https://docs.temporal.io/schedule“Schedules provide a more flexible and user-friendly approach than Temporal Cron Jobs.”
- [claimed-docs] https://docs.temporal.io/workflows“Workflow Definition ... Workflow Execution ... Schedules ... Dynamic Handler ... Cron Job”
- [claimed-docs] https://docs.temporal.io/schedule“A Schedule contains instructions for starting a Workflow Execution at specific times. Schedules provide a more flexible and user-friendly approach than Temporal Cron Jobs.”
- [claimed-docs] https://docs.temporal.io/ai“Long-running, stateful agent loops that call LLMs and tools, wait on humans, and pick up exactly where they left off after a failure.”
- [claimed-docs] https://docs.temporal.io/develop/python/integrations/openai-agents“model calls are executed as Activities, so they retry durably and are not repeated during Workflow replay. Your agents survive Worker restarts and can run for extended periods without losing state.”
- [claimed-docs] https://docs.temporal.io/ai/cookbook“Build a durable agentic loop in Python with Claude tool calling and Temporal.”
Version, review, and roll back my automationsweight 1
1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max
- [claimed-docs] https://docs.temporal.io/worker-versioning“You can declare each Workflow type to have a Versioning Behavior, either Pinned or Auto-Upgrade, in your Workflow config”
- [claimed-docs] https://docs.temporal.io/worker-versioning“This page defines some of the underlying concepts used in Worker Versioning ... Worker Deployments ... Worker Deployment Versions ... Versioning Behaviors”
- [claimed-docs] https://docs.temporal.io/web-ui“The Temporal Web UI provides users with Workflow Execution state and metadata for debugging purposes.”
- [claimed-docs] https://docs.temporal.io/web-ui“The Temporal Web UI provides users with Workflow Execution state and metadata for debugging purposes. It ships with every Temporal CLI release”
Automation = 40.8 ÷ 80 × 100 = 51.0