Skip to content
ProductArena

How Conductor’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score30/100

Agent-ready 38.6 × 0.30 = 11.58

API quality 5.1 × 0.20 = 1.02

Openness 6.0 × 0.20 = 1.20

Built-in AI 65.3 × 0.15 = 9.79

Automation 41.3 × 0.15 = 6.19

(11.58 + 1.02 + 1.20 + 9.79 + 6.19) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 29.79 ÷ 1.00 = 29.8

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready38.6/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://www.conductor.build/llms.txt“PROBE llms.txt: HTTP 200 at https://www.conductor.build/llms.txt # Conductor > Conductor is a Mac app that lets you run many coding agents in parallel on your codebase. ## Links - [C”
  • [probe] https://www.conductor.build/docs.md“PROBE docs-md: HTTP 200 at https://www.conductor.build/docs.md --- title: "Introduction" url: "/docs" description: "Learn what Conductor is and where to start in the docs" --- # Intr”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://www.conductor.build/changelog“Introducing routines! You can now run your agents on a schedule or via GitHub action.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [claimed-docs] https://www.conductor.build/docs/cloud/getting-started.md“The agent can test your repositories, update install and setup scripts, and run builds — without asking you to confirm each step.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [community] https://news.ycombinator.com/item?id=44594584“Fixed! You can now give Conductor fine-grained GitHub repository access. Or, skip the integration and use your local GitHub CLI auth.”

Drive the product through a documented public APIweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”
  • [probe] https://www.conductor.build/openapi.json“PROBE openapi: all candidate paths 404 (https://www.conductor.build/openapi.json, https://www.conductor.build/swagger.json, https://www.conductor.build/api/openapi.json, https://www.conductor.build/.well-known/openapi.json)”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [community] https://news.ycombinator.com/item?id=44594584“Any way to have it not require full write access to your entire GitHub account?”
  • [community] https://news.ycombinator.com/item?id=44594584“Full read-write access required to all your Github account's repos. Not just code. Settings, deploy keys. The works... Zero disclosure of data practices. You are INSANE to authorize this app on anything other than throwaway code.”
  • [community] https://news.ycombinator.com/item?id=44594584“I was really excited to try this but this does NOT work the way I expected. I wanted a simple git worktree manager for my existing, already-checked-out repository. Instead, it requests Github permissions and clones the repo from Github... it's like Codex or Cursor Background Agents, except worse, because it's on your machine.”
  • [community] https://news.ycombinator.com/item?id=44594584“Right now the app uses GitHub's OAuth sign in which unfortunately doesn't allow for fine-grained permissions... We're switching our sign-in to a GitHub App so we can make the permissions fine-grained.”
  • [community] https://news.ycombinator.com/item?id=44594584“Fixed! You can now give Conductor fine-grained GitHub repository access. Or, skip the integration and use your local GitHub CLI auth.”
  • [claimed-docs] https://www.conductor.build/markdown/pricing“Bring your own subscriptions and keys”

Build against official SDKsweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”
  • [probe] https://www.conductor.build/openapi.json“PROBE openapi: all candidate paths 404 (https://www.conductor.build/openapi.json, https://www.conductor.build/swagger.json, https://www.conductor.build/api/openapi.json, https://www.conductor.build/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”

Agent-ready = 81.0 ÷ 210 × 100 = 38.6

API quality5.1/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [probe] https://www.conductor.build/openapi.json“PROBE openapi: all candidate paths 404 (https://www.conductor.build/openapi.json, https://www.conductor.build/swagger.json, https://www.conductor.build/api/openapi.json, https://www.conductor.build/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://www.conductor.build/openapi.json“PROBE openapi: all candidate paths 404 (https://www.conductor.build/openapi.json, https://www.conductor.build/swagger.json, https://www.conductor.build/api/openapi.json, https://www.conductor.build/.well-known/openapi.json)”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 6 (quality) × 0.6 (partial) = 3.6 of 10 max

  • [claimed-docs] https://www.conductor.build/docs“Each task gets its own workspace, branch, files, terminal, diff, and review path.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“Sandboxes spin up in seconds, and agents keep working after you close your laptop.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/parallel-agents.md“Create a new workspace with Command + N when work should have its own branch, files, running environment, and review path.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/git-worktrees.md“Conductor creates a separate working tree for each workspace. That lets agents work in parallel without editing the same files on disk.”
  • [community] https://news.ycombinator.com/item?id=44594584“Oh cool, I was already doing this with git worktrees but a ui for it would be handy.”
  • [community] https://news.ycombinator.com/item?id=44594584“We create an isolated git worktree locally on your machine — whereas Codex (I believe) is running a container on the cloud.”
  • [community] https://news.ycombinator.com/item?id=44594584“Full read-write access required to all your Github account's repos. Not just code. Settings, deploy keys. The works... Zero disclosure of data practices. You are INSANE to authorize this app on anything other than throwaway code.”
  • [community] https://news.ycombinator.com/item?id=44594584“I was really excited to try this but this does NOT work the way I expected. I wanted a simple git worktree manager for my existing, already-checked-out repository. Instead, it requests Github permissions and clones the repo from Github... it's like Codex or Cursor Background Agents, except worse, because it's on your machine.”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [probe] https://www.conductor.build/openapi.json“PROBE openapi: all candidate paths 404 (https://www.conductor.build/openapi.json, https://www.conductor.build/swagger.json, https://www.conductor.build/api/openapi.json, https://www.conductor.build/.well-known/openapi.json)”

API quality = 3.6 ÷ 70 × 100 = 5.1

Openness6.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”
  • [probe] https://www.conductor.build/openapi.json“PROBE openapi: all candidate paths 404 (https://www.conductor.build/openapi.json, https://www.conductor.build/swagger.json, https://www.conductor.build/api/openapi.json, https://www.conductor.build/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://www.conductor.build/docs/concepts/git-worktrees.md“Conductor creates a separate working tree for each workspace. That lets agents work in parallel without editing the same files on disk.”
  • [community] https://news.ycombinator.com/item?id=44594584“Love it! Even just simply freeing my main branch would be a big win so I can keep working as well. But no way to find out if there's any data sent to your servers etc, unless I'm missing some links?”
  • [community] https://news.ycombinator.com/item?id=44594584“Full read-write access required to all your Github account's repos. Not just code. Settings, deploy keys. The works... Zero disclosure of data practices. You are INSANE to authorize this app on anything other than throwaway code.”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [community] https://news.ycombinator.com/item?id=44594584“Crystal can do all of this and more, and unlike Conductor is open source.”

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [community] https://news.ycombinator.com/item?id=44594584“Crystal can do all of this and more, and unlike Conductor is open source.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“Sandboxes spin up in seconds, and agents keep working after you close your laptop.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”

Openness = 6.0 ÷ 100 × 100 = 6.0

Built-in AI65.3/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://www.conductor.build/docs“When the work is ready, Conductor helps you review the diff, open a pull request, merge, and archive the workspace.”
  • [claimed-docs] https://www.conductor.build/docs/cloud/getting-started.md“The agent can test your repositories, update install and setup scripts, and run builds — without asking you to confirm each step.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“You can also have an agent configure the computer for you: it can test your repositories, edit setup scripts, and run builds.”
  • [claimed-docs] https://www.conductor.build/docs/reference/agent-behavior.md“Checkpoints | Session/workspace | Revert code and chat state to an earlier turn”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://www.conductor.build/changelog“Introducing routines! You can now run your agents on a schedule or via GitHub action.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“Sandboxes spin up in seconds, and agents keep working after you close your laptop.”
  • [claimed-docs] https://www.conductor.build/docs/cloud/getting-started.md“The agent can test your repositories, update install and setup scripts, and run builds — without asking you to confirm each step.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“You can also have an agent configure the computer for you: it can test your repositories, edit setup scripts, and run builds.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://www.conductor.build/docs“Conductor lets you run Claude Code, Codex, Cursor, and OpenCode in parallel.”
  • [claimed-docs] https://www.conductor.build/docs/cloud/getting-started.md“The agent can test your repositories, update install and setup scripts, and run builds — without asking you to confirm each step.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“Sandboxes spin up in seconds, and agents keep working after you close your laptop.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/git-worktrees.md“Conductor creates a separate working tree for each workspace. That lets agents work in parallel without editing the same files on disk.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“You can also have an agent configure the computer for you: it can test your repositories, edit setup scripts, and run builds.”
  • [community] https://news.ycombinator.com/item?id=44594584“I have been imagining something like this would be perfect for working with Claude Code... This feels like just a nice clean simple extension of how Claude code already works that solves my most common pain points in the workflow. Anyways, excellent work!”
  • [community] https://news.ycombinator.com/item?id=44594584“Your messages are just between you and Claude Code — it all runs on your local Claude Code installation via the SDK.”

Operate the product with natural-language commandsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://www.conductor.build/docs/api/mcp.md“Conductor's hosted Model Context Protocol (MCP) server lets ChatGPT, Claude, Codex, and other MCP clients manage your cloud workspaces.”
  • [claimed-docs] https://www.conductor.build/docs/cloud/getting-started.md“The agent can test your repositories, update install and setup scripts, and run builds — without asking you to confirm each step.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”
  • [claimed-docs] https://www.conductor.build/docs/cloud.md“You can also have an agent configure the computer for you: it can test your repositories, edit setup scripts, and run builds.”
  • [probe] https://www.conductor.build/docs/api/mcp“official MCP server documented at https://www.conductor.build/docs/api/mcp”

Built-in AI = 58.8 ÷ 90 × 100 = 65.3

Automation41.3/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

  • [claimed-docs] https://www.conductor.build/docs“Conductor lets you run Claude Code, Codex, Cursor, and OpenCode in parallel.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/parallel-agents.md“Create a new workspace with Command + N when work should have its own branch, files, running environment, and review path.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/parallel-agents.md“Run multiple agents in one workspace when the work belongs on the same branch and should share the same files and context.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/git-worktrees.md“Conductor creates a separate working tree for each workspace. That lets agents work in parallel without editing the same files on disk.”
  • [claimed-docs] https://www.conductor.build/changelog“Introducing routines! You can now run your agents on a schedule or via GitHub action.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically.”
  • [claimed-docs] https://www.conductor.build/docs/api.md“The Conductor API lets you manage cloud workspaces programmatically. Use it to do things like: Create workspaces, send prompts to the coding agent, and read its replies.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://www.conductor.build/changelog“Introducing routines! You can now run your agents on a schedule or via GitHub action.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 6 (quality) × 1.0 (full) = 12.0 of 20 max

  • [claimed-docs] https://www.conductor.build/changelog“Introducing routines! You can now run your agents on a schedule or via GitHub action.”

Version, review, and roll back my automationsweight 1

1 (weight) × 6 (quality) × 0.6 (partial) = 3.6 of 10 max

  • [claimed-docs] https://www.conductor.build/docs/reference/agent-behavior.md“Checkpoints | Session/workspace | Revert code and chat state to an earlier turn”
  • [claimed-docs] https://www.conductor.build/docs“When the work is ready, Conductor helps you review the diff, open a pull request, merge, and archive the workspace.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/git-worktrees.md“Conductor creates a separate working tree for each workspace. That lets agents work in parallel without editing the same files on disk.”
  • [claimed-docs] https://www.conductor.build/changelog“Introducing routines! You can now run your agents on a schedule or via GitHub action.”
  • [claimed-docs] https://www.conductor.build/docs/concepts/parallel-agents.md“Create a new workspace with Command + N when work should have its own branch, files, running environment, and review path.”

Automation = 33.0 ÷ 80 × 100 = 41.3