Skip to content
ProductArena

How Manufact’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score23/100

Agent-ready 48.6 × 0.30 = 14.58

API quality 5.1 × 0.20 = 1.02

Openness 7.2 × 0.20 = 1.44

Built-in AI 35.1 × 0.15 = 5.26

Automation 6.0 × 0.15 = 0.90

(14.58 + 1.02 + 1.44 + 5.26 + 0.90) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 23.20 ÷ 1.00 = 23.2

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready48.6/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.manufact.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.manufact.com/llms.txt # Docs - Manufact Cloud: Deploy, monitor, and manage MCP servers on Manufact Cloud - [Welcome to Manufact Cloud](/das”
  • [claimed-docs] https://docs.manufact.com/mcp.md“exposes the platform, organizations, servers, deployments, logs, and observability, as MCP tools, so you can manage everything from Cursor, Claude”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/cli.md“Run your MCP server locally with hot reload + inspector”
  • [claimed-docs] https://docs.manufact.com/cli/deploy.md“Deploys the current project to Manufact Cloud.”
  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Trigger deployment: deploy a branch on demand.”
  • [probe] https://docs.manufact.com/cli“official CLI documented at https://docs.manufact.com/cli”
  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://docs.manufact.com/dashboard/servers.md“paste your MCP URL. No deploy required: Manufact connects directly for Chat, testing, and the publish workflow.”
  • [claimed-docs] https://docs.manufact.com/dashboard/testing.md“Manufact executes them across different MCP clients and LLM models”
  • [claimed-docs] https://docs.manufact.com/dashboard/connect-clients.md“You get one-click installs or copy-paste configuration for”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.manufact.com/mcp.md“exposes the platform, organizations, servers, deployments, logs, and observability, as MCP tools, so you can manage everything from Cursor, Claude”
  • [claimed-docs] https://docs.manufact.com/dashboard/connect-clients.md“You get one-click installs or copy-paste configuration for”
  • [probe] https://docs.manufact.com/mcp“official MCP server documented at https://docs.manufact.com/mcp”
  • [community] https://hn.algolia.com/api/v1/items/48762862“Noted an issue with the offline_access OAuth scope causing frequent reauthentication requests from clients (citing a related Codex bug); many MCP servers work around it with increased token life, and v2 of mcp-use (end of month) should add a builtin way to handle buggy clients so the server stays connected.”

Use an official CLIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/cli.md“Run your MCP server locally with hot reload + inspector”
  • [claimed-docs] https://docs.manufact.com/cli/deploy.md“Deploys the current project to Manufact Cloud.”
  • [probe] https://docs.manufact.com/cli“official CLI documented at https://docs.manufact.com/cli”

Drive the product through a documented public APIweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [claimed-docs] https://docs.manufact.com/mcp.md“exposes the platform, organizations, servers, deployments, logs, and observability, as MCP tools, so you can manage everything from Cursor, Claude”
  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”
  • [probe] https://docs.manufact.com/mcp“official MCP server documented at https://docs.manufact.com/mcp”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”
  • [probe] https://docs.manufact.com/cli“official CLI documented at https://docs.manufact.com/cli”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 102.0 ÷ 210 × 100 = 48.6

API quality5.1/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”
  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [claimed-docs] https://docs.manufact.com/dashboard/testing.md“Manufact executes them across different MCP clients and LLM models”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”
  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 6 (quality) × 0.6 (partial) = 3.6 of 10 max

  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Preview environments are created per branch. Each gets its own MCP URL”
  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Trigger deployment: deploy a branch on demand.”
  • [claimed-docs] https://docs.manufact.com/cli.md“Run your MCP server locally with hot reload + inspector”
  • [claimed-docs] https://docs.manufact.com/dashboard/changelog“Set which Git branch serves your canonical production URL from the Deployment paths & triggers section”
  • [claimed-docs] https://docs.manufact.com/dashboard/testing.md“Manufact executes them across different MCP clients and LLM models”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”

API quality = 3.6 ÷ 70 × 100 = 5.1

Openness7.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.manufact.com/mcp.md“exposes the platform, organizations, servers, deployments, logs, and observability, as MCP tools, so you can manage everything from Cursor, Claude”
  • [claimed-docs] https://docs.manufact.com/cli.md“Run your MCP server locally with hot reload + inspector”
  • [claimed-docs] https://docs.manufact.com/cli/deploy.md“Deploys the current project to Manufact Cloud.”
  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [probe] https://docs.manufact.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.manufact.com/openapi.json, https://docs.manufact.com/swagger.json, https://docs.manufact.com/api/openapi.json, https://docs.manufact.com/.well-known/openapi.json)”
  • [probe] https://docs.manufact.com/mcp“official MCP server documented at https://docs.manufact.com/mcp”
  • [probe] https://docs.manufact.com/cli“official CLI documented at https://docs.manufact.com/cli”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.manufact.com/dashboard/servers.md“Selecting a template creates a new repository from the template in your connected GitHub account or organization and deploys it”
  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [claimed-docs] https://docs.manufact.com/dashboard/observability.md“shows individual events: every request flowing through the gateway, refreshed every few seconds”
  • [probe] https://docs.manufact.com/cli“official CLI documented at https://docs.manufact.com/cli”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.manufact.com“deploy from GitHub in minutes”
  • [claimed-docs] https://docs.manufact.com/cli/deploy.md“Deploys the current project to Manufact Cloud.”
  • [claimed-docs] https://docs.manufact.com/dashboard/api-keys.md“API keys authenticate programmatic access to your organization, from the REST API, CI pipelines, and scripts.”
  • [probe] https://docs.manufact.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.manufact.com/llms.txt # Docs - Manufact Cloud: Deploy, monitor, and manage MCP servers on Manufact Cloud - [Welcome to Manufact Cloud](/das”

Openness = 7.2 ÷ 100 × 100 = 7.2

Built-in AI35.1/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“runs an automated audit of your server for protocol compliance and platform readiness”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“copy a fix prompt into your own coding agent, or run the built-in autofix flow”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“you can start a checklist automatically after each successful deployment”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“you can start a checklist automatically after each successful deployment”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“runs an automated audit of your server for protocol compliance and platform readiness”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“end-to-end checks that exercise your server live in ChatGPT and Claude”
  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Trigger deployment: deploy a branch on demand.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

  • [claimed-docs] https://docs.manufact.com/dashboard/servers.md“paste your MCP URL. No deploy required: Manufact connects directly for Chat, testing, and the publish workflow.”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“end-to-end checks that exercise your server live in ChatGPT and Claude”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“copy a fix prompt into your own coding agent, or run the built-in autofix flow”

Operate the product with natural-language commandsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/mcp.md“exposes the platform, organizations, servers, deployments, logs, and observability, as MCP tools, so you can manage everything from Cursor, Claude”
  • [probe] https://docs.manufact.com/mcp“official MCP server documented at https://docs.manufact.com/mcp”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“copy a fix prompt into your own coding agent, or run the built-in autofix flow”
  • [claimed-docs] https://docs.manufact.com/dashboard/connect-clients.md“You get one-click installs or copy-paste configuration for”

Built-in AI = 31.6 ÷ 90 × 100 = 35.1

Automation6.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Trigger deployment: deploy a branch on demand.”
  • [claimed-docs] https://docs.manufact.com/dashboard/testing.md“Manufact executes them across different MCP clients and LLM models”
  • [claimed-docs] https://docs.manufact.com/mcp.md“exposes the platform, organizations, servers, deployments, logs, and observability, as MCP tools, so you can manage everything from Cursor, Claude”
  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“The history table shows every deployment with its MCP URL, source branch and commit, duration, creation time, and the latest completed publish checklist score”

Define rules that trigger actions automatically on eventsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Trigger deployment: deploy a branch on demand.”
  • [claimed-docs] https://docs.manufact.com/dashboard/publish-checks.md“you can start a checklist automatically after each successful deployment”
  • [claimed-docs] https://docs.manufact.com/dashboard/changelog“Set which Git branch serves your canonical production URL from the Deployment paths & triggers section”

Version, review, and roll back my automationsweight 1

1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max

  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Preview environments are created per branch. Each gets its own MCP URL”
  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“Trigger deployment: deploy a branch on demand.”
  • [claimed-docs] https://docs.manufact.com/dashboard/deployments.md“The history table shows every deployment with its MCP URL, source branch and commit, duration, creation time, and the latest completed publish checklist score”
  • [claimed-docs] https://docs.manufact.com/dashboard/changelog“Set which Git branch serves your canonical production URL from the Deployment paths & triggers section”

Automation = 3.0 ÷ 50 × 100 = 6.0