How Factory’s scores are calculated

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [probe] https://docs.factory.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.factory.ai/llms.txt # Factory Documentation > Documentation for Factory, the agent-native software development platform. Every page below l”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”
• [claimed-docs] https://docs.factory.ai/agent-readiness/overview“Run the /readiness-report slash command in a Factory App web or desktop session, or in the Droid CLI, to evaluate a repository's readiness level”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“Droid exec uses tiered autonomy to control what operations can run without manual confirmation.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”
• [probe] https://docs.factory.ai/droid-cli/quickstart“official CLI documented at https://docs.factory.ai/droid-cli/quickstart”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Connect Jira, Notion, Slack, Linear, PagerDuty, and MCP tools to keep development synchronized with team systems”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”

Connect an agent via an official MCP serverweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

• [probe] https://docs.factory.ai/harness/mcp“official MCP server documented at https://docs.factory.ai/harness/mcp”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Connect Jira, Notion, Slack, Linear, PagerDuty, and MCP tools to keep development synchronized with team systems”

Use an official CLIweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Press ! to toggle bash mode and run shell commands directly without AI interpretation.”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [probe] https://docs.factory.ai/droid-cli/quickstart“official CLI documented at https://docs.factory.ai/droid-cli/quickstart”

Drive the product through a documented public APIweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“Droid exec uses tiered autonomy to control what operations can run without manual confirmation.”
• [probe] https://docs.factory.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.factory.ai/openapi.json, https://docs.factory.ai/swagger.json, https://docs.factory.ai/api/openapi.json, https://docs.factory.ai/.well-known/openapi.json)”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [probe] https://docs.factory.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.factory.ai/openapi.json, https://docs.factory.ai/swagger.json, https://docs.factory.ai/api/openapi.json, https://docs.factory.ai/.well-known/openapi.json)”
• [probe] https://docs.factory.ai/harness/mcp“official MCP server documented at https://docs.factory.ai/harness/mcp”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [probe] https://docs.factory.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.factory.ai/openapi.json, https://docs.factory.ai/swagger.json, https://docs.factory.ai/api/openapi.json, https://docs.factory.ai/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://docs.factory.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.factory.ai/openapi.json, https://docs.factory.ai/swagger.json, https://docs.factory.ai/api/openapi.json, https://docs.factory.ai/.well-known/openapi.json)”
• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [probe] https://docs.factory.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.factory.ai/openapi.json, https://docs.factory.ai/swagger.json, https://docs.factory.ai/api/openapi.json, https://docs.factory.ai/.well-known/openapi.json)”

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [claimed-docs] https://docs.factory.ai/missions/overview“Use Factory Missions to plan and execute large, multi-feature projects with structured orchestration.”
• [claimed-docs] https://docs.factory.ai/software-factory/overview“Open Software Factory to see your delivery lifecycle as an automation coverage map.”
• [claimed-docs] https://docs.factory.ai/agent-readiness/overview“Run the /readiness-report slash command in a Factory App web or desktop session, or in the Droid CLI, to evaluate a repository's readiness level”
• [claimed-docs] https://docs.factory.ai/agent-readiness/overview“Automatically fix failing criteria with the /readiness-fix slash command in a Factory App web or desktop session, or in the Droid CLI”
• [probe] https://docs.factory.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.factory.ai/openapi.json, https://docs.factory.ai/swagger.json, https://docs.factory.ai/api/openapi.json, https://docs.factory.ai/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“Droid exec uses tiered autonomy to control what operations can run without manual confirmation.”
• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [claimed-docs] https://docs.factory.ai/missions/overview“Use Factory Missions to plan and execute large, multi-feature projects with structured orchestration.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://docs.factory.ai“Delegate a task, review the diff, and merge from the App or your terminal.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“delegate scoped tasks to Custom Droids via /droids, and package reusable procedures as Skills with /skills or /create-skill”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”

Operate the product with natural-language commandsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Press ! to toggle bash mode and run shell commands directly without AI interpretation.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“delegate scoped tasks to Custom Droids via /droids, and package reusable procedures as Skills with /skills or /create-skill”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/missions/overview“Use Factory Missions to plan and execute large, multi-feature projects with structured orchestration.”
• [probe] https://docs.factory.ai/droid-cli/quickstart“official CLI documented at https://docs.factory.ai/droid-cli/quickstart”

Perform bulk operations across many items at onceweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/api-reference/sessions“Create and drive Droid sessions: manage their lifecycle, settings, and messages.”
• [claimed-docs] https://docs.factory.ai/missions/overview“Use Factory Missions to plan and execute large, multi-feature projects with structured orchestration.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

• [claimed-docs] https://docs.factory.ai/droid-exec/overview“droid exec runs as a one-shot command that completes a task and exits, making it ideal for CI/CD pipelines, shell scripts, and batch processing.”
• [claimed-docs] https://docs.factory.ai/droid-exec/overview“Droid exec uses tiered autonomy to control what operations can run without manual confirmation.”
• [claimed-docs] https://docs.factory.ai/software-factory/overview“Open Software Factory to see your delivery lifecycle as an automation coverage map.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max

• [claimed-docs] https://docs.factory.ai“Delegate a task, review the diff, and merge from the App or your terminal.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“Use the Droid CLI to run Factory from your terminal, editor, tests, and Git workflow.”
• [claimed-docs] https://docs.factory.ai/droid-cli/overview“delegate scoped tasks to Custom Droids via /droids, and package reusable procedures as Skills with /skills or /create-skill”