Skip to content

How Railway’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score28/100

Agent-ready 48.0 × 0.30 = 14.40

API quality 3.6 × 0.20 = 0.72

Openness 4.8 × 0.20 = 0.96

Built-in AI 60.4 × 0.15 = 9.06

Automation 20.0 × 0.15 = 3.00

(14.40 + 0.72 + 0.96 + 9.06 + 3.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 28.14 ÷ 1.00 = 28.1

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready48.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.railway.com/llms.txtPROBE llms.txt: HTTP 200 at https://docs.railway.com/llms.txt # Railway Documentation > Railway is an all-in-one intelligent cloud provider that makes it easy to provision infrastru
  • [claimed-docs] https://docs.railway.com/agents.mdInstall the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.
  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [claimed-docs] https://docs.railway.com/agents.mdThe use-railway skill teaches AI coding agents how to operate Railway.

Run the product headlessly / in CI for automationweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.railway.comDevelop locally and deploy from your terminal with the Railway CLI.
  • [probe] https://docs.railway.com/guides/cliofficial CLI documented at https://docs.railway.com/guides/cli

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.railway.com/ai/agent-connectors.mdConnect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.comBuild with Railway using Agent Skills and the MCP server for AI-powered workflows.

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.railway.comBuild with Railway using Agent Skills and the MCP server for AI-powered workflows.
  • [claimed-docs] https://docs.railway.com/agents.mdInstall the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.
  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [claimed-docs] https://docs.railway.com/agents.mdThe use-railway skill teaches AI coding agents how to operate Railway.

Use an official CLIweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [claimed-docs] https://docs.railway.comDevelop locally and deploy from your terminal with the Railway CLI.
  • [claimed-docs] https://docs.railway.comRailway is an all-in-one intelligent cloud provider that makes it easy to provision infrastructure, develop locally, and deploy to the cloud.
  • [claimed-docs] https://docs.railway.com/agents.mdInstall the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.
  • [claimed-docs] https://docs.railway.comBuild with Railway using Agent Skills and the MCP server for AI-powered workflows.
  • [claimed-docs] https://docs.railway.com/agents.mdThe use-railway skill teaches AI coding agents how to operate Railway.
  • [probe] https://docs.railway.com/guides/cliofficial CLI documented at https://docs.railway.com/guides/cli

Drive the product through a documented public APIweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [claimed-docs] https://docs.railway.comDevelop locally and deploy from your terminal with the Railway CLI.
  • [claimed-docs] https://docs.railway.comBuild with Railway using Agent Skills and the MCP server for AI-powered workflows.
  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.railway.com/agents.mdInstall the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.
  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [claimed-docs] https://docs.railway.com/cloud-agents.mdRailway prepares the environment and carries available coding-agent credentials from your machine. Your files stay on the agent's disk, and the machine stays running when you disconnect.

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)
  • [claimed-docs] https://docs.railway.comDevelop locally and deploy from your terminal with the Railway CLI.
  • [claimed-docs] https://docs.railway.comBuild with Railway using Agent Skills and the MCP server for AI-powered workflows.

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 100.8 ÷ 210 × 100 = 48.0

API quality3.6/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)
  • [probe] https://docs.railway.com/llms.txtPROBE llms.txt: HTTP 200 at https://docs.railway.com/llms.txt # Railway Documentation > Railway is an all-in-one intelligent cloud provider that makes it easy to provision infrastru

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 6 (quality) × 0.6 (partial) = 3.6 of 10 max

  • [claimed-docs] https://railway.comUnlimited environments mean everyone can ship simultaneously.
  • [claimed-docs] https://railway.comEvery pull request gets its own preview. No surprises after merge.
  • [claimed-docs] https://docs.railway.com/cloud-agents.mdRailway prepares the environment and carries available coding-agent credentials from your machine. Your files stay on the agent's disk, and the machine stays running when you disconnect.

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)

The documented rate limits and concurrency caps for APIs and functions so I can plan for scaleweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)

API quality = 3.6 ÷ 100 × 100 = 3.6

Openness4.8/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.railway.com/agents.mdInstall the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.
  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [probe] https://docs.railway.com/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.railway.comDevelop locally and deploy from your terminal with the Railway CLI.
  • [claimed-docs] https://docs.railway.comMigrate from Heroku

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.railway.comRailway is an all-in-one intelligent cloud provider that makes it easy to provision infrastructure, develop locally, and deploy to the cloud.

Openness = 4.8 ÷ 100 × 100 = 4.8

Built-in AI60.4/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdIf the fix is in your code, the agent can open a pull request with the change so you can review and merge it.
  • [claimed-docs] https://docs.railway.com/ai/agent-connectors.mdConnect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.railway.com/cloud-agents.mdRailway prepares the environment and carries available coding-agent credentials from your machine. Your files stay on the agent's disk, and the machine stays running when you disconnect.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdIf the fix is in your code, the agent can open a pull request with the change so you can review and merge it.
  • [claimed-docs] https://railway.comSlack, Discord, or emails the moment conditions you specify are met.

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdIf the fix is in your code, the agent can open a pull request with the change so you can review and merge it.
  • [claimed-docs] https://docs.railway.com/ai/agent-connectors.mdConnect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.
  • [claimed-docs] https://docs.railway.com/ai/agent-integrations/slack.mdMention @Railway in Slack to ask the Railway Agent about your projects, inspect deployments, read logs, and make changes without leaving the conversation.

Operate the product with natural-language commandsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdIf the fix is in your code, the agent can open a pull request with the change so you can review and merge it.
  • [claimed-docs] https://docs.railway.com/ai/agent-connectors.mdConnect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.
  • [claimed-docs] https://docs.railway.com/ai/agent-integrations/slack.mdMention @Railway in Slack to ask the Railway Agent about your projects, inspect deployments, read logs, and make changes without leaving the conversation.
  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [claimed-docs] https://docs.railway.com/agents.mdInstall the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.
  • [claimed-docs] https://docs.railway.com/agents.mdThe use-railway skill teaches AI coding agents how to operate Railway.

Built-in AI = 54.4 ÷ 90 × 100 = 60.4

Automation20.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.railway.com/ai/mcp-server.mdIt lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.
  • [probe] https://docs.railway.com/guides/cliofficial CLI documented at https://docs.railway.com/guides/cli

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://railway.comSlack, Discord, or emails the moment conditions you specify are met.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdIf the fix is in your code, the agent can open a pull request with the change so you can review and merge it.

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 7 (quality) × 1.0 (full) = 7.0 of 10 max

  • [claimed-docs] https://railway.comEvery pull request gets its own preview. No surprises after merge.
  • [claimed-docs] https://railway.comRollback to any previous version instantly when something breaks.
  • [claimed-docs] https://railway.comUnlimited environments mean everyone can ship simultaneously.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdThe Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.
  • [claimed-docs] https://docs.railway.com/ai/railway-agent.mdIf the fix is in your code, the agent can open a pull request with the change so you can review and merge it.

Automation = 16.0 ÷ 80 × 100 = 20.0