How Railway’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score28/100
Agent-ready 48.0 × 0.30 = 14.40
API quality 3.6 × 0.20 = 0.72
Openness 4.8 × 0.20 = 0.96
Built-in AI 60.4 × 0.15 = 9.06
Automation 20.0 × 0.15 = 3.00
(14.40 + 0.72 + 0.96 + 9.06 + 3.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 28.14 ÷ 1.00 = 28.1
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready48.0/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [probe] https://docs.railway.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.railway.com/llms.txt # Railway Documentation > Railway is an all-in-one intelligent cloud provider that makes it easy to provision infrastru”
- [claimed-docs] https://docs.railway.com/agents.md“Install the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.”
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [claimed-docs] https://docs.railway.com/agents.md“The use-railway skill teaches AI coding agents how to operate Railway.”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://docs.railway.com“Develop locally and deploy from your terminal with the Railway CLI.”
- [probe] https://docs.railway.com/guides/cli“official CLI documented at https://docs.railway.com/guides/cli”
Plug MCP servers into this product so it can use their toolsweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.railway.com/ai/agent-connectors.md“Connect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com“Build with Railway using Agent Skills and the MCP server for AI-powered workflows.”
Connect an agent via an official MCP serverweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.railway.com“Build with Railway using Agent Skills and the MCP server for AI-powered workflows.”
- [claimed-docs] https://docs.railway.com/agents.md“Install the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.”
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [claimed-docs] https://docs.railway.com/agents.md“The use-railway skill teaches AI coding agents how to operate Railway.”
Use an official CLIweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [claimed-docs] https://docs.railway.com“Develop locally and deploy from your terminal with the Railway CLI.”
- [claimed-docs] https://docs.railway.com“Railway is an all-in-one intelligent cloud provider that makes it easy to provision infrastructure, develop locally, and deploy to the cloud.”
- [claimed-docs] https://docs.railway.com/agents.md“Install the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.”
- [claimed-docs] https://docs.railway.com“Build with Railway using Agent Skills and the MCP server for AI-powered workflows.”
- [claimed-docs] https://docs.railway.com/agents.md“The use-railway skill teaches AI coding agents how to operate Railway.”
- [probe] https://docs.railway.com/guides/cli“official CLI documented at https://docs.railway.com/guides/cli”
Drive the product through a documented public APIweight 3
3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [claimed-docs] https://docs.railway.com“Develop locally and deploy from your terminal with the Railway CLI.”
- [claimed-docs] https://docs.railway.com“Build with Railway using Agent Skills and the MCP server for AI-powered workflows.”
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.railway.com/agents.md“Install the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.”
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [claimed-docs] https://docs.railway.com/cloud-agents.md“Railway prepares the environment and carries available coding-agent credentials from your machine. Your files stay on the agent's disk, and the machine stays running when you disconnect.”
Build against official SDKsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
- [claimed-docs] https://docs.railway.com“Develop locally and deploy from your terminal with the Railway CLI.”
- [claimed-docs] https://docs.railway.com“Build with Railway using Agent Skills and the MCP server for AI-powered workflows.”
Subscribe to events via webhooksweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Agent-ready = 100.8 ÷ 210 × 100 = 48.0
API quality3.6/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
- [probe] https://docs.railway.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.railway.com/llms.txt # Railway Documentation > Railway is an all-in-one intelligent cloud provider that makes it easy to provision infrastru”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 6 (quality) × 0.6 (partial) = 3.6 of 10 max
- [claimed-docs] https://railway.com“Unlimited environments mean everyone can ship simultaneously.”
- [claimed-docs] https://railway.com“Every pull request gets its own preview. No surprises after merge.”
- [claimed-docs] https://docs.railway.com/cloud-agents.md“Railway prepares the environment and carries available coding-agent credentials from your machine. Your files stay on the agent's disk, and the machine stays running when you disconnect.”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
The documented rate limits and concurrency caps for APIs and functions so I can plan for scaleweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
API quality = 3.6 ÷ 100 × 100 = 3.6
Openness4.8/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max
- [claimed-docs] https://docs.railway.com/agents.md“Install the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.”
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [probe] https://docs.railway.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.railway.com/openapi.json, https://docs.railway.com/swagger.json, https://docs.railway.com/api/openapi.json, https://docs.railway.com/.well-known/openapi.json)”
Export all of my data in open formats and leaveweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://docs.railway.com“Develop locally and deploy from your terminal with the Railway CLI.”
- [claimed-docs] https://docs.railway.com“Migrate from Heroku”
Read the product's source under an open licenseweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Self-host the core productweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://docs.railway.com“Railway is an all-in-one intelligent cloud provider that makes it easy to provision infrastructure, develop locally, and deploy to the cloud.”
Openness = 4.8 ÷ 100 × 100 = 4.8
Built-in AI60.4/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“If the fix is in your code, the agent can open a pull request with the change so you can review and merge it.”
- [claimed-docs] https://docs.railway.com/ai/agent-connectors.md“Connect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://docs.railway.com/cloud-agents.md“Railway prepares the environment and carries available coding-agent credentials from your machine. Your files stay on the agent's disk, and the machine stays running when you disconnect.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“If the fix is in your code, the agent can open a pull request with the change so you can review and merge it.”
- [claimed-docs] https://railway.com“Slack, Discord, or emails the moment conditions you specify are met.”
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“If the fix is in your code, the agent can open a pull request with the change so you can review and merge it.”
- [claimed-docs] https://docs.railway.com/ai/agent-connectors.md“Connect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.”
- [claimed-docs] https://docs.railway.com/ai/agent-integrations/slack.md“Mention @Railway in Slack to ask the Railway Agent about your projects, inspect deployments, read logs, and make changes without leaving the conversation.”
Operate the product with natural-language commandsweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“If the fix is in your code, the agent can open a pull request with the change so you can review and merge it.”
- [claimed-docs] https://docs.railway.com/ai/agent-connectors.md“Connect Notion, Linear, or Sentry from the catalog, or point Railway at any remote MCP server you run, and the agent can read from it while it works on your projects.”
- [claimed-docs] https://docs.railway.com/ai/agent-integrations/slack.md“Mention @Railway in Slack to ask the Railway Agent about your projects, inspect deployments, read logs, and make changes without leaving the conversation.”
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [claimed-docs] https://docs.railway.com/agents.md“Install the Railway CLI and configure agent support — skills, MCP, and authentication — in one command.”
- [claimed-docs] https://docs.railway.com/agents.md“The use-railway skill teaches AI coding agents how to operate Railway.”
Built-in AI = 54.4 ÷ 90 × 100 = 60.4
Automation20.0/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://docs.railway.com/ai/mcp-server.md“It lets AI assistants create projects, deploy templates, manage environments, pull variables, and redeploy services.”
- [probe] https://docs.railway.com/guides/cli“official CLI documented at https://docs.railway.com/guides/cli”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max
- [claimed-docs] https://railway.com“Slack, Discord, or emails the moment conditions you specify are met.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“If the fix is in your code, the agent can open a pull request with the change so you can review and merge it.”
Schedule recurring jobs or workflowsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Version, review, and roll back my automationsweight 1
1 (weight) × 7 (quality) × 1.0 (full) = 7.0 of 10 max
- [claimed-docs] https://railway.com“Every pull request gets its own preview. No surprises after merge.”
- [claimed-docs] https://railway.com“Rollback to any previous version instantly when something breaks.”
- [claimed-docs] https://railway.com“Unlimited environments mean everyone can ship simultaneously.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“The Railway Agent is a chat-based AI assistant built into the Railway dashboard. It can operate the platform on your behalf: creating and configuring services, inspecting deployments, diagnosing failures, and opening pull requests to fix broken builds.”
- [claimed-docs] https://docs.railway.com/ai/railway-agent.md“If the fix is in your code, the agent can open a pull request with the change so you can review and merge it.”
Automation = 16.0 ÷ 80 × 100 = 20.0