How Skyvern’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score31/100

Agent-ready 42.4 × 0.30 = 12.72

API quality 0.0 × 0.20 = 0.00

Openness 39.0 × 0.20 = 7.80

Built-in AI 62.0 × 0.15 = 9.30

Automation 6.7 × 0.15 = 1.00

(12.72 + 0.00 + 7.80 + 9.30 + 1.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 30.82 ÷ 1.00 = 30.8

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready42.4/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

[probe] https://skyvern.com/llms.txt“PROBE llms.txt: HTTP 200 at https://skyvern.com/llms.txt # Skyvern > Skyvern is an open-source, AI-powered browser automation platform. It uses large language models and comput”
[claimed-docs] https://www.skyvern.com/llms“Visual workflow builder for non-developers — drag-and-drop, no code required”
[claimed-docs] https://www.skyvern.com/llms“Browser recorder that converts manual actions into reusable automations”
[claimed-docs] https://www.skyvern.com/llms“SOP upload — describe a process in plain English and Skyvern builds the workflow”
[claimed-docs] https://www.skyvern.com/llms“Copilot chat for building and debugging workflows interactively”
[probe] https://skyvern.com/docs.md“PROBE docs-md: HTTP 404 at https://skyvern.com/docs.md”
[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”
[claimed-docs] https://skyvern.com/docs“Run Skyvern on your own infrastructure with your own LLM keys.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Browser Automation is the code-first way to build multi-step automations. The Skyvern SDK connects to a cloud Chromium instance over CDP, layers Playwright on top, and injects AI into every page interaction.”
[claimed-docs] https://skyvern.com/docs/developers/self-hosted/overview“Self-hosted Skyvern runs entirely on your infrastructure: your servers, your browsers, your LLM API keys.”
[claimed-docs] https://www.skyvern.com/pricing“You're replacing brittle Selenium scripts, integrating browser automation via API, or building workflows into your product.”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

[claimed-docs] https://skyvern.com/docs/developers/getting-started/mcp“The Skyvern MCP server lets AI assistants like Claude Desktop, Claude Code, Codex, Cursor, and Windsurf control a browser.”
[probe] https://skyvern.com/docs/developers/getting-started/mcp“official MCP server documented at https://skyvern.com/docs/developers/getting-started/mcp”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

[claimed-docs] https://skyvern.com/docs/developers/getting-started/mcp“The Skyvern MCP server lets AI assistants like Claude Desktop, Claude Code, Codex, Cursor, and Windsurf control a browser.”
[probe] https://skyvern.com/docs/developers/getting-started/mcp“official MCP server documented at https://skyvern.com/docs/developers/getting-started/mcp”

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Browser Automation is the code-first way to build multi-step automations. The Skyvern SDK connects to a cloud Chromium instance over CDP, layers Playwright on top, and injects AI into every page interaction.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/mcp“The Skyvern MCP server lets AI assistants like Claude Desktop, Claude Code, Codex, Cursor, and Windsurf control a browser.”

Drive the product through a documented public APIweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Browser Automation is the code-first way to build multi-step automations. The Skyvern SDK connects to a cloud Chromium instance over CDP, layers Playwright on top, and injects AI into every page interaction.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/introduction“It navigates websites it has never seen before, filling forms, extracting data, and completing multi-step tasks via a simple API.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“You provide a natural-language prompt describing the goal, a starting URL, and optionally a JSON schema for structured output.”
[claimed-docs] https://skyvern.com/docs/developers/browser-automations/extract-structured-data“you can extract structured data from any page using `page.extract` with a JSON schema, or by passing a `data_extraction_schema` to `page.agent.run_task`”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/mcp“The Skyvern MCP server lets AI assistants like Claude Desktop, Claude Code, Codex, Cursor, and Windsurf control a browser.”
[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”
[probe] https://skyvern.com/docs/developers/getting-started/mcp“official MCP server documented at https://skyvern.com/docs/developers/getting-started/mcp”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[claimed-docs] https://skyvern.com/docs“Run Skyvern on your own infrastructure with your own LLM keys.”
[claimed-docs] https://skyvern.com/docs/developers/self-hosted/overview“Self-hosted Skyvern runs entirely on your infrastructure: your servers, your browsers, your LLM API keys.”
[community] https://news.ycombinator.com/item?id=41936745“you are expecting them to pass over their website login credentials and apparently their credit card details too, in plain text. You had better have a very solid idea of how to handle that sensitive data.”

Build against official SDKsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Browser Automation is the code-first way to build multi-step automations. The Skyvern SDK connects to a cloud Chromium instance over CDP, layers Playwright on top, and injects AI into every page interaction.”
[claimed-docs] https://www.skyvern.com/developers“Drop-in AI commands on top of Playwright. Use natural language to act, extract, and validate — or fall back to selectors.”
[claimed-docs] https://skyvern.com/docs/developers/browser-automations/extract-structured-data“you can extract structured data from any page using `page.extract` with a JSON schema, or by passing a `data_extraction_schema` to `page.agent.run_task`”
[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 89.0 ÷ 210 × 100 = 42.4

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”
[probe] https://skyvern.com/docs.md“PROBE docs-md: HTTP 404 at https://skyvern.com/docs.md”
[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”
[probe] https://skyvern.com/docs.md“PROBE docs-md: HTTP 404 at https://skyvern.com/docs.md”
[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”
[probe] https://skyvern.com/docs.md“PROBE docs-md: HTTP 404 at https://skyvern.com/docs.md”

API quality = 0.0 ÷ 70 × 100 = 0.0

Openness39.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

[claimed-docs] https://skyvern.com/docs“Integrate browser automation into your product with Python, TypeScript, or REST.”
[claimed-docs] https://skyvern.com/docs“Use the dashboard to run tasks and build agents visually.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Browser Automation is the code-first way to build multi-step automations. The Skyvern SDK connects to a cloud Chromium instance over CDP, layers Playwright on top, and injects AI into every page interaction.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Build multi-step automations visually in the Cloud UI with drag-and-drop blocks. No code required. Share templates across your team.”
[claimed-docs] https://www.skyvern.com/llms“Visual workflow builder for non-developers — drag-and-drop, no code required”
[claimed-docs] https://www.skyvern.com/llms“Browser recorder that converts manual actions into reusable automations”
[claimed-docs] https://www.skyvern.com/llms“SOP upload — describe a process in plain English and Skyvern builds the workflow”
[claimed-docs] https://www.skyvern.com/llms“Copilot chat for building and debugging workflows interactively”
[probe] https://skyvern.com/openapi.json“PROBE openapi: all candidate paths 404 (https://skyvern.com/openapi.json, https://skyvern.com/swagger.json, https://skyvern.com/api/openapi.json, https://skyvern.com/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

[claimed-docs] https://skyvern.com/docs/developers/self-hosted/overview“Self-hosted Skyvern runs entirely on your infrastructure: your servers, your browsers, your LLM API keys.”
[claimed-docs] https://skyvern.com/docs/developers/debugging/using-artifacts“Every run automatically captures what happened: recordings of the browser session, screenshots at each step, the AI's reasoning, and network traffic.”
[claimed-docs] https://skyvern.com/docs“Run Skyvern on your own infrastructure with your own LLM keys.”

Read the product's source under an open licenseweight 2

2 (weight) × 4 (quality) × 0.3 (disputed) = 2.4 of 20 max

[github] https://github.com/Skyvern-AI/skyvern“Skyvern can operate on websites it's never seen before, as it's able to map visual elements to actions necessary to complete a workflow, without any customized code”
[github] https://github.com/Skyvern-AI/skyvern“a no-code workflow builder to help both technical and non-technical users automate manual workflows on any website, replacing brittle or unreliable automation solutions”
[probe] https://skyvern.com/llms.txt“PROBE llms.txt: HTTP 200 at https://skyvern.com/llms.txt # Skyvern > Skyvern is an open-source, AI-powered browser automation platform. It uses large language models and comput”
[community] https://news.ycombinator.com/item?id=39706004“Exciting stuff, my employer would be interested but it's AGPL3 licensed so it's a non-starter for them.”

Self-host the core productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

[claimed-docs] https://skyvern.com/docs/developers/self-hosted/overview“Self-hosted Skyvern runs entirely on your infrastructure: your servers, your browsers, your LLM API keys.”
[claimed-docs] https://skyvern.com/docs“Run Skyvern on your own infrastructure with your own LLM keys.”
[community] https://news.ycombinator.com/item?id=39706004“Exciting stuff, my employer would be interested but it's AGPL3 licensed so it's a non-starter for them.”
[probe] https://skyvern.com/llms.txt“PROBE llms.txt: HTTP 200 at https://skyvern.com/llms.txt # Skyvern > Skyvern is an open-source, AI-powered browser automation platform. It uses large language models and comput”

Openness = 39.0 ÷ 100 × 100 = 39.0

Built-in AI62.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Browser Automation is the code-first way to build multi-step automations. The Skyvern SDK connects to a cloud Chromium instance over CDP, layers Playwright on top, and injects AI into every page interaction.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Build multi-step automations visually in the Cloud UI with drag-and-drop blocks. No code required. Share templates across your team.”
[claimed-docs] https://skyvern.com/docs/developers/features/browser-sessions“Human-in-the-loop flows: pause for approval between steps without losing browser state. The VNC stream lets you watch or take control at any point.”
[claimed-docs] https://skyvern.com/docs/developers/debugging/using-artifacts“Every run automatically captures what happened: recordings of the browser session, screenshots at each step, the AI's reasoning, and network traffic.”
[claimed-docs] https://skyvern.com/docs/developers/features/browser-sessions“Cookies, local storage, open tabs, and the current page all persist, so later operations pick up exactly where the previous one stopped.”
[claimed-docs] https://skyvern.com/docs“Connect to Zapier”
[claimed-docs] https://www.skyvern.com/integrations“Skyvern automates browser-based workflows across these platforms — no API keys or custom connectors required.”
[community] https://news.ycombinator.com/item?id=39706004“I played with the Geico example, and it seems to do a good job on the happy path. But I tried costcotravel.com... it struggled to hit the 'rental car' tab... it entered JFK into the pickup location, but then failed to click the popup.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

[claimed-docs] https://skyvern.com/docs/developers/getting-started/introduction“It navigates websites it has never seen before, filling forms, extracting data, and completing multi-step tasks via a simple API.”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“You provide a natural-language prompt describing the goal, a starting URL, and optionally a JSON schema for structured output.”
[claimed-docs] https://www.skyvern.com/llms“SOP upload — describe a process in plain English and Skyvern builds the workflow”
[claimed-docs] https://www.skyvern.com/llms“Copilot chat for building and debugging workflows interactively”
[github] https://github.com/Skyvern-AI/skyvern“Skyvern can operate on websites it's never seen before, as it's able to map visual elements to actions necessary to complete a workflow, without any customized code”

Operate the product with natural-language commandsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“You provide a natural-language prompt describing the goal, a starting URL, and optionally a JSON schema for structured output.”
[claimed-docs] https://www.skyvern.com/llms“SOP upload — describe a process in plain English and Skyvern builds the workflow”
[claimed-docs] https://www.skyvern.com/llms“Copilot chat for building and debugging workflows interactively”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/mcp“The Skyvern MCP server lets AI assistants like Claude Desktop, Claude Code, Codex, Cursor, and Windsurf control a browser.”
[claimed-docs] https://www.skyvern.com/developers“Drop-in AI commands on top of Playwright. Use natural language to act, extract, and validate — or fall back to selectors.”
[community] https://news.ycombinator.com/item?id=39706004“I played with the Geico example, and it seems to do a good job on the happy path. But I tried costcotravel.com... it struggled to hit the 'rental car' tab... it entered JFK into the pickup location, but then failed to click the popup.”

Built-in AI = 43.4 ÷ 70 × 100 = 62.0

Automation6.7/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

[claimed-docs] https://skyvern.com/docs“Connect to Zapier”
[claimed-docs] https://skyvern.com/docs/developers/getting-started/core-concepts“Build multi-step automations visually in the Cloud UI with drag-and-drop blocks. No code required. Share templates across your team.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 5.4 ÷ 80 × 100 = 6.7