Skip to content
ProductArena

How Firecrawl’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score32/100

Agent-ready 53.6 × 0.30 = 16.08

API quality 0.0 × 0.20 = 0.00

Openness 43.0 × 0.20 = 8.60

Built-in AI 18.5 × 0.15 = 2.77

Automation 26.7 × 0.15 = 4.00

(16.08 + 0.00 + 8.60 + 2.77 + 4.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 31.46 ÷ 1.00 = 31.5

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready53.6/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [probe] https://docs.firecrawl.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.firecrawl.dev/llms.txt # Firecrawl Docs ## English ### v2 #### Documentation ##### Get Started - [Introduction](https://docs.firecrawl.dev”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.firecrawl.dev“Webhooks Async event delivery”
  • [probe] https://docs.firecrawl.dev/sdks/cli“official CLI documented at https://docs.firecrawl.dev/sdks/cli”
  • [github] https://github.com/mendableai/firecrawl“Scrape thousands of URLs asynchronously”
  • [community] https://news.ycombinator.com/item?id=49148163“It being vibe coded aside, does it support screenshots? I noticed the daemon mode has a lot of weird limitations too like not being able to return html.”

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://docs.firecrawl.dev“MCP Server: Connect Firecrawl to any AI tool via the Model Context Protocol”
  • [probe] https://github.com/mendableai/firecrawl-mcp-server“official MCP server documented at https://github.com/mendableai/firecrawl-mcp-server”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.firecrawl.dev“MCP Server: Connect Firecrawl to any AI tool via the Model Context Protocol”
  • [probe] https://github.com/mendableai/firecrawl-mcp-server“official MCP server documented at https://github.com/mendableai/firecrawl-mcp-server”

Use an official CLIweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

  • [claimed-docs] https://docs.firecrawl.dev“One command installs the Firecrawl CLI, authenticates in your browser, and adds skills to every detected coding agent.”
  • [probe] https://docs.firecrawl.dev/sdks/cli“official CLI documented at https://docs.firecrawl.dev/sdks/cli”
  • [community] https://news.ycombinator.com/item?id=49148163“It being vibe coded aside, does it support screenshots? I noticed the daemon mode has a lot of weird limitations too like not being able to return html.”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.firecrawl.dev“Extract content from any URL as markdown, HTML, or structured JSON”
  • [claimed-docs] https://docs.firecrawl.dev“Search the web and get full page content from results in one call.”
  • [claimed-docs] https://docs.firecrawl.dev“Scrape a page, then keep working with it: click, fill forms, extract dynamic content, or navigate deeper.”
  • [github] https://github.com/mendableai/firecrawl“Use a schema to get structured data:”
  • [claimed-docs] https://docs.firecrawl.dev“Webhooks Async event delivery”
  • [probe] https://docs.firecrawl.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.firecrawl.dev/llms.txt # Firecrawl Docs ## English ### v2 #### Documentation ##### Get Started - [Introduction](https://docs.firecrawl.dev”
  • [probe] https://docs.firecrawl.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.firecrawl.dev/openapi.json, https://docs.firecrawl.dev/swagger.json, https://docs.firecrawl.dev/api/openapi.json, https://docs.firecrawl.dev/.well-known/openapi.json)”
  • [probe] https://docs.firecrawl.dev/sdks/cli“official CLI documented at https://docs.firecrawl.dev/sdks/cli”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [probe] https://docs.firecrawl.dev/sdks/cli“official CLI documented at https://docs.firecrawl.dev/sdks/cli”
  • [claimed-docs] https://docs.firecrawl.dev“One command installs the Firecrawl CLI, authenticates in your browser, and adds skills to every detected coding agent.”

Subscribe to events via webhooksweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.firecrawl.dev“Webhooks Async event delivery”

Agent-ready = 96.4 ÷ 180 × 100 = 53.6

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.firecrawl.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.firecrawl.dev/openapi.json, https://docs.firecrawl.dev/swagger.json, https://docs.firecrawl.dev/api/openapi.json, https://docs.firecrawl.dev/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.firecrawl.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.firecrawl.dev/openapi.json, https://docs.firecrawl.dev/swagger.json, https://docs.firecrawl.dev/api/openapi.json, https://docs.firecrawl.dev/.well-known/openapi.json)”
  • [probe] https://docs.firecrawl.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.firecrawl.dev/llms.txt # Firecrawl Docs ## English ### v2 #### Documentation ##### Get Started - [Introduction](https://docs.firecrawl.dev”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.firecrawl.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.firecrawl.dev/llms.txt # Firecrawl Docs ## English ### v2 #### Documentation ##### Get Started - [Introduction](https://docs.firecrawl.dev”
  • [probe] https://docs.firecrawl.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.firecrawl.dev/openapi.json, https://docs.firecrawl.dev/swagger.json, https://docs.firecrawl.dev/api/openapi.json, https://docs.firecrawl.dev/.well-known/openapi.json)”

The documented rate limit (requests per second or minute) enforced on my API key before throttling kicks inweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

API quality = 0.0 ÷ 100 × 100 = 0.0

Openness43.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.firecrawl.dev“Extract content from any URL as markdown, HTML, or structured JSON”
  • [claimed-docs] https://docs.firecrawl.dev“Search the web and get full page content from results in one call.”
  • [claimed-docs] https://docs.firecrawl.dev“Scrape a page, then keep working with it: click, fill forms, extract dynamic content, or navigate deeper.”
  • [github] https://github.com/mendableai/firecrawl“Crawl an entire website and get content from all pages.”
  • [github] https://github.com/mendableai/firecrawl“Scrape thousands of URLs asynchronously”
  • [probe] https://docs.firecrawl.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.firecrawl.dev/openapi.json, https://docs.firecrawl.dev/swagger.json, https://docs.firecrawl.dev/api/openapi.json, https://docs.firecrawl.dev/.well-known/openapi.json)”
  • [probe] https://docs.firecrawl.dev/sdks/cli“official CLI documented at https://docs.firecrawl.dev/sdks/cli”

Export all of my data in open formats and leaveweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.firecrawl.dev“Extract content from any URL as markdown, HTML, or structured JSON”
  • [github] https://github.com/mendableai/firecrawl“Firecrawl is open source under the AGPL-3.0 license. The cloud version at firecrawl.dev includes additional features”
  • [community] https://news.ycombinator.com/item?id=42056056“Finally, people starting to realize that AGPL means you can just fork and remove everything you don't like (including branding).”

Read the product's source under an open licenseweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [github] https://github.com/mendableai/firecrawl“Firecrawl is open source under the AGPL-3.0 license. The cloud version at firecrawl.dev includes additional features”
  • [community] https://news.ycombinator.com/item?id=42056056“Finally, people starting to realize that AGPL means you can just fork and remove everything you don't like (including branding).”

Self-host the core productweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [github] https://github.com/mendableai/firecrawl“Firecrawl is open source under the AGPL-3.0 license. The cloud version at firecrawl.dev includes additional features”
  • [community] https://news.ycombinator.com/item?id=42056056“As I see, you use Puppeteer, not Playwright. Also, both Firecrawl and Firecrawl Simple are really simple, and most importantly don't have proxy service which is the heart of any crawler and scraper.”
  • [community] https://news.ycombinator.com/item?id=49148163“It being vibe coded aside, does it support screenshots? I noticed the daemon mode has a lot of weird limitations too like not being able to return html.”

Openness = 43.0 ÷ 100 × 100 = 43.0

Built-in AI18.5/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.firecrawl.dev“Webhooks Async event delivery”
  • [github] https://github.com/mendableai/firecrawl“Scrape thousands of URLs asynchronously”
  • [claimed-docs] https://docs.firecrawl.dev“MCP Server: Connect Firecrawl to any AI tool via the Model Context Protocol”
  • [probe] https://github.com/mendableai/firecrawl-mcp-server“official MCP server documented at https://github.com/mendableai/firecrawl-mcp-server”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

  • [github] https://github.com/mendableai/firecrawl“Describe what you need, and our AI agent searches, navigates, and retrieves it. No URLs required.”
  • [github] https://github.com/mendableai/firecrawl“Set how much reasoning the agent spends on the task”

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [github] https://github.com/mendableai/firecrawl“Describe what you need, and our AI agent searches, navigates, and retrieves it. No URLs required.”
  • [github] https://github.com/mendableai/firecrawl“Set how much reasoning the agent spends on the task”
  • [claimed-docs] https://docs.firecrawl.dev“One command installs the Firecrawl CLI, authenticates in your browser, and adds skills to every detected coding agent.”
  • [claimed-docs] https://docs.firecrawl.dev“MCP Server: Connect Firecrawl to any AI tool via the Model Context Protocol”
  • [probe] https://github.com/mendableai/firecrawl-mcp-server“official MCP server documented at https://github.com/mendableai/firecrawl-mcp-server”

Apply a preset configuration tuned for research agents that returns structured, citable outputweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Built-in AI = 20.4 ÷ 110 × 100 = 18.5

Automation26.7/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [github] https://github.com/mendableai/firecrawl“Crawl an entire website and get content from all pages.”
  • [github] https://github.com/mendableai/firecrawl“Discover all URLs on a website instantly.”
  • [github] https://github.com/mendableai/firecrawl“Scrape thousands of URLs asynchronously”
  • [claimed-docs] https://docs.firecrawl.dev“Webhooks Async event delivery”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

  • [claimed-docs] https://docs.firecrawl.dev“Webhooks Async event delivery”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 21.4 ÷ 80 × 100 = 26.7