How ScrapingBee’s scores are calculated

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [probe] https://www.scrapingbee.com/llms.txt“PROBE llms.txt: HTTP 200 at https://www.scrapingbee.com/llms.txt # ScrapingBee Documentation > Official documentation index for ScrapingBee's web scraping, search, ecommerce, AI, devel”
• [probe] https://www.scrapingbee.com/documentation.md“PROBE docs-md: HTTP 404 at https://www.scrapingbee.com/documentation.md”
• [probe] https://mcp.scrapingbee.com/“official MCP server documented at https://mcp.scrapingbee.com/”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“To scrape a web page, you only need two things: Your API key... The encoded web page URL you want to scrape”
• [probe] https://github.com/ScrapingBee/scrapingbee-cli“official CLI documented at https://github.com/ScrapingBee/scrapingbee-cli”

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

• [probe] https://mcp.scrapingbee.com/“official MCP server documented at https://mcp.scrapingbee.com/”

Connect an agent via an official MCP serverweight 3

3 (weight) × 6 (quality) × 1.0 (full) = 18.0 of 30 max

• [probe] https://mcp.scrapingbee.com/“official MCP server documented at https://mcp.scrapingbee.com/”

Use an official CLIweight 2

2 (weight) × 6 (quality) × 1.0 (full) = 12.0 of 20 max

• [probe] https://github.com/ScrapingBee/scrapingbee-cli“official CLI documented at https://github.com/ScrapingBee/scrapingbee-cli”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://www.scrapingbee.com/documentation“To scrape a web page, you only need two things: Your API key... The encoded web page URL you want to scrape”
• [claimed-docs] https://www.scrapingbee.com/documentation“extract_rules [stringified JSON] ("") Data extraction from CSS selectors”
• [claimed-docs] https://www.scrapingbee.com/documentation“ai_query [string] ("") The information you want to extract from the webpage using AI”
• [probe] https://www.scrapingbee.com/llms.txt“PROBE llms.txt: HTTP 200 at https://www.scrapingbee.com/llms.txt # ScrapingBee Documentation > Official documentation index for ScrapingBee's web scraping, search, ecommerce, AI, devel”
• [probe] https://mcp.scrapingbee.com/“official MCP server documented at https://mcp.scrapingbee.com/”
• [probe] https://github.com/ScrapingBee/scrapingbee-cli“official CLI documented at https://github.com/ScrapingBee/scrapingbee-cli”
• [probe] https://www.scrapingbee.com/openapi.json“PROBE openapi: all candidate paths 404 (https://www.scrapingbee.com/openapi.json, https://www.scrapingbee.com/swagger.json, https://www.scrapingbee.com/api/openapi.json, https://www.scrapingbee.com/.well-known/openapi.json)”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“To scrape a web page, you only need two things: Your API key... The encoded web page URL you want to scrape”
• [community] https://news.ycombinator.com/item?id=41221007“cool idea, but I don't like how I need to use two separate API keys to connect to this API (which relies on ScrapingBee for scraping) - can you make it simpler?”

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“To scrape a web page, you only need two things: Your API key... The encoded web page URL you want to scrape”
• [probe] https://www.scrapingbee.com/documentation.md“PROBE docs-md: HTTP 404 at https://www.scrapingbee.com/documentation.md”
• [probe] https://www.scrapingbee.com/openapi.json“PROBE openapi: all candidate paths 404 (https://www.scrapingbee.com/openapi.json, https://www.scrapingbee.com/swagger.json, https://www.scrapingbee.com/api/openapi.json, https://www.scrapingbee.com/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://www.scrapingbee.com/documentation.md“PROBE docs-md: HTTP 404 at https://www.scrapingbee.com/documentation.md”
• [probe] https://www.scrapingbee.com/openapi.json“PROBE openapi: all candidate paths 404 (https://www.scrapingbee.com/openapi.json, https://www.scrapingbee.com/swagger.json, https://www.scrapingbee.com/api/openapi.json, https://www.scrapingbee.com/.well-known/openapi.json)”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://www.scrapingbee.com/openapi.json“PROBE openapi: all candidate paths 404 (https://www.scrapingbee.com/openapi.json, https://www.scrapingbee.com/swagger.json, https://www.scrapingbee.com/api/openapi.json, https://www.scrapingbee.com/.well-known/openapi.json)”
• [probe] https://www.scrapingbee.com/documentation.md“PROBE docs-md: HTTP 404 at https://www.scrapingbee.com/documentation.md”

The documented rate limit (requests per second or minute) enforced on my API key before throttling kicks inweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“To scrape a web page, you only need two things: Your API key... The encoded web page URL you want to scrape”
• [claimed-docs] https://www.scrapingbee.com/documentation“If you want to interact with pages you want to scrape before we return your the HTML you can add JavaScript scenario to your API call.”
• [claimed-docs] https://www.scrapingbee.com/documentation“extract_rules [stringified JSON] ("") Data extraction from CSS selectors”
• [claimed-docs] https://www.scrapingbee.com/documentation“ai_query [string] ("") The information you want to extract from the webpage using AI”
• [claimed-docs] https://www.scrapingbee.com/documentation“screenshot_selector [string] ("") Return a screenshot of a particular area of the page, targeted by a CSS selector”

Export all of my data in open formats and leaveweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

• [claimed-docs] https://www.scrapingbee.com/documentation“extract_rules [stringified JSON] ("") Data extraction from CSS selectors”
• [claimed-docs] https://www.scrapingbee.com/documentation“return_page_markdown [boolean] (false) Return the page content in markdown format”
• [claimed-docs] https://www.scrapingbee.com/documentation“ai_query [string] ("") The information you want to extract from the webpage using AI”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [community] https://news.ycombinator.com/item?id=41221007“Any plans on open sourcing any part of your stack instead of relying on paid services like ScrapingBee? What does your SaaS setup look like?”

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

• [community] https://news.ycombinator.com/item?id=41221007“Any plans on open sourcing any part of your stack instead of relying on paid services like ScrapingBee? What does your SaaS setup look like?”
• [community] https://news.ycombinator.com/item?id=41221007“Have you looked at running something locally instead of paying for ScrapingBee? I'm using Laravel and considering Dusk to retrieve page contents instead.”

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“ai_query [string] ("") The information you want to extract from the webpage using AI”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“ai_query [string] ("") The information you want to extract from the webpage using AI”
• [probe] https://mcp.scrapingbee.com/“official MCP server documented at https://mcp.scrapingbee.com/”

Apply a preset configuration tuned for research agents that returns structured, citable outputweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

• [claimed-docs] https://www.scrapingbee.com/documentation“ai_query [string] ("") The information you want to extract from the webpage using AI”
• [claimed-docs] https://www.scrapingbee.com/documentation“return_page_markdown [boolean] (false) Return the page content in markdown format”
• [claimed-docs] https://www.scrapingbee.com/documentation“extract_rules [stringified JSON] ("") Data extraction from CSS selectors”
• [probe] https://mcp.scrapingbee.com/“official MCP server documented at https://mcp.scrapingbee.com/”

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh