[
  {
    "id": "scrapingbee-docs-1",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "To scrape a web page, you only need two things: Your API key... The encoded web page URL you want to scrape",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-2",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "This can be useful for scraping a Single Page Application built with frameworks such as React.js, Angular.js, JQuery or Vue.",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-3",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "If you want to interact with pages you want to scrape before we return your the HTML you can add JavaScript scenario to your API call.",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-4",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "Our headless browsers will wait for the CSS / Xpath selector passed in the parameter before returning the HTML.",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-5",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "By default, ScrapingBee does not block ads. To avoid scraping them (e.g.,to speed up your request), use `block_ads=true`",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-6",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "By default, and to speed up requests, ScrapingBee blocks all images and CSS in the scraped page, but to scrape them, use `block_resources=false`",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-7",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "If you need to change the dimension of the browser's viewport (window) when scraping the target page you can use the `window_width` and `window_height` parameters.",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-8",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "extract_rules [stringified JSON] (\"\") Data extraction from CSS selectors",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-9",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "ai_query [string] (\"\") The information you want to extract from the webpage using AI",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-10",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "premium_proxy [boolean] (false) Use premium proxies to bypass difficult to scrape websites",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-11",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "country_code [string] (\"\") Premium proxy geolocation",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-12",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "session_id [integer] (\"\") Route multiple API requests through the same IP address",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-13",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "screenshot_selector [string] (\"\") Return a screenshot of a particular area of the page, targeted by a CSS selector",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-14",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "mode [string] (\"\") Let ScrapingBee pick the cheapest configuration that succeeds. Only value is auto",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-docs-15",
    "tier": "claimed-docs",
    "url": "https://www.scrapingbee.com/documentation",
    "excerpt": "return_page_markdown [boolean] (false) Return the page content in markdown format",
    "fetchedAt": "2026-08-28T01:17:19.293Z"
  },
  {
    "id": "scrapingbee-comm-1",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=41221007",
    "excerpt": "Using ScrapingBee is expensive; I've brought the cost of a CRM creation down to about 1.5 cents (+3 cents for a custom cover image) by looking at cheaper alternatives.",
    "fetchedAt": "2026-08-28T01:21:36.772Z"
  },
  {
    "id": "scrapingbee-comm-2",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=41221007",
    "excerpt": "Have you looked at running something locally instead of paying for ScrapingBee? I'm using Laravel and considering Dusk to retrieve page contents instead.",
    "fetchedAt": "2026-08-28T01:21:36.772Z"
  },
  {
    "id": "scrapingbee-comm-3",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=41221007",
    "excerpt": "Any plans on open sourcing any part of your stack instead of relying on paid services like ScrapingBee? What does your SaaS setup look like?",
    "fetchedAt": "2026-08-28T01:21:36.772Z"
  },
  {
    "id": "scrapingbee-comm-4",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=41221007",
    "excerpt": "cool idea, but I don't like how I need to use two separate API keys to connect to this API (which relies on ScrapingBee for scraping) - can you make it simpler?",
    "fetchedAt": "2026-08-28T01:21:36.772Z"
  },
  {
    "id": "scrapingbee-comm-5",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=41221007",
    "excerpt": "Reminds me of Kimono Labs and Roborabbit, older tools that did similar webpage-to-API scraping before services like ScrapingBee became common.",
    "fetchedAt": "2026-08-28T01:21:36.772Z"
  },
  {
    "id": "scrapingbee-probe-1",
    "tier": "probe",
    "url": "https://www.scrapingbee.com/llms.txt",
    "excerpt": "PROBE llms.txt: HTTP 200 at https://www.scrapingbee.com/llms.txt # ScrapingBee Documentation\n\n> Official documentation index for ScrapingBee's web scraping, search, ecommerce, AI, devel",
    "fetchedAt": "2026-08-28T22:35:55.014Z"
  },
  {
    "id": "scrapingbee-probe-2",
    "tier": "probe",
    "url": "https://www.scrapingbee.com/documentation.md",
    "excerpt": "PROBE docs-md: HTTP 404 at https://www.scrapingbee.com/documentation.md",
    "fetchedAt": "2026-08-28T22:35:55.014Z"
  },
  {
    "id": "scrapingbee-probe-3",
    "tier": "probe",
    "url": "https://www.scrapingbee.com/openapi.json",
    "excerpt": "PROBE openapi: all candidate paths 404 (https://www.scrapingbee.com/openapi.json, https://www.scrapingbee.com/swagger.json, https://www.scrapingbee.com/api/openapi.json, https://www.scrapingbee.com/.well-known/openapi.json)",
    "fetchedAt": "2026-08-28T22:35:55.014Z"
  },
  {
    "id": "scrapingbee-probe-4",
    "tier": "probe",
    "url": "https://mcp.scrapingbee.com/",
    "excerpt": "official MCP server documented at https://mcp.scrapingbee.com/",
    "fetchedAt": "2026-08-28T22:35:55.014Z"
  },
  {
    "id": "scrapingbee-probe-5",
    "tier": "probe",
    "url": "https://github.com/ScrapingBee/scrapingbee-cli",
    "excerpt": "official CLI documented at https://github.com/ScrapingBee/scrapingbee-cli",
    "fetchedAt": "2026-08-28T22:35:55.014Z"
  }
]