[
  {
    "id": "firecrawl-docs-1",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "Extract content from any URL as markdown, HTML, or structured JSON",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-2",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "Search the web and get full page content from results in one call.",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-3",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "Scrape a page, then keep working with it: click, fill forms, extract dynamic content, or navigate deeper.",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-4",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "One command installs the Firecrawl CLI, authenticates in your browser, and adds skills to every detected coding agent.",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-5",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "MCP Server: Connect Firecrawl to any AI tool via the Model Context Protocol",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-1",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Describe what you need, and our AI agent searches, navigates, and retrieves it. No URLs required.",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-2",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Set how much reasoning the agent spends on the task",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-3",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Crawl an entire website and get content from all pages.",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-4",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Discover all URLs on a website instantly.",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-5",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Scrape thousands of URLs asynchronously",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-6",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "Turn local PDFs, DOCX, XLSX, HTML, and more into Markdown or structured JSON",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-7",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "Webhooks\n\nAsync event delivery",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-6",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Firecrawl is open source under the AGPL-3.0 license. The cloud version at firecrawl.dev includes additional features",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-gh-7",
    "tier": "github",
    "url": "https://github.com/mendableai/firecrawl",
    "excerpt": "Use a schema to get structured data:",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-docs-8",
    "tier": "claimed-docs",
    "url": "https://docs.firecrawl.dev",
    "excerpt": "Browser Sandbox\n\nManaged browser sessions for interactive workflows",
    "fetchedAt": "2026-08-28T01:16:08.505Z"
  },
  {
    "id": "firecrawl-comm-1",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=42056056",
    "excerpt": "Cool project, a mild pet peeve with this type of thing - I have to read 75% of the README before I find out what it even does.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-2",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=42056056",
    "excerpt": "Finally, people starting to realize that AGPL means you can just fork and remove everything you don't like (including branding).",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-3",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=42056056",
    "excerpt": "As I see, you use Puppeteer, not Playwright. Also, both Firecrawl and Firecrawl Simple are really simple, and most importantly don't have proxy service which is the heart of any crawler and scraper.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-4",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=49148163",
    "excerpt": "It being vibe coded aside, does it support screenshots? I noticed the daemon mode has a lot of weird limitations too like not being able to return html.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-5",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=49148163",
    "excerpt": "Quite useful. Currently we do overpay for the services [referring to Firecrawl-like scraping services].",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-6",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=49148163",
    "excerpt": "same setup here for news pages. tier 3 is where my money went, 320 solves a day and 10gb of proxy gone in two days.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-7",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=49148163",
    "excerpt": "I made newsagents.app and I ended up using the extract API from kagi and falling back to cloudflare's browser API for problem pages. That looks to be more cost efficient than firecrawl.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-8",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=40404615",
    "excerpt": "Excellent, another kind of copyright theft as a service that assumes your site is ripe for scraping unless you disallow yet another agent (FireCrawlAgent) that you won't find out about until it's too late.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-9",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=40404615",
    "excerpt": "Interesting... Looks like it would be good for RAG. Maybe add Ollama support for local hosting?",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-10",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=47578663",
    "excerpt": "I replaced Firecrawl with 2,700 lines of Elixir.",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-comm-11",
    "tier": "community",
    "url": "https://news.ycombinator.com/item?id=48819736",
    "excerpt": "how is it 6MB, how did you manage browser? because some sites are CSR only [question comparing to Firecrawl's larger footprint].",
    "fetchedAt": "2026-08-28T01:20:15.046Z"
  },
  {
    "id": "firecrawl-probe-1",
    "tier": "probe",
    "url": "https://docs.firecrawl.dev/llms.txt",
    "excerpt": "PROBE llms.txt: HTTP 200 at https://docs.firecrawl.dev/llms.txt # Firecrawl Docs\n\n## English\n\n### v2\n\n#### Documentation\n\n##### Get Started\n\n- [Introduction](https://docs.firecrawl.dev",
    "fetchedAt": "2026-08-28T21:08:58.165Z"
  },
  {
    "id": "firecrawl-probe-2",
    "tier": "probe",
    "url": "https://docs.firecrawl.dev/openapi.json",
    "excerpt": "PROBE openapi: all candidate paths 404 (https://docs.firecrawl.dev/openapi.json, https://docs.firecrawl.dev/swagger.json, https://docs.firecrawl.dev/api/openapi.json, https://docs.firecrawl.dev/.well-known/openapi.json)",
    "fetchedAt": "2026-08-28T21:08:58.165Z"
  },
  {
    "id": "firecrawl-probe-3",
    "tier": "probe",
    "url": "https://github.com/mendableai/firecrawl-mcp-server",
    "excerpt": "official MCP server documented at https://github.com/mendableai/firecrawl-mcp-server",
    "fetchedAt": "2026-08-28T21:08:58.165Z"
  },
  {
    "id": "firecrawl-probe-4",
    "tier": "probe",
    "url": "https://docs.firecrawl.dev/sdks/cli",
    "excerpt": "official CLI documented at https://docs.firecrawl.dev/sdks/cli",
    "fetchedAt": "2026-08-28T21:08:58.165Z"
  }
]