AI Search APIs — procurement report
ProductArena · rankings as of 2026-09-16 · evidence as of 2026-09-16 · 5 products · 50 judged requirements · 250 judged cells
Methodology: Every product is judged against a shared taxonomy of user stories using cited evidence — hands-on probes > repository code > independent community sources > vendor claims — never opinion. Full writeup: https://ultrametric.ai/productarena/methodology
Leaderboard
| # | Product | PA Score | Coverage score | Applicable cells | Confidence |
|---|---|---|---|---|---|
| 1 | Tavily | 38.5 | 33.2 | 43/50 | B |
| 2 | Perplexity Sonar API | 32.7 | 33.2 | 48/50 | C |
| 3 | Exa | 31.0 | 38.2 | 47/50 | B |
| 4 | Brave Search API | 31.0 | 28.8 | 41/50 | C |
| 5 | SerpApi | 22.0 | 30.3 | 45/50 | A |
PA Score = agent-readiness blend (see methodology). Coverage score = weighted share of judged requirements met. Confidence = how much of the score rests on tested vs claimed evidence (A–D).
Uncertainty note
The current #1/#2 gap in this arena is not close enough to qualify for the multi-judge uncertainty pass (or the pass has not covered it yet) — no extra caveat applies beyond the per-product confidence grades above.
Buyer checklist (RFP)
The arena's 50 judged user stories as requirements, grouped by theme. Priorities mirror the story weights our scoring uses (3 = must-have, 2 = should-have, 1 = nice-to-have). Interactive version with per-requirement verdicts for the top products: /arena/ai-search-apis/checklist
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
- ai-native userPlug MCP servers into this product so it can use their toolsmust-have
- ai-native userConnect an agent via an official MCP servermust-have
- ai-native userDrive the product through a documented public APImust-have
- ai-native userDelegate tasks to a built-in AI assistant inside the productmust-have
- ai-native userPoint an agent at llms.txt or agent-oriented docsshould-have
- ai-native userRun the product headlessly / in CI for automationshould-have
- ai-native userUse an official CLIshould-have
- ai-native userIssue scoped/least-privilege API credentials for an agentshould-have
- ai-native userBuild against official SDKsshould-have
- ai-native userSubscribe to events via webhooksshould-have
- ai-native userGet AI-generated insights and suggestions from my data inside the productshould-have
- ai-native userSet up automations that run autonomously in the backgroundshould-have
- ai-native userOperate the product with natural-language commandsshould-have
- ai-native userExplore an interactive API reference with runnable examplesshould-have
- ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)should-have
- ai-native userRely on versioned APIs with a documented deprecation policyshould-have
- ai-native userTest against a sandbox environment without touching production datanice-to-have
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
- ai-native userDefine rules that trigger actions automatically on eventsmust-have
- ai-native userPerform bulk operations across many items at onceshould-have
- ai-native userSchedule recurring jobs or workflowsshould-have
- ai-native userVersion, review, and roll back my automationsnice-to-have
Citations trust — stories about citations trust in this arenaCitations trust
Stories about citations trust in this arena
- developerRely on results carrying canonical URLs, titles, and published dates so my app can cite sources accuratelymust-have
- data engineerRead a documented stance on robots.txt, content licensing, and permitted use of resultsshould-have
Content extraction — stories about content extraction in this arenaContent extraction
Stories about content extraction in this arena
- developerRetrieve full page text or markdown for results, not just snippetsmust-have
- ai-native userHave an agent run a multi-step research flow — search, extract contents, and synthesize — through one APIshould-have
- developerGet structured output matching a JSON schema I defineshould-have
- data engineerCrawl subpages or entire sites starting from a search resultnice-to-have
Filters controls — stories about filters controls in this arenaFilters controls
Stories about filters controls in this arena
- developerRestrict or exclude specific domains from my search resultsshould-have
- developerRead per-result relevance scores to threshold what enters my pipelinenice-to-have
Freshness coverage — stories about freshness coverage in this arenaFreshness coverage
Stories about freshness coverage in this arena
- data engineerGet fresh results with date-range and recency filters backed by a frequently updated indexmust-have
- data engineerQuery dedicated verticals like news, images, or finance through specific endpoints or category filtersshould-have
- data engineerLocalize results by country, language, or location parametersshould-have
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
- ai-native userExport all of my data in open formats and leavemust-have
- ai-native userSelf-host the core productmust-have
- ai-native userDo everything through the API that I can do in the UIshould-have
- ai-native userRead the product's source under an open licenseshould-have
Pricing limits — free-tier ceilings, usage caps, and rate limits before you have to payPricing limits
Free-tier ceilings, usage caps, and rate limits before you have to pay
- developerSee clear per-request or per-credit pricing without talking to salesmust-have
- developerRead documented rate limits and concurrency caps with a self-serve upgrade pathshould-have
- developerPrototype against the API on a free tier or free creditsshould-have
- data engineerSubmit batched or asynchronous jobs for high-volume query workloadsshould-have
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
- ai-native userPrevent my data from being used to train AI modelsmust-have
- ai-native userChoose where my data is stored (region/residency)should-have
- ai-native userControl data retention and deletionshould-have
- ai-native userOpt out of telemetry and usage trackingshould-have
Search quality — stories about search quality in this arenaSearch quality
Stories about search quality in this arena
- ai-native userPlug the API into an agent as a ready-made tool, with function-calling schemas and agent-framework integrations designed for direct tool-call consumptionmust-have
- developerGet results sized and ranked for direct use as LLM context in a RAG pipelinemust-have
- developerRun meaning-based semantic search that finds results keyword engines missmust-have
- developerGet a sourced, LLM-generated answer to a query in a single API callshould-have
- developerChoose between keyword, neural, or hybrid retrieval modes per queryshould-have
- developerFind pages similar to a URL I already havenice-to-have
Pricing signals
Extracted verbatim from each vendor's own pricing page — never converted, averaged, or derived. Products whose page prints no unit price are recorded as unclear, honestly.
| Product | Headline price | Unit | As of |
|---|---|---|---|
| Tavily | $0.008 | search | 2026-09-07 |
| Perplexity Sonar API | $5 | 1k searches | 2026-09-07 |
| Exa | $7 | 1k searches | 2026-09-07 |
| Brave Search API | $4 | 1k searches | 2026-09-07 |
| SerpApi | $25 | month (entry plan) | 2026-09-07 |
Appendix: recorded probes
No replayable probe recordings exist for this arena yet. Probe-tier evidence (hands-on checks) still backs verdicts where cited — see each product page for the evidence trail.
Cite as: ProductArena by Ultrametric Inc, AI Search APIs arena, rankings as of 2026-09-16 — https://ultrametric.ai/productarena/arena/ai-search-apis
License: © 2026 Ultrametric Inc. Brief quotation of individual verdicts, scores, or evidence excerpts is permitted with attribution to "ProductArena by Ultrametric Inc (ultrametric.ai/productarena)", as is use of the data to evaluate, contest, or contribute corrections. Bulk copying, redistribution, or use to build competing datasets requires prior written permission (see DATA-LICENSE in the repository).
No liability: rankings, verdicts, and scores are research outputs derived from the cited evidence at a point in time, provided "as is", without warranties. Ultrametric Inc accepts no responsibility for procurement, purchasing, or other decisions made in reliance on them — verify against the cited evidence before acting (https://ultrametric.ai/productarena/terms).