How DeepInfra’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score10/100
Agent-ready 25.7 × 0.30 = 7.71
API quality 0.0 × 0.20 = 0.00
Openness 10.3 × 0.20 = 2.06
Built-in AI 0.0 × 0.15 = 0.00
Automation 0.0 × 0.15 = 0.00
(7.71 + 0.00 + 2.06 + 0.00 + 0.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 9.77 ÷ 1.00 = 9.8
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready25.7/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://deepinfra.com/llms.txt“PROBE llms.txt: HTTP 404 at https://deepinfra.com/llms.txt”
- [probe] https://deepinfra.com/docs.md“PROBE docs-md: HTTP 404 at https://deepinfra.com/docs.md”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: 1. Set `base_url` to `https://api.deepinfra.com/v1/openai` 2. Set `api_key` to your DeepInfra token 3. Set `model` to a model from our catalog”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: Set base_url to https://api.deepinfra.com/v1/openai”
- [probe] https://api.deepinfra.com/v1/openai/models“PROBE models-endpoint (2026-09-04): GET https://api.deepinfra.com/v1/openai/models with NO API key returned HTTP 200 with a machine-readable catalog of 189 models — an agent can enumerate the live model list keylessly via the OpenAI-compatible models endpoint.”
- [claimed-docs] https://deepinfra.com/docs“You only pay per token — no idle GPU time, no minimums, no seat fees.”
Plug MCP servers into this product so it can use their toolsweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Connect an agent via an official MCP serverweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Use an official CLIweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://deepinfra.com/docs“Point your existing OpenAI SDK to `https://api.deepinfra.com/v1/openai` and your code works without changes. No migration required.”
- [probe] https://deepinfra.com/llms.txt“PROBE llms.txt: HTTP 404 at https://deepinfra.com/llms.txt”
- [probe] https://deepinfra.com/docs.md“PROBE docs-md: HTTP 404 at https://deepinfra.com/docs.md”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
Drive the product through a documented public APIweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://deepinfra.com/docs“Point your existing OpenAI SDK to `https://api.deepinfra.com/v1/openai` and your code works without changes. No migration required.”
- [claimed-docs] https://deepinfra.com/docs/inference“OpenAI-compatible chat completions API — just change the base URL and model name.”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: 1. Set `base_url` to `https://api.deepinfra.com/v1/openai` 2. Set `api_key` to your DeepInfra token 3. Set `model` to a model from our catalog”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: Set base_url to https://api.deepinfra.com/v1/openai”
- [claimed-docs] https://deepinfra.com/docs/inference“Set service_tier to "priority" to request priority inference on supported models. Priority requests get faster time-to-first-token and higher throughput during peak demand.”
- [claimed-docs] https://deepinfra.com/docs/inference“Set service_tier to "flex" to run Chat Completions requests at a lower cost in exchange for slower response times and occasional resource unavailability.”
- [claimed-docs] https://deepinfra.com/docs/inference“Set the optional fail_fast parameter to true to get an immediate HTTP 429 instead of waiting.”
- [probe] https://api.deepinfra.com/v1/openai/models“PROBE models-endpoint (2026-09-04): GET https://api.deepinfra.com/v1/openai/models with NO API key returned HTTP 200 with a machine-readable catalog of 189 models — an agent can enumerate the live model list keylessly via the OpenAI-compatible models endpoint.”
- [probe] https://deepinfra.com/llms.txt“PROBE llms.txt: HTTP 404 at https://deepinfra.com/llms.txt”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: 1. Set `base_url` to `https://api.deepinfra.com/v1/openai` 2. Set `api_key` to your DeepInfra token 3. Set `model` to a model from our catalog”
- [claimed-docs] https://deepinfra.com/docs“Drop-in OpenAI replacement. Point your existing OpenAI SDK to https://api.deepinfra.com/v1/openai and your code works without changes.”
Build against official SDKsweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://deepinfra.com/docs“Point your existing OpenAI SDK to `https://api.deepinfra.com/v1/openai` and your code works without changes. No migration required.”
- [claimed-docs] https://deepinfra.com/docs“Point your existing OpenAI SDK to https://api.deepinfra.com/v1/openai and your code works without changes. No migration required.”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: 1. Set `base_url` to `https://api.deepinfra.com/v1/openai` 2. Set `api_key` to your DeepInfra token 3. Set `model` to a model from our catalog”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: Set base_url to https://api.deepinfra.com/v1/openai”
- [claimed-docs] https://deepinfra.com/docs“Drop-in OpenAI replacement. Point your existing OpenAI SDK to https://api.deepinfra.com/v1/openai and your code works without changes.”
- [probe] https://api.deepinfra.com/v1/openai/models“PROBE models-endpoint (2026-09-04): GET https://api.deepinfra.com/v1/openai/models with NO API key returned HTTP 200 with a machine-readable catalog of 189 models — an agent can enumerate the live model list keylessly via the OpenAI-compatible models endpoint.”
Subscribe to events via webhooksweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Agent-ready = 54.0 ÷ 210 × 100 = 25.7
API quality0.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://deepinfra.com/llms.txt“PROBE llms.txt: HTTP 404 at https://deepinfra.com/llms.txt”
- [probe] https://deepinfra.com/docs.md“PROBE docs-md: HTTP 404 at https://deepinfra.com/docs.md”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: 1. Set `base_url` to `https://api.deepinfra.com/v1/openai` 2. Set `api_key` to your DeepInfra token 3. Set `model` to a model from our catalog”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://deepinfra.com/llms.txt“PROBE llms.txt: HTTP 404 at https://deepinfra.com/llms.txt”
- [probe] https://deepinfra.com/docs.md“PROBE docs-md: HTTP 404 at https://deepinfra.com/docs.md”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
- [claimed-docs] https://deepinfra.com/docs“Need to run your own fine-tuned weights, or require data isolation? Deploy a dedicated instance on A100/H100/H200/B200/B300 with autoscaling and a private endpoint”
- [claimed-docs] https://deepinfra.com“With our zero retention policy your inputs, your outputs, and your user data stay private. DeepInfra is SOC 2 and ISO 27001 certified.”
- [claimed-docs] https://deepinfra.com/docs“You only pay per token — no idle GPU time, no minimums, no seat fees.”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://deepinfra.com/docs.md“PROBE docs-md: HTTP 404 at https://deepinfra.com/docs.md”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
- [claimed-docs] https://deepinfra.com/docs/inference“The only changes you need to make from your existing OpenAI code: 1. Set `base_url` to `https://api.deepinfra.com/v1/openai` 2. Set `api_key` to your DeepInfra token 3. Set `model` to a model from our catalog”
API quality = 0.0 ÷ 70 × 100 = 0.0
Openness10.3/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://deepinfra.com/docs/inference“OpenAI-compatible chat completions API — just change the base URL and model name.”
- [claimed-docs] https://deepinfra.com/docs“Run your own fine-tuned LLM on A100 / H100 / H200 / B200 / B300 with autoscaling.”
- [claimed-docs] https://deepinfra.com/docs“Need to run your own fine-tuned weights, or require data isolation? Deploy a dedicated instance on A100/H100/H200/B200/B300 with autoscaling and a private endpoint”
- [claimed-docs] https://deepinfra.com/docs“GPU Clusters for training and full control. Rent a B200 or B300 cluster with SSH access and run whatever you want.”
- [claimed-docs] https://deepinfra.com/docs“Embeddings & Reranking State-of-the-art embedding and reranker models for search and RAG.”
- [claimed-docs] https://deepinfra.com/docs“Image & Video Generation FLUX, Stable Diffusion, text-to-video, and more.”
- [claimed-docs] https://deepinfra.com/docs“Speech recognition (Whisper) and text-to-speech models.”
- [claimed-docs] https://deepinfra.com/docs“Vision & OCR Multimodal models for visual understanding and document text extraction.”
- [probe] https://deepinfra.com/llms.txt“PROBE llms.txt: HTTP 404 at https://deepinfra.com/llms.txt”
- [probe] https://deepinfra.com/docs.md“PROBE docs-md: HTTP 404 at https://deepinfra.com/docs.md”
- [probe] https://deepinfra.com/openapi.json“PROBE openapi: all candidate paths 404 (https://deepinfra.com/openapi.json, https://deepinfra.com/swagger.json, https://deepinfra.com/api/openapi.json, https://deepinfra.com/.well-known/openapi.json)”
- [probe] https://api.deepinfra.com/v1/openai/models“PROBE models-endpoint (2026-09-04): GET https://api.deepinfra.com/v1/openai/models with NO API key returned HTTP 200 with a machine-readable catalog of 189 models — an agent can enumerate the live model list keylessly via the OpenAI-compatible models endpoint.”
Export all of my data in open formats and leaveweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://deepinfra.com“With our zero retention policy your inputs, your outputs, and your user data stay private. DeepInfra is SOC 2 and ISO 27001 certified.”
Read the product's source under an open licenseweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Self-host the core productweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Openness = 7.2 ÷ 70 × 100 = 10.3
Built-in AI0.0/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
n/a — not applicable to this product: excluded from numerator and denominator
- [claimed-docs] https://deepinfra.com/docs“DeepInfra is an AI inference cloud that makes it simple to run the latest machine learning models at scale — LLMs, vision, embeddings, image generation, video generation, speech, and more.”
- [claimed-docs] https://deepinfra.com/docs“Embeddings & Reranking State-of-the-art embedding and reranker models for search and RAG.”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Operate the product with natural-language commandsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Built-in AI = 0.0 ÷ 70 × 100 = 0.0
Automation0.0/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://deepinfra.com/docs/inference“It’s ideal for non-production or lower-priority tasks such as model evaluations, data enrichment, and asynchronous workloads.”
- [claimed-docs] https://deepinfra.com/docs/inference“Set service_tier to "flex" to run Chat Completions requests at a lower cost in exchange for slower response times and occasional resource unavailability.”
Define rules that trigger actions automatically on eventsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Schedule recurring jobs or workflowsweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Version, review, and roll back my automationsweight 1
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Automation = 0.0 ÷ 20 × 100 = 0.0