Skip to content
ProductArena

How Portkey’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score20/100

Agent-ready 36.2 × 0.30 = 10.86

API quality 6.9 × 0.20 = 1.38

Openness 22.8 × 0.20 = 4.56

Built-in AI 0.0 × 0.15 = 0.00

Automation 18.0 × 0.15 = 2.70

(10.86 + 1.38 + 4.56 + 0.00 + 2.70) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 19.50 ÷ 1.00 = 19.5

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready36.2/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://portkey.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://portkey.ai/llms.txt # Portkey > Portkey is a production stack for Gen AI builders, equipping AI teams with everything they need to go to pr”
  • [probe] https://portkey.ai/docs.md“PROBE docs-md: HTTP 404 at https://portkey.ai/docs.md”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“npx @portkey-ai/gateway”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“Connect to Remote MCP severs, allowing you to connect external tools and data sources.”

Connect an agent via an official MCP serverweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“Connect to Remote MCP severs, allowing you to connect external tools and data sources.”

Use an official CLIweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“npx @portkey-ai/gateway”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“Ideal for: if you’re currently utilizing OpenAI’s Python or Node.js SDKs. By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey's features into your existing setup.”
  • [probe] https://portkey.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://portkey.ai/llms.txt # Portkey > Portkey is a production stack for Gen AI builders, equipping AI teams with everything they need to go to pr”
  • [probe] https://portkey.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://portkey.ai/openapi.json, https://portkey.ai/swagger.json, https://portkey.ai/api/openapi.json, https://portkey.ai/.well-known/openapi.json)”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“Configure budget and rate limits on API keys to effectively manage AI spending and usage across your organization”
  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“Budget limits allow you to set maximum LLM spending or token usage thresholds on your API keys, automatically preventing further usage when limits are reached.”
  • [claimed-docs] https://portkey.ai/docs/product/model-catalog“Fine-grained control: budgets, rate limits, and model allow-lists at both org and workspace level.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“Set hourly, daily, or per minute rate limits on requests or tokens sent”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway/virtual-keys“Provider credentials stored securely, never exposed in code”

Build against official SDKsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“Ideal for: if you’re currently utilizing OpenAI’s Python or Node.js SDKs. By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey's features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”
  • [probe] https://portkey.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://portkey.ai/openapi.json, https://portkey.ai/swagger.json, https://portkey.ai/api/openapi.json, https://portkey.ai/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 76.0 ÷ 210 × 100 = 36.2

API quality6.9/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“Ideal for: if you’re currently utilizing OpenAI’s Python or Node.js SDKs. By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey's features into your existing setup.”
  • [probe] https://portkey.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://portkey.ai/openapi.json, https://portkey.ai/swagger.json, https://portkey.ai/api/openapi.json, https://portkey.ai/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://portkey.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://portkey.ai/openapi.json, https://portkey.ai/swagger.json, https://portkey.ai/api/openapi.json, https://portkey.ai/.well-known/openapi.json)”
  • [probe] https://portkey.ai/docs.md“PROBE docs-md: HTTP 404 at https://portkey.ai/docs.md”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”
  • [probe] https://portkey.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://portkey.ai/openapi.json, https://portkey.ai/swagger.json, https://portkey.ai/api/openapi.json, https://portkey.ai/.well-known/openapi.json)”

API quality = 4.8 ÷ 70 × 100 = 6.9

Openness22.8/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“The base URL for all REST API requests is `https://api.portkey.ai/v1`”
  • [claimed-docs] https://portkey.ai/docs/api-reference/inference-api/introduction“Ideal for: if you’re currently utilizing OpenAI’s Python or Node.js SDKs. By changing the base URL and adding Portkey-specific headers, you can quickly integrate Portkey’s features into your existing setup.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”
  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“Configure budget and rate limits on API keys to effectively manage AI spending and usage across your organization”
  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“The Logs section presents a chronological list of all the requests processed through Portkey.”
  • [probe] https://portkey.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://portkey.ai/openapi.json, https://portkey.ai/swagger.json, https://portkey.ai/api/openapi.json, https://portkey.ai/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“The Logs section presents a chronological list of all the requests processed through Portkey.”
  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“Each log on Portkey has a unique URL. You can copy the link from the address bar and directly share it with anyone in your org.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”

Read the product's source under an open licenseweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“npx @portkey-ai/gateway”

Self-host the core productweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“npx @portkey-ai/gateway”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:”
  • [claimed-docs] https://portkey.ai/docs/product/model-catalog“A single pane to view and manage every AI provider and model in your organization. It provides centralized governance, discovery, and usage controls for all your AI resources.”
  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“Configure budget and rate limits on API keys to effectively manage AI spending and usage across your organization”

Openness = 22.8 ÷ 100 × 100 = 22.8

Built-in AI0.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“The Logs section presents a chronological list of all the requests processed through Portkey.”
  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“you can also add manual feedback on the logs to be analysed and filtered later”
  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“Configure budget and rate limits on API keys to effectively manage AI spending and usage across your organization”

Set up automations that run autonomously in the backgroundweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Built-in AI = 0.0 ÷ 40 × 100 = 0.0

Automation18.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway/fallbacks“Specify a prioritized list of providers/models. If the primary LLM fails, Portkey automatically falls back to the next in line.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway/fallbacks“By default, fallback triggers on any **non-2xx** status code. Customize with `on_status_codes`”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway/automatic-retries“Automatically retry failed LLM requests with exponential backoff.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“Configure per-strategy circuit protection and failure handling”
  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“When usage reaches this threshold, notifications will be sent to configured recipients”
  • [claimed-docs] https://portkey.ai/docs/product/administration/enforce-budget-and-rate-limit“Budget limits allow you to set maximum LLM spending or token usage thresholds on your API keys, automatically preventing further usage when limits are reached.”
  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway“Set hourly, daily, or per minute rate limits on requests or tokens sent”

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

  • [claimed-docs] https://portkey.ai/docs/product/ai-gateway/fallbacks“Filter logs by `Config ID` to see all requests using that config”
  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“The Logs section presents a chronological list of all the requests processed through Portkey.”
  • [claimed-docs] https://portkey.ai/docs/product/observability/logs“Each log on Portkey has a unique URL. You can copy the link from the address bar and directly share it with anyone in your org.”

Automation = 10.8 ÷ 60 × 100 = 18.0