Skip to content

How Milvus’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score36/100

Agent-ready 57.8 × 0.30 = 17.34

API quality 10.0 × 0.20 = 2.00

Openness 64.2 × 0.20 = 12.84

Built-in AI 10.3 × 0.15 = 1.55

Automation 12.0 × 0.15 = 1.80

(17.34 + 2.00 + 12.84 + 1.55 + 1.80) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 35.52 ÷ 1.00 = 35.5

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready57.8/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://milvus.io/llms.txtPROBE llms.txt: HTTP 200 at https://milvus.io/llms.txt # Milvus > Milvus is an open-source, high-performance vector database designed for similarity search and AI application

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production.
  • [github] https://github.com/milvus-io/milvusThis installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client
  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdfrom pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdTo create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data
  • [github] https://github.com/milvus-io/milvusThis installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client
  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus
  • [probe] https://milvus.io/openapi.jsonPROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/adminGuide/rbac.mdWith RBAC, you can finely control the operations users can perform at the collection, database, and instance levels, enhancing data security
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/adminGuide/rbac.mdWith RBAC, you can finely control the operations users can perform at the collection, database, and instance levels, enhancing data security.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus

Build against official SDKsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdTo create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data
  • [github] https://github.com/milvus-io/milvusThis installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdMilvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.
  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,
  • [community] https://hn.algolia.com/api/v1/items/40522400I recently used Milvus for the first time - it made sense because it was quick to implement, purpose built, and worked exactly as intended.

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 104.0 ÷ 180 × 100 = 57.8

API quality10.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://milvus.io/openapi.jsonPROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdfrom pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")
  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://milvus.io/openapi.jsonPROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 7 (quality) × 1.0 (full) = 7.0 of 10 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdTo create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdMilvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/about/overview.mdMilvus Lite is a Python library that can be easily integrated into your applications. As a lightweight version of Milvus, it’s ideal for quick prototyping in Jupyter Notebooks or running on edge devices
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdfrom pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")
  • [github] https://github.com/milvus-io/milvusThis installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://milvus.io/openapi.jsonPROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)

API quality = 7.0 ÷ 70 × 100 = 10.0

Openness64.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdMilvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdfrom pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")
  • [github] https://github.com/milvus-io/milvusThis installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client
  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,
  • [probe] https://milvus.io/openapi.jsonPROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)

Export all of my data in open formats and leaveweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdTo create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdfrom pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production
  • [github] https://github.com/milvus-io/milvusMilvus also supports Standalone mode for single machine deployment.

Read the product's source under an open licenseweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.mdMilvus is an open-source vector database that suits AI applications of every size from running a demo chatbot in Jupyter notebook to building web-scale search that serves billions of users.
  • [github] https://github.com/milvus-io/milvusThis installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client
  • [github] https://github.com/milvus-io/milvusMilvus also supports Standalone mode for single machine deployment.
  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,
  • [probe] https://milvus.io/llms.txtPROBE llms.txt: HTTP 200 at https://milvus.io/llms.txt # Milvus > Milvus is an open-source, high-performance vector database designed for similarity search and AI application

Self-host the core productweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdWith the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdMilvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.
  • [github] https://github.com/milvus-io/milvusMilvus also supports Standalone mode for single machine deployment.
  • [community] https://hn.algolia.com/api/v1/items/46222002For people who run thousands of QPS on billions of vectors, Milvus is a solid choice... I've seen many builders migrate from pgvector to Milvus as their apps scale, but perhaps they wish they had considered scalability earlier. (from a Milvus team member, self-described as possibly biased)
  • [community] https://hn.algolia.com/api/v1/items/46222002pgVector is great and so is FAISS, but those are just a subset of what you get from Milvus - if you want hybrid search, different IVF variants, disk-based search, horizontal scaling, SIMD, or sparse vectors, Milvus is great.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/about/overview.mdIn 2022, Milvus supported billion-scale vectors, and in 2023, it scaled up to tens of billions with consistent stability

Openness = 64.2 ÷ 100 × 100 = 64.2

Built-in AI10.3/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus

Set up automations that run autonomously in the backgroundweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdallowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.mdThis tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.
  • [probe] https://github.com/zilliztech/mcp-server-milvusofficial MCP server documented at https://github.com/zilliztech/mcp-server-milvus

Built-in AI = 7.2 ÷ 70 × 100 = 10.3

Automation12.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [github] https://github.com/milvus-io/milvusres = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/about/overview.mdIn 2022, Milvus supported billion-scale vectors, and in 2023, it scaled up to tens of billions with consistent stability
  • [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.mdMilvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.
  • [community] https://hn.algolia.com/api/v1/items/22012300Milvus allows appending vectors, stored across multiple file slices; when a slice hits a threshold, Milvus builds the index for it and new data goes into a new slice. Vector deletion was not yet supported, expected by end of Q1.

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 7.2 ÷ 60 × 100 = 12.0