How Milvus’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score36/100
Agent-ready 57.8 × 0.30 = 17.34
API quality 10.0 × 0.20 = 2.00
Openness 64.2 × 0.20 = 12.84
Built-in AI 10.3 × 0.15 = 1.55
Automation 12.0 × 0.15 = 1.80
(17.34 + 2.00 + 12.84 + 1.55 + 1.80) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 35.52 ÷ 1.00 = 35.5
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready57.8/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [probe] https://milvus.io/llms.txt“PROBE llms.txt: HTTP 200 at https://milvus.io/llms.txt # Milvus > Milvus is an open-source, high-performance vector database designed for similarity search and AI application”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production.”
- [github] https://github.com/milvus-io/milvus“This installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client”
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“from pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")”
Plug MCP servers into this product so it can use their toolsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
Connect an agent via an official MCP serverweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
Use an official CLIweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Drive the product through a documented public APIweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“To create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data”
- [github] https://github.com/milvus-io/milvus“This installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client”
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
- [probe] https://milvus.io/openapi.json“PROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/adminGuide/rbac.md“With RBAC, you can finely control the operations users can perform at the collection, database, and instance levels, enhancing data security”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/adminGuide/rbac.md“With RBAC, you can finely control the operations users can perform at the collection, database, and instance levels, enhancing data security.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
Build against official SDKsweight 2
2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“To create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data”
- [github] https://github.com/milvus-io/milvus“This installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“Milvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.”
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
- [community] https://hn.algolia.com/api/v1/items/40522400“I recently used Milvus for the first time - it made sense because it was quick to implement, purpose built, and worked exactly as intended.”
Subscribe to events via webhooksweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Agent-ready = 104.0 ÷ 180 × 100 = 57.8
API quality10.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://milvus.io/openapi.json“PROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“from pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")”
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://milvus.io/openapi.json“PROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 7 (quality) × 1.0 (full) = 7.0 of 10 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“To create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“Milvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/about/overview.md“Milvus Lite is a Python library that can be easily integrated into your applications. As a lightweight version of Milvus, it’s ideal for quick prototyping in Jupyter Notebooks or running on edge devices”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“from pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")”
- [github] https://github.com/milvus-io/milvus“This installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://milvus.io/openapi.json“PROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)”
API quality = 7.0 ÷ 70 × 100 = 10.0
Openness64.2/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“Milvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“from pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")”
- [github] https://github.com/milvus-io/milvus“This installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client”
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
- [probe] https://milvus.io/openapi.json“PROBE openapi: all candidate paths 404 (https://milvus.io/openapi.json, https://milvus.io/swagger.json, https://milvus.io/api/openapi.json, https://milvus.io/.well-known/openapi.json)”
Export all of my data in open formats and leaveweight 3
3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“To create a local Milvus vector database, simply instantiate a `MilvusClient` by specifying a file name to store all data”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“from pymilvus import MilvusClient client = MilvusClient("milvus_demo.db")”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production”
- [github] https://github.com/milvus-io/milvus“Milvus also supports Standalone mode for single machine deployment.”
Read the product's source under an open licenseweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/quickstart.md“Milvus is an open-source vector database that suits AI applications of every size from running a demo chatbot in Jupyter notebook to building web-scale search that serves billions of users.”
- [github] https://github.com/milvus-io/milvus“This installs `pymilvus`, the Python SDK for Milvus. Use `MilvusClient` to create a client”
- [github] https://github.com/milvus-io/milvus“Milvus also supports Standalone mode for single machine deployment.”
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
- [probe] https://milvus.io/llms.txt“PROBE llms.txt: HTTP 200 at https://milvus.io/llms.txt # Milvus > Milvus is an open-source, high-performance vector database designed for similarity search and AI application”
Self-host the core productweight 3
3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“With the same client-side code, you can run GenAI apps with Milvus Lite on a laptop or Jupyter Notebook, or Milvus Standalone on Docker container, or Milvus Distributed on massive scale Kubernetes cluster serving billions of vectors in production”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“Milvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.”
- [github] https://github.com/milvus-io/milvus“Milvus also supports Standalone mode for single machine deployment.”
- [community] https://hn.algolia.com/api/v1/items/46222002“For people who run thousands of QPS on billions of vectors, Milvus is a solid choice... I've seen many builders migrate from pgvector to Milvus as their apps scale, but perhaps they wish they had considered scalability earlier. (from a Milvus team member, self-described as possibly biased)”
- [community] https://hn.algolia.com/api/v1/items/46222002“pgVector is great and so is FAISS, but those are just a subset of what you get from Milvus - if you want hybrid search, different IVF variants, disk-based search, horizontal scaling, SIMD, or sparse vectors, Milvus is great.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/about/overview.md“In 2022, Milvus supported billion-scale vectors, and in 2023, it scaled up to tens of billions with consistent stability”
Openness = 64.2 ÷ 100 × 100 = 64.2
Built-in AI10.3/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
Set up automations that run autonomously in the backgroundweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
Operate the product with natural-language commandsweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/integrations/milvus_and_mcp.md“This tutorial walks you through setting up an MCP server for Milvus, allowing AI applications to perform vector searches, manage collections, and retrieve data using natural language commands—without writing custom database queries.”
- [probe] https://github.com/zilliztech/mcp-server-milvus“official MCP server documented at https://github.com/zilliztech/mcp-server-milvus”
Built-in AI = 7.2 ÷ 70 × 100 = 10.3
Automation12.0/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [github] https://github.com/milvus-io/milvus“res = client.search( collection_name="demo_collection", # target collection data=query_vectors, # a list of one or more query vectors, supports batch limit=2,”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/about/overview.md“In 2022, Milvus supported billion-scale vectors, and in 2023, it scaled up to tens of billions with consistent stability”
- [claimed-docs] https://raw.githubusercontent.com/milvus-io/milvus-docs/v3.0.x/site/en/getstarted/milvus_lite.md“Milvus Lite shares the same API with Milvus Standalone and Distributed, and covers most of the features such as vector data persistence and management, vector CRUD operations, sparse and dense vector search, metadata filtering, multi-vector and hybrid_search.”
- [community] https://hn.algolia.com/api/v1/items/22012300“Milvus allows appending vectors, stored across multiple file slices; when a slice hits a threshold, Milvus builds the index for it and new data goes into a new slice. Vector deletion was not yet supported, expected by end of Q1.”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Schedule recurring jobs or workflowsweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Version, review, and roll back my automationsweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Automation = 7.2 ÷ 60 × 100 = 12.0