How Galileo’s scores are calculated

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [probe] https://docs.galileo.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.galileo.ai/llms.txt # Galileo - [What Is Galileo?](https://docs.galileo.ai/what-is-galileo.md) - [Log Your First Trace](https://docs.galile”
• [probe] https://docs.galileo.ai/what-is-galileo.md“PROBE docs-md: HTTP 200 at https://docs.galileo.ai/what-is-galileo.md > ## Documentation Index > Fetch the complete documentation index at: https://docs.galileo.ai/llms.txt > Use this file t”
• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [github] https://github.com/rungalileo/galileo-python“You can also use the `@log` decorator to log spans.”
• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“Experiments allow you to evaluate prompts, models, and your application code, using well-defined inputs, against metrics of your choice.”
• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“In the Galileo console UI, "Create Experiment" buttons allow you to easily add experiments to a project.”
• [claimed-docs] https://docs.galileo.ai/concepts/logging/overview.md“Once instrumented, Galileo captures every session, trace, and span, producing a structured stream of real-time data.”
• [claimed-docs] https://docs.galileo.ai/sdk-api/logging/distributed-tracing-otel.md“OpenTelemetry's W3C `traceparent` header carries the trace context across the wire. Galileo joins all spans that share a trace ID into a single trace.”

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [probe] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp“official MCP server documented at https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [probe] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp“official MCP server documented at https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp”

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Drive the product through a documented public APIweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

• [github] https://github.com/rungalileo/galileo-python“You can also use the `@log` decorator to log spans.”
• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [claimed-docs] https://docs.galileo.ai/sdk-api/logging/distributed-tracing-otel.md“OpenTelemetry's W3C `traceparent` header carries the trace context across the wire. Galileo joins all spans that share a trace ID into a single trace.”
• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”
• [probe] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp“official MCP server documented at https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [github] https://github.com/rungalileo/galileo-python“You can also use the `@log` decorator to log spans.”
• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [claimed-docs] https://docs.galileo.ai/concepts/logging/overview.md“Once instrumented, Galileo captures every session, trace, and span, producing a structured stream of real-time data.”
• [claimed-docs] https://docs.galileo.ai/sdk-api/logging/distributed-tracing-otel.md“OpenTelemetry's W3C `traceparent` header carries the trace context across the wire. Galileo joins all spans that share a trace ID into a single trace.”
• [probe] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp“official MCP server documented at https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp”
• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.galileo.ai/how-to-guides/basics/set-up-alerts-on-logs.md“Galileo enables you to get alerted whenever unexpected things happen.”
• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 4 (quality) × 0.6 (partial) = 2.4 of 10 max

• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“Experiments allow you to evaluate prompts, models, and your application code, using well-defined inputs, against metrics of your choice.”
• [claimed-docs] https://galileo.ai“Build your datasets from synthetic, development, and live production data. Capture subject matter expert annotations to create a living asset that continuously grounds your AI systems.”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“Experiments allow you to evaluate prompts, models, and your application code, using well-defined inputs, against metrics of your choice.”
• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“In the Galileo console UI, "Create Experiment" buttons allow you to easily add experiments to a project.”
• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [github] https://github.com/rungalileo/galileo-python“You can also use the `@log` decorator to log spans.”
• [probe] https://docs.galileo.ai/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.galileo.ai/openapi.json, https://docs.galileo.ai/swagger.json, https://docs.galileo.ai/api/openapi.json, https://docs.galileo.ai/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

• [github] https://github.com/rungalileo/galileo-python“You can also use the `@log` decorator to log spans.”

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.galileo.ai/concepts/metrics/overview.md“You can then expand these metrics with custom metrics, using LLM-as-a-judge, or custom code-based metrics.”
• [claimed-docs] https://docs.galileo.ai/how-to-guides/basics/set-up-alerts-on-logs.md“Galileo enables you to get alerted whenever unexpected things happen.”
• [claimed-docs] https://docs.galileo.ai/concepts/metrics/overview.md“This allows you to continuously provide feedback in natural language that automatically improves the metrics to align better with your domain, or expected inputs and outputs.”
• [claimed-docs] https://docs.galileo.ai/concepts/metrics/agentic/agentic-overview.md“Agentic metrics help you measure how well your AI agents perform complex, multi-step tasks—especially when those agents need to use tools, make decisions, or interact with external systems.”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

• [claimed-docs] https://docs.galileo.ai/how-to-guides/basics/set-up-alerts-on-logs.md“Galileo enables you to get alerted whenever unexpected things happen.”
• [claimed-docs] https://docs.galileo.ai/concepts/logging/overview.md“Once instrumented, Galileo captures every session, trace, and span, producing a structured stream of real-time data.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [claimed-docs] https://docs.galileo.ai/concepts/metrics/overview.md“This allows you to continuously provide feedback in natural language that automatically improves the metrics to align better with your domain, or expected inputs and outputs.”
• [probe] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp“official MCP server documented at https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp”

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“Experiments allow you to evaluate prompts, models, and your application code, using well-defined inputs, against metrics of your choice.”
• [claimed-docs] https://docs.galileo.ai/getting-started/experiments.md“In the Galileo console UI, "Create Experiment" buttons allow you to easily add experiments to a project.”
• [claimed-docs] https://docs.galileo.ai/getting-started/mcp/setup-galileo-mcp.md“With MCP, you can access Galileo's capabilities directly from your development environment, including: Creating and managing datasets, Running experiments, Setting up prompt templates”
• [claimed-docs] https://galileo.ai“Build your datasets from synthetic, development, and live production data. Capture subject matter expert annotations to create a living asset that continuously grounds your AI systems.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

• [claimed-docs] https://docs.galileo.ai/how-to-guides/basics/set-up-alerts-on-logs.md“Galileo enables you to get alerted whenever unexpected things happen.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh