How Braintrust’s scores are calculated

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [probe] https://www.braintrust.dev/llms.txt“PROBE llms.txt: HTTP 200 at https://www.braintrust.dev/llms.txt # Braintrust > Braintrust is the active observability platform for instrumenting, understanding, and improving agents.”
• [probe] https://www.braintrust.dev/docs.md“PROBE docs-md: HTTP 404 at https://www.braintrust.dev/docs.md”
• [probe] https://www.braintrust.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://www.braintrust.dev/openapi.json, https://www.braintrust.dev/swagger.json, https://www.braintrust.dev/api/openapi.json, https://www.braintrust.dev/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Automate in CI/CD — Run evals on every pull request to catch regressions”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Experiments are the immutable, comparable record of your eval runs. Run them from code or in the UI, track progress over time, and integrate into CI/CD to catch regressions before they reach production.”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [github] https://github.com/braintrustdata/braintrust-sdk-javascript“Eval("Say Hi Bot", { data: () => [ { input: "Foo", expected: "Hi Foo" }, ], task: (input) => "Hi " + input, scores: [LevenshteinScorer], });”
• [probe] https://www.braintrust.dev/docs/reference/cli/quickstart“official CLI documented at https://www.braintrust.dev/docs/reference/cli/quickstart”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Query production logs, author prompts and scorers, configure monitoring, and run evals from Claude Code, Cursor, Codex, VS Code, and any other MCP-compatible client.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Connect Claude Code, Cursor, Codex, and other MCP clients to Braintrust. Query logs, author scorers, configure Topics, and run evals from your editor.”
• [probe] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“official MCP server documented at https://www.braintrust.dev/docs/integrations/developer-tools/mcp”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust’s AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust's AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”

Connect an agent via an official MCP serverweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Query production logs, author prompts and scorers, configure monitoring, and run evals from Claude Code, Cursor, Codex, VS Code, and any other MCP-compatible client.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Connect Claude Code, Cursor, Codex, and other MCP clients to Braintrust. Query logs, author scorers, configure Topics, and run evals from your editor.”
• [probe] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“official MCP server documented at https://www.braintrust.dev/docs/integrations/developer-tools/mcp”

Use an official CLIweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs“Install the `bt` CLI to set up, instrument, and run Braintrust with your coding agent”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Browse traces and individual spans, in the UI or from the terminal with [`bt view logs`](/docs/reference/cli/view).”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Browse traces and individual spans, in the UI or from the terminal with `bt view logs`. ... Download logs as CSV or JSON, or pull them locally with `bt sync pull`.”
• [probe] https://www.braintrust.dev/docs/reference/cli/quickstart“official CLI documented at https://www.braintrust.dev/docs/reference/cli/quickstart”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Query production logs, author prompts and scorers, configure monitoring, and run evals from Claude Code, Cursor, Codex, VS Code, and any other MCP-compatible client.”
• [probe] https://www.braintrust.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://www.braintrust.dev/openapi.json, https://www.braintrust.dev/swagger.json, https://www.braintrust.dev/api/openapi.json, https://www.braintrust.dev/.well-known/openapi.json)”
• [probe] https://www.braintrust.dev/docs/reference/cli/quickstart“official CLI documented at https://www.braintrust.dev/docs/reference/cli/quickstart”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [community] https://hn.algolia.com/api/v1/items/48042494“AI evaluation startup Braintrust confirms breach, tells every customer to rotate sensitive keys.”

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [github] https://github.com/braintrustdata/braintrust-sdk-javascript“Eval("Say Hi Bot", { data: () => [ { input: "Foo", expected: "Hi Foo" }, ], task: (input) => "Hi " + input, scores: [LevenshteinScorer], });”
• [github] https://github.com/braintrustdata/braintrust-sdk-javascript“Eval("Say Hi Bot", { data: () => [ { input: "Foo", expected: "Hi Foo" }, { input: "Bar", expected: "Hello Bar" }, ], task: (input) => "Hi " + input, scores: [LevenshteinScorer], });”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Query production logs, author prompts and scorers, configure monitoring, and run evals from Claude Code, Cursor, Codex, VS Code, and any other MCP-compatible client.”
• [probe] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“official MCP server documented at https://www.braintrust.dev/docs/integrations/developer-tools/mcp”
• [probe] https://www.braintrust.dev/docs/reference/cli/quickstart“official CLI documented at https://www.braintrust.dev/docs/reference/cli/quickstart”
• [community] https://hn.algolia.com/api/v1/items/44194187“Braintrust: Interesting approach to evaluation but feels like an early-stage product. Documentation is sparse and integration options are limited.”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [probe] https://www.braintrust.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://www.braintrust.dev/openapi.json, https://www.braintrust.dev/swagger.json, https://www.braintrust.dev/api/openapi.json, https://www.braintrust.dev/.well-known/openapi.json)”
• [probe] https://www.braintrust.dev/docs.md“PROBE docs-md: HTTP 404 at https://www.braintrust.dev/docs.md”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://www.braintrust.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://www.braintrust.dev/openapi.json, https://www.braintrust.dev/swagger.json, https://www.braintrust.dev/api/openapi.json, https://www.braintrust.dev/.well-known/openapi.json)”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 4 (quality) × 0.6 (partial) = 2.4 of 10 max

• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Experiments are the immutable, comparable record of your eval runs. Run them from code or in the UI, track progress over time, and integrate into CI/CD to catch regressions before they reach production.”
• [claimed-docs] https://www.braintrust.dev/docs/annotate/datasets“Datasets are versioned collections of test cases that you use to run evaluations and track improvements over time. Build datasets from production logs, user feedback, manual curation, or generate them with Loop.”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Braintrust offers a self-hosted deployment option that separates data storage from platform management.”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Self-hosting is designed for organizations with specific requirements: Data residency and compliance: Meet regulatory or contractual obligations by keeping all customer data ... within your own cloud account and region.”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [probe] https://www.braintrust.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://www.braintrust.dev/openapi.json, https://www.braintrust.dev/swagger.json, https://www.braintrust.dev/api/openapi.json, https://www.braintrust.dev/.well-known/openapi.json)”

Do everything through the API that I can do in the UIweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Query production logs, author prompts and scorers, configure monitoring, and run evals from Claude Code, Cursor, Codex, VS Code, and any other MCP-compatible client.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Connect Claude Code, Cursor, Codex, and other MCP clients to Braintrust. Query logs, author scorers, configure Topics, and run evals from your editor.”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate/playgrounds“Playgrounds provide a no-code workspace for rapidly iterating on prompts, models, scorers, and datasets. Run full evaluations in real-time, compare results side-by-side”
• [probe] https://www.braintrust.dev/openapi.json“PROBE openapi: all candidate paths 404 (https://www.braintrust.dev/openapi.json, https://www.braintrust.dev/swagger.json, https://www.braintrust.dev/api/openapi.json, https://www.braintrust.dev/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/observe“Browse traces and individual spans, in the UI or from the terminal with `bt view logs`. ... Download logs as CSV or JSON, or pull them locally with `bt sync pull`.”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“The Braintrust API allows you to interact with all aspects of the Braintrust platform programmatically.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Braintrust offers a self-hosted deployment option that separates data storage from platform management.”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [github] https://github.com/braintrustdata/braintrust-sdk-javascript“Eval("Say Hi Bot", { data: () => [ { input: "Foo", expected: "Hi Foo" }, ], task: (input) => "Hi " + input, scores: [LevenshteinScorer], });”
• [github] https://github.com/braintrustdata/braintrust-sdk-javascript“Eval("Say Hi Bot", { data: () => [ { input: "Foo", expected: "Hi Foo" }, { input: "Bar", expected: "Hello Bar" }, ], task: (input) => "Hi " + input, scores: [LevenshteinScorer], });”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Braintrust offers a self-hosted deployment option that separates data storage from platform management. You deploy and control the infrastructure that stores your sensitive AI data, while Braintrust provides the managed UI, authentication, and platform updates.”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Braintrust offers a self-hosted deployment option that separates data storage from platform management.”

Self-host the core productweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Braintrust offers a self-hosted deployment option that separates data storage from platform management. You deploy and control the infrastructure that stores your sensitive AI data, while Braintrust provides the managed UI, authentication, and platform updates.”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Braintrust offers a self-hosted deployment option that separates data storage from platform management.”
• [claimed-docs] https://www.braintrust.dev/docs/admin/self-hosting“Self-hosting is designed for organizations with specific requirements: Data residency and compliance: Meet regulatory or contractual obligations by keeping all customer data ... within your own cloud account and region.”

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust’s AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures, then records each one with the traces that support it and a suggested fix.”
• [claimed-docs] https://www.braintrust.dev/docs“Ask Braintrust’s AI agent to investigate your data and build scorers, datasets, and dashboards”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Topics automatically analyze and classify your logs without manual review.”
• [claimed-docs] https://www.braintrust.dev“Define the dimensions that matter to your business, like use case, customer segment, compliance, or tone. Topics continuously clusters every trace against them.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Topics automatically analyze and classify your logs without manual review. Each trace is analyzed by facets that extract sho”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures, then records each one with the traces that support it and a suggested fix.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Online scoring evaluates production traces automatically as they’re logged, running asynchronously with no impact on latency.”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Online scoring evaluates production traces automatically as they're logged, running asynchronously with no impact on latency.”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Automate in CI/CD — Run evals on every pull request to catch regressions”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust’s AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust’s AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures, then records each one with the traces that support it and a suggested fix.”
• [claimed-docs] https://www.braintrust.dev/docs“Ask Braintrust’s AI agent to investigate your data and build scorers, datasets, and dashboards”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust's AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”

Operate the product with natural-language commandsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust’s AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”
• [claimed-docs] https://www.braintrust.dev/docs“Ask Braintrust’s AI agent to investigate your data and build scorers, datasets, and dashboards”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Loop is Braintrust's AI agent. It understands your data structure, so you can investigate your logs through natural language instead of writing queries.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Query production logs, author prompts and scorers, configure monitoring, and run evals from Claude Code, Cursor, Codex, VS Code, and any other MCP-compatible client.”
• [claimed-docs] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“Connect Claude Code, Cursor, Codex, and other MCP clients to Braintrust. Query logs, author scorers, configure Topics, and run evals from your editor.”
• [probe] https://www.braintrust.dev/docs/integrations/developer-tools/mcp“official MCP server documented at https://www.braintrust.dev/docs/integrations/developer-tools/mcp”

Perform bulk operations across many items at onceweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/evaluate/playgrounds“Playgrounds provide a no-code workspace for rapidly iterating on prompts, models, scorers, and datasets. Run full evaluations in real-time, compare results side-by-side, and share configurations with teammates.”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Online scoring evaluates production traces automatically as they’re logged, running asynchronously with no impact on latency.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Topics automatically analyze and classify your logs without manual review.”
• [claimed-docs] https://www.braintrust.dev/docs/annotate/datasets“Datasets are versioned collections of test cases that you use to run evaluations and track improvements over time. Build datasets from production logs, user feedback, manual curation, or generate them with Loop.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Browse traces and individual spans, in the UI or from the terminal with `bt view logs`. ... Download logs as CSV or JSON, or pull them locally with `bt sync pull`.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Online scoring evaluates production traces automatically as they’re logged, running asynchronously with no impact on latency.”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Online scoring evaluates production traces automatically as they're logged, running asynchronously with no impact on latency.”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Automate in CI/CD — Run evals on every pull request to catch regressions”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures, then records each one with the traces that support it and a suggested fix.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures, then records each one with the traces that support it and a suggested fix.”
• [claimed-docs] https://www.braintrust.dev/docs/observe“Patterns puts Loop to work on your trace backlog on a schedule. It searches for recurring problems and trends that no scorer already measures”
• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Automate in CI/CD — Run evals on every pull request to catch regressions”

Version, review, and roll back my automationsweight 1

1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max

• [claimed-docs] https://www.braintrust.dev/docs/evaluate“Experiments are the immutable, comparable record of your eval runs. Run them from code or in the UI, track progress over time, and integrate into CI/CD to catch regressions before they reach production.”
• [claimed-docs] https://www.braintrust.dev/docs/annotate/datasets“Datasets are versioned collections of test cases that you use to run evaluations and track improvements over time. Build datasets from production logs, user feedback, manual curation, or generate them with Loop.”
• [claimed-docs] https://www.braintrust.dev/docs/reference/cli/quickstart“`bt` is the command-line interface for Braintrust. It lets you authenticate, trace coding-agent sessions, run evals, browse and query logs, sync data, and manage functions without leaving your terminal.”
• [claimed-docs] https://www.braintrust.dev/docs/api-reference“You can use it to: Create and manage projects, experiments, and datasets; Log traces and metrics; Manage prompts, tools, and scorers”