Skip to content

How Homebrew’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score28/100

Agent-ready 21.2 × 0.30 = 6.36

API quality 0.0 × 0.20 = 0.00

Openness 43.5 × 0.20 = 8.70

Built-in AI n/a — excluded, its ×0.15 weight renormalized away

Automation 59.3 × 0.15 = 8.89

(6.36 + 0.00 + 8.70 + 8.89) ÷ (0.30 + 0.20 + 0.20 + 0.15) = 23.95 ÷ 0.85 = 28.2 — weights renormalized over the scored components

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready21.2/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.brew.sh/llms.txtPROBE llms.txt: HTTP 404 at https://docs.brew.sh/llms.txt
  • [probe] https://docs.brew.sh/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.brew.sh/openapi.json, https://docs.brew.sh/swagger.json, https://docs.brew.sh/api/openapi.json, https://docs.brew.sh/.well-known/openapi.json)

Run the product headlessly / in CI for automationweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.brew.sh/Installationprepend `NONINTERACTIVE=1` to the installation command
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileAdding a `Brewfile` to a project's repository (like you might a `package.json`, `Gemfile` or `requirements.txt`) is a nicer way of encoding project dependencies for developer environments.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileAdding a `Brewfile` to a project’s repository (like you might a `package.json`, `Gemfile` or `requirements.txt`) is a nicer way of encoding project dependencies for developer environments.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileAdding a `Brewfile` to a project's repository (like you might a `package.json`, `Gemfile` or `requirements.txt`) is a nicer way of encoding project dependencies
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfilebrew bundle check || brew bundle install
  • [claimed-docs] https://docs.brew.sh/ManpageRun your shell in a `brew bundle exec` environment.
  • [probe] https://docs.brew.sh/Manpageofficial CLI documented at https://docs.brew.sh/Manpage

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [probe] https://docs.brew.sh/llms.txtPROBE llms.txt: HTTP 404 at https://docs.brew.sh/llms.txt
  • [probe] https://docs.brew.sh/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.brew.sh/openapi.json, https://docs.brew.sh/swagger.json, https://docs.brew.sh/api/openapi.json, https://docs.brew.sh/.well-known/openapi.json)

Use an official CLIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [probe] https://docs.brew.sh/Manpageofficial CLI documented at https://docs.brew.sh/Manpage
  • [claimed-docs] https://docs.brew.sh/Installationprepend `NONINTERACTIVE=1` to the installation command
  • [probe] https://docs.brew.sh/llms.txtPROBE llms.txt: HTTP 404 at https://docs.brew.sh/llms.txt

Drive the product through a documented public APIweight 3

3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max

  • [probe] https://docs.brew.sh/llms.txtPROBE llms.txt: HTTP 404 at https://docs.brew.sh/llms.txt
  • [probe] https://docs.brew.sh/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.brew.sh/openapi.json, https://docs.brew.sh/swagger.json, https://docs.brew.sh/api/openapi.json, https://docs.brew.sh/.well-known/openapi.json)
  • [probe] https://docs.brew.sh/Manpageofficial CLI documented at https://docs.brew.sh/Manpage
  • [claimed-docs] https://docs.brew.sh/ManpageBundler for non-Ruby dependencies from Homebrew formulae, Homebrew casks, Mac App Store dependencies, VSCode (and forks/variants) extensions, Go packages, Cargo packages, uv tools, Flatpak packages, WinGet packages, Krew plugins and npm packages.

Issue scoped/least-privilege API credentials for an agentweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Subscribe to events via webhooksweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 25.4 ÷ 120 × 100 = 21.2

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.brew.sh/llms.txtPROBE llms.txt: HTTP 404 at https://docs.brew.sh/llms.txt
  • [probe] https://docs.brew.sh/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.brew.sh/openapi.json, https://docs.brew.sh/swagger.json, https://docs.brew.sh/api/openapi.json, https://docs.brew.sh/.well-known/openapi.json)

Test against a sandbox environment without touching production dataweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

API quality = 0.0 ÷ 20 × 100 = 0.0

Openness43.5/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Export all of my data in open formats and leaveweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfile`brew bundle dump` is Homebrew's installed-state snapshot command: it records supported installed formulae, casks, taps and other package types as a `Brewfile`.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfile`brew bundle dump` is Homebrew's installed-state snapshot command: it records supported installed formulae, casks, taps and other package types as a `Brewfile`
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileAdding a `Brewfile` to a project’s repository (like you might a `package.json`, `Gemfile` or `requirements.txt`) is a nicer way of encoding project dependencies for developer environments.
  • [claimed-docs] https://docs.brew.sh/ManpageBundler for non-Ruby dependencies from Homebrew formulae, Homebrew casks, Mac App Store dependencies, VSCode (and forks/variants) extensions, Go packages, Cargo packages, uv tools, Flatpak packages, WinGet packages, Krew plugins and npm packages.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileYou can check if a `brew bundle install` will do anything by running: $ brew bundle check

Read the product's source under an open licenseweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [github] https://github.com/Homebrew/brewperform a strict audit on a package you use e.g. `brew audit --strict ffmpeg` for FFmpeg

Self-host the core productweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.brew.sh/TapsThe `brew tap` command adds repositories that Homebrew can use for formulae, casks and external commands.
  • [claimed-docs] https://docs.brew.sh/Taps`brew tap <user>/<repository>` clones `https://github.com/<user>/homebrew-<repository>` into Homebrew’s tap directory.
  • [claimed-docs] https://docs.brew.sh/Taps`brew tap <user>/<repository>` clones `https://github.com/<user>/homebrew-<repository>` into Homebrew's tap directory
  • [community] https://news.ycombinator.com/item?id=48490024User who tried hosting a Homebrew tap found it much harder than hosting apt/yum repos, since it requires running a git server rather than just a static file host with a CDN.

Openness = 34.8 ÷ 80 × 100 = 43.5

Built-in AIn/a×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

every cell n/a — unscored (not zero), excluded from the blend

Automation59.3/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfile`brew bundle dump` is Homebrew's installed-state snapshot command: it records supported installed formulae, casks, taps and other package types as a `Brewfile`.
  • [claimed-docs] https://docs.brew.sh/ManpageBundler for non-Ruby dependencies from Homebrew formulae, Homebrew casks, Mac App Store dependencies, VSCode (and forks/variants) extensions, Go packages, Cargo packages, uv tools, Flatpak packages, WinGet packages, Krew plugins and npm packages.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileYou can check if a `brew bundle install` will do anything by running: $ brew bundle check
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfilebrew bundle check || brew bundle install
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfilethis will take instructions from the Brewfile to run brew install ruby and install Ruby if needed
  • [claimed-docs] https://docs.brew.sh/Installationprepend `NONINTERACTIVE=1` to the installation command
  • [community] https://news.ycombinator.com/item?id=48490024User reports that 'brew upgrade' started updating ALL casks, even ones marked 'auto_updates: true' in the Cask JSON API, calling it new default behavior that didn't used to happen.
  • [community] https://news.ycombinator.com/item?id=48490024User asks: "Does homebrew still do that insane thing when you want to upgrade a single package it tells you 'hold my beer' and starts installing postgres and some obscure python version?"

Define rules that trigger actions automatically on eventsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 3 (quality) × 0.6 (partial) = 1.8 of 10 max

  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileAdding a `Brewfile` to a project's repository (like you might a `package.json`, `Gemfile` or `requirements.txt`) is a nicer way of encoding project dependencies for developer environments.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-Brewfile`brew bundle dump` is Homebrew's installed-state snapshot command: it records supported installed formulae, casks, taps and other package types as a `Brewfile`.
  • [claimed-docs] https://docs.brew.sh/Brew-Bundle-and-BrewfileYou can check if a `brew bundle install` will do anything by running: $ brew bundle check
  • [community] https://news.ycombinator.com/item?id=48490024User requests a better rollback mechanism, having broken their home server multiple times with bad InfluxDB/Grafana updates via Homebrew; now disables cleanup to keep old versions as a workaround.

Automation = 17.8 ÷ 30 × 100 = 59.3