Skip to content

How Nix’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score23/100

Agent-ready 25.8 × 0.30 = 7.74

API quality 10.0 × 0.20 = 2.00

Openness 48.0 × 0.20 = 9.60

Built-in AI n/a — excluded, its ×0.15 weight renormalized away

Automation 0.0 × 0.15 = 0.00

(7.74 + 2.00 + 9.60 + 0.00) ÷ (0.30 + 0.20 + 0.20 + 0.15) = 19.34 ÷ 0.85 = 22.8 — weights renormalized over the scored components

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready25.8/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://nix.dev/llms.txtPROBE llms.txt: HTTP 404 at https://nix.dev/llms.txt
  • [probe] https://nix.dev.mdPROBE docs-md: HTTP 404 at https://nix.dev.md
  • [probe] https://nix.dev/openapi.jsonPROBE openapi: all candidate paths 404 (https://nix.dev/openapi.json, https://nix.dev/swagger.json, https://nix.dev/api/openapi.json, https://nix.dev/.well-known/openapi.json)

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nixBuild the flake in the current directory: console # nix build # ./result/bin/hello Hello, world!
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nix`nix run` - run a Nix application
  • [claimed-docs] https://nix.devRemote builds.
  • [claimed-docs] https://nixos.org/manual/nix/stable/introductionNix can automatically skip building from source and instead use a binary cache, a web server that provides pre-built binaries.
  • [community] https://news.ycombinator.com/item?id=23251754I've worked on one of the largest Nix systems and it saves our entire dev team hours. Everything is only built once, on a large set of specialized remote builders, then shared among all of our devs, CI, and deployment infrastructure.
  • [community] https://news.ycombinator.com/item?id=23251754We're using Nix where I work... it was not the most user-friendly to set up, once we got it in place it has reliably worked for the last two years... This is my favorite part of Nix — you can do `nix-shell --run "<some command>"`, and it will make sure you have all of the correct dependencies.

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://nixos.org/manual/nix/stable/introductionthe command `nix-shell` will build or download those dependencies if they’re not already in your Nix store, and then start a Bash shell in which all necessary environment variables (such as compiler search paths) are set.
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nix`nix develop` - run a bash shell that provides the build environment of a derivation
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nixBuild the flake in the current directory: console # nix build # ./result/bin/hello Hello, world!
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nix`nix search` - search for packages
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nix`nix run` - run a Nix application
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nixCreate a new flake: # nix flake new hello
  • [probe] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nixofficial CLI documented at https://nix.dev/manual/nix/2.28/command-ref/new-cli/nix

Drive the product through a documented public APIweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [probe] https://nix.dev/llms.txtPROBE llms.txt: HTTP 404 at https://nix.dev/llms.txt
  • [probe] https://nix.dev.mdPROBE docs-md: HTTP 404 at https://nix.dev.md
  • [probe] https://nix.dev/openapi.jsonPROBE openapi: all candidate paths 404 (https://nix.dev/openapi.json, https://nix.dev/swagger.json, https://nix.dev/api/openapi.json, https://nix.dev/.well-known/openapi.json)

Issue scoped/least-privilege API credentials for an agentweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Subscribe to events via webhooksweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 23.2 ÷ 90 × 100 = 25.8

API quality10.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://nix.dev/llms.txtPROBE llms.txt: HTTP 404 at https://nix.dev/llms.txt
  • [probe] https://nix.dev.mdPROBE docs-md: HTTP 404 at https://nix.dev.md
  • [probe] https://nix.dev/openapi.jsonPROBE openapi: all candidate paths 404 (https://nix.dev/openapi.json, https://nix.dev/swagger.json, https://nix.dev/api/openapi.json, https://nix.dev/.well-known/openapi.json)

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max

  • [claimed-docs] https://nixos.org/manual/nix/stable/introductionthe command `nix-shell` will build or download those dependencies if they’re not already in your Nix store, and then start a Bash shell in which all necessary environment variables (such as compiler search paths) are set.
  • [claimed-docs] https://nix.dev/manual/nix/2.28/command-ref/new-cli/nix`nix develop` - run a bash shell that provides the build environment of a derivation
  • [claimed-docs] https://nix.devReproducible integration testing using virtual machines.
  • [claimed-docs] https://nix.devReproducible integration testing using virtual machines
  • [community] https://news.ycombinator.com/item?id=23251754We're using Nix where I work... it was not the most user-friendly to set up, once we got it in place it has reliably worked for the last two years... This is my favorite part of Nix — you can do `nix-shell --run "<some command>"`, and it will make sure you have all of the correct dependencies.

Rely on versioned APIs with a documented deprecation policyweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

API quality = 3.0 ÷ 30 × 100 = 10.0

Openness48.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Export all of my data in open formats and leaveweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://nixos.org/download/$ curl --proto '=https' --tlsv1.2 -L https://nixos.org/nix/install | sh -s -- --daemon
  • [claimed-docs] https://nixos.org/download/curl --proto '=https' --tlsv1.2 -L https://nixos.org/nix/install | sh -s -- --daemon
  • [claimed-docs] https://nixos.org/download/Install Nix via the recommended multi-user installation
  • [claimed-docs] https://nixos.org/manual/nix/stable/introductionNix can automatically skip building from source and instead use a binary cache, a web server that provides pre-built binaries.
  • [claimed-docs] https://nix.devTransparent build caching using binary caches
  • [claimed-docs] https://nixos.org/guides/how-nix-works/You configure a NixOS system by writing a specification of the functionality that you want on your machine in `/etc/nixos/configuration.nix`.
  • [claimed-docs] https://nixos.org/guides/how-nix-works/You configure a NixOS system by writing a specification of the functionality that you want on your machine in `/etc/nixos/configuration.nix`
  • [claimed-docs] https://nixos.org/download/NixOS can be deployed to Amazon EC2 using our official AMI.
  • [claimed-docs] https://nixos.org/download/The graphical installation ISO image contains the graphical NixOS installer as well as several Desktop Environments and several applications.
  • [community] https://news.ycombinator.com/item?id=27573393I really liked how easy it was to create a custom ISO when I installed Nix. For once I had Dvorak as the default keyboard from the outset, neovim for editing, and the proprietary WiFi drivers I needed all from a minimal config file and `nix build`.

Openness = 24.0 ÷ 50 × 100 = 48.0

Built-in AIn/a×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

every cell n/a — unscored (not zero), excluded from the blend

Automation0.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Define rules that trigger actions automatically on eventsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 0.0 ÷ 20 × 100 = 0.0