Skip to content

How Slate’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score15/100

Agent-ready 20.0 × 0.30 = 6.00

API quality 0.0 × 0.20 = 0.00

Openness 0.0 × 0.20 = 0.00

Built-in AI 50.9 × 0.15 = 7.63

Automation 9.0 × 0.15 = 1.35

(6.00 + 0.00 + 0.00 + 7.63 + 1.35) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 14.98 ÷ 1.00 = 15.0

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready20.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://docs.randomlabs.ai/llms.txtPROBE llms.txt: HTTP 200 at https://docs.randomlabs.ai/llms.txt # Slate ## Docs - [Introduction](https://docs.randomlabs.ai/en/getting-started/introduction.md) - [Quickstart](https:/

Run the product headlessly / in CI for automationweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/configuration.mdWe support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.
  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdnpm i -g @randomlabs/slate
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdUse `/sessions` to switch between existing sessions

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdnpm i -g @randomlabs/slate
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdUse `/sessions` to switch between existing sessions
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdPress Tab to queue the current message so it runs after the current turn finishes.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdExecute shell commands directly with `!`
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/hotkey_reference.mdCtrl+X then N New session
  • [probe] https://docs.randomlabs.ai/en/getting-started/quickstartofficial CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart

Drive the product through a documented public APIweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [probe] https://docs.randomlabs.ai/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.randomlabs.ai/api/openapi.json, https://docs.randomlabs.ai/.well-known/openapi.json)
  • [probe] https://docs.randomlabs.ai/llms.txtPROBE llms.txt: HTTP 200 at https://docs.randomlabs.ai/llms.txt # Slate ## Docs - [Introduction](https://docs.randomlabs.ai/en/getting-started/introduction.md) - [Quickstart](https:/

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/configuration.mdEach permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/configuration.mdWe support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.randomlabs.ai/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.randomlabs.ai/api/openapi.json, https://docs.randomlabs.ai/.well-known/openapi.json)
  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdnpm i -g @randomlabs/slate

Subscribe to events via webhooksweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 32.0 ÷ 160 × 100 = 20.0

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

n/a — not applicable to this product: excluded from numerator and denominator

  • [probe] https://docs.randomlabs.ai/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.randomlabs.ai/api/openapi.json, https://docs.randomlabs.ai/.well-known/openapi.json)

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.randomlabs.ai/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.randomlabs.ai/api/openapi.json, https://docs.randomlabs.ai/.well-known/openapi.json)

Test against a sandbox environment without touching production dataweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.randomlabs.ai/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.randomlabs.ai/api/openapi.json, https://docs.randomlabs.ai/.well-known/openapi.json)

API quality = 0.0 ÷ 40 × 100 = 0.0

Openness0.0/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.randomlabs.ai/openapi.jsonPROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.randomlabs.ai/api/openapi.json, https://docs.randomlabs.ai/.well-known/openapi.json)
  • [probe] https://docs.randomlabs.ai/en/getting-started/quickstartofficial CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart
  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdnpm i -g @randomlabs/slate

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdnpm i -g @randomlabs/slate
  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdOnboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subscription, or Slate credits.

Openness = 0.0 ÷ 100 × 100 = 0.0

Built-in AI50.9/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdPlease review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.
  • [community] https://hn.algolia.com/api/v1/items/45339631Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/examples, and provided no repo link to verify the port worked.
  • [community] https://hn.algolia.com/api/v1/items/45339631"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of the ported code produced by the tool.

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdThose agents show up as a grid of inline subagent cards, one per agent.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdWhile one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more agents to parallelize work across several tasks at once.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.md`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/introduction.mdParallelize working and orchestration of many tasks at once.
  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdPlease review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdThose agents show up as a grid of inline subagent cards, one per agent.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdWhile one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more agents to parallelize work across several tasks at once.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.md`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.
  • [community] https://hn.algolia.com/api/v1/items/45339631"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of the ported code produced by the tool.

Operate the product with natural-language commandsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/quickstart.mdPlease review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdExecute shell commands directly with `!`
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdUse `@filename` references
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdUse `/sessions` to switch between existing sessions
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.md`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.

Built-in AI = 45.8 ÷ 90 × 100 = 50.9

Automation9.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/getting-started/introduction.mdParallelize working and orchestration of many tasks at once.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdThose agents show up as a grid of inline subagent cards, one per agent.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdWhile one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more agents to parallelize work across several tasks at once.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.md`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/workspace_setup.mdSlate by default respects agent rules in the following order
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/configuration.mdEach permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdThose agents show up as a grid of inline subagent cards, one per agent.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.mdWhile one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more agents to parallelize work across several tasks at once.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.md`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdUse `/sessions` to switch between existing sessions
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/index.mdUse `/workspace` to open the workspace manager, where you can review and remove workspace directories.
  • [claimed-docs] https://docs.randomlabs.ai/en/using-slate/orchestration.md`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.

Automation = 7.2 ÷ 80 × 100 = 9.0