cubic vs Slate

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to cubic
   cubic✓fullprobed9/10

   cubic hosts a dedicated llms.txt file at docs.cubic.dev/llms.txt (confirmed via live probe returning HTTP 200 with a documentation summary), directly enabling agents to be pointed at agent-oriented docs; this is reinforced by MCP server and CLI docs designed for agent consumption. Missing for 10: no independent/community confirmation of an agent successfully using llms.txt in practice.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.cubic.dev/llms.txt # cubic documentation > cubic reviews code on GitHub and in local coding workfl…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate✓fullprobed8/10

   A probe confirms Slate's docs site serves a valid llms.txt at the root with links to actual docs pages, directly satisfying the ability to point an agent at agent-oriented docs. Missing for 10: no independent/community confirmation that agents successfully consume this llms.txt in practice, and no broader agent-oriented doc format beyond the single file.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.randomlabs.ai/llms.txt # Slate ## Docs - [Introduction](https://docs.randomlabs.ai/en/getting-sta…”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to cubic
   cubic~partialprobed6/10

   cubic automatically reviews PRs once installed (headless, event-triggered automation on GitHub) and ships a standalone CLI (`cubic review`) that can run local/pre-push checks, which could be scripted into CI. However, there's no explicit documentation of a CI/CD pipeline integration (e.g., GitHub Actions workflow, exit codes, non-interactive flags) confirming true headless CI usage beyond the GitHub-app webhook flow. missing for 10: explicit CI pipeline integration docs/examples, confirmation of non-interactive/exit-code behavior for CLI in automated pipelines.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate—none0/10

   The docs describe Slate as an interactive terminal agent (onboarding, slash commands, hotkeys, subagent cards) with a permission-bypass flag (--dangerously-skip-permissions/--yolo), but there is no mention of a headless mode, non-interactive CLI flags, exit-code/scriptable output, or CI integration examples. Missing for 10: documented headless/non-interactive invocation, CI pipeline examples, scriptable output format, and any evidence of automation use outside the interactive TUI.

   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”
   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”

   proof ↗⚑ flag

3. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round drawn
   cubic—none0/10

   All MCP-related evidence describes cubic acting as an MCP *server* that other coding agents/clients connect to (cubic-docs-15, cubic-docs-3, cubic-probe-3) — the reverse of this story, which asks whether a user can plug external MCP servers into cubic so it can consume their tools. No evidence shows cubic itself connecting to or invoking external MCP servers/tools.

   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “You can now ask your coding agent to check your cubic subscription, manage team seats and roles, and purchase more seats without leaving you…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the pack mentions MCP servers or integrating external tool providers into Slate; the docs cover skills, permissions, orchestration, and CLI usage but never MCP support. Missing for 10: any documentation or claim about connecting/plugging in MCP servers, configuring MCP tool sources, or using MCP-provided tools.

   ⚑ flag

4. ai-native userUse an official CLI

   weight 2 · round drawn
   cubic✓fullprobed8/10

   cubic ships an official CLI (`cubic review`) that reviews local/uncommitted changes and generates fix prompts for coding agents, documented explicitly and confirmed by a docs probe; it also integrates with agent workflows via MCP. Missing for 10: independent hands-on verification of the CLI itself (community evidence covers other product aspects, not CLI usage) and broader CLI command documentation beyond the single review command.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate✓fullprobed8/10

   Slate is delivered as an official CLI (npm-installed, terminal-based) with rich first-party docs covering install, sessions, hotkeys, shell execution, and configuration — squarely matching the 'official CLI' story for an AI-native user. Missing for 10: independent/hands-on corroboration of the CLI experience itself (community evidence found only relates to unrelated porting-quality claims, not CLI usage).

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Press Tab to queue the current message so it runs after the current turn finishes.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Ctrl+X then N New session”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”

   proof ↗⚑ flag

5. ai-native userDrive the product through a documented public API

   weight 3 · round to cubic
   cubic~partialprobed6/10

   cubic documents an MCP server (cubic-docs-15, cubic-probe-3) that lets an AI agent request PR reviews, read findings, and triage issues, plus an Analytics API (cubic-docs-20) for PR-level data and a CLI (cubic-probe-4) for local reviews — all documented, agent-drivable surfaces. However, probes for a formal public API spec (openapi/swagger) all returned 404 (cubic-probe-2), so there's no evidence of a comprehensive documented public REST/GraphQL API beyond these narrower interfaces. Missing for 10: a full public API reference/spec, broader programmatic control beyond analytics/MCP/CLI, and independent confirmation of API usage.

   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is documented as a CLI/terminal agent with configuration, skills, and hotkeys, but there is no evidence of a documented public API for programmatic/agentic access—the OpenAPI probe returned 404 across all candidate paths and no SDK or REST/API docs are mentioned anywhere in the pack.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.randomlabs.ai/llms.txt # Slate ## Docs - [Introduction](https://docs.randomlabs.ai/en/getting-sta…”

   proof ↗⚑ flag

6. ai-native userIssue scoped/least-privilege API credentials for an agent

   weight 2 · round drawn
   cubic—none0/10

   Cubic documents role-based access control for team subscription/settings (cubic-docs-47) and exposes an MCP server, Analytics API, and CLI that agents can connect to, but there is no evidence of issuing scoped or least-privilege API credentials/tokens specifically for an agent's use — no API key scoping, OAuth scope, or agent-specific credential mechanism is documented.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is a coding-agent CLI; its evidence only covers permission settings (allow/ask/deny) for tool actions, not issuance of scoped/least-privilege API credentials or tokens for agents. No mention of credential/token scoping, API key generation, or IAM-style access control.

   • [claimed-docs] “Each permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.”
   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”

   proof ↗⚑ flag

7. ai-native userBuild against official SDKs

   weight 2 · round drawn
   cubic—none0/10

   cubic documents an MCP server, CLI, and an Analytics API, but there is no evidence of official language SDKs (e.g., Python/JS client libraries) for building against cubic programmatically; the OpenAPI probe also returned 404s across candidate paths, suggesting no formal SDK/API spec is published.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate—none0/10

   The evidence pack covers Slate's CLI, skills, configuration, and orchestration features but contains no mention of an official SDK (Python/TypeScript/etc.) for building applications on top of Slate, and the OpenAPI probe returned 404s across all candidate paths. Missing for 10: any documented SDK package, API reference, or programmatic interface for building against Slate.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”
   • [claimed-docs] “npm i -g @randomlabs/slate”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to cubic
   cubic~partialcommunity6/10

   Cubic generates AI-driven insights from a user's own code/PR data via automated reviews, Ultrareview, AI-powered codebase scans, an AI wiki that indexes the codebase, and an analytics dashboard summarizing AI coding/review impact (cubic-docs-4,13,18,20,21,22). However, community hands-on feedback is mixed, with several users noting a large share of AI-generated comments are irrelevant or low-value (cubic-comm-3,9), tempering claims of consistently useful insights. Missing for 10: independent benchmarking of insight accuracy, and confirmation that analytics/wiki insights are broadly praised rather than just described in docs.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “The analytics dashboard shows how your team ships code across three lenses: AI coding usage, AI review impact, and delivery speed.”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [community] “I've tried something similar in the past. The concept is cool, but so far the solutions I've seen are not so useful in terms of comments qua…”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”

   proof ↗⚑ flag

   Slate~partialcommunity4/10

   Slate is a coding-agent CLI whose evidence shows it can analyze a codebase and produce suggestions (e.g., generating an ARCH.md with improvement ideas), which maps loosely to 'AI-generated insights from data' but only in the narrow sense of source code, not general data analysis. Community evidence also raises skepticism about the real quality of generated output (e.g., criticism of a ported-code example as low quality/unverified). Missing for 10: evidence of insights/suggestions over non-code datasets, dashboards or analytics-style outputs, and independent validation of suggestion quality.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [community] “Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/exampl…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to cubic
   cubic✓fullclaimed8/10

   cubic ships several autonomous background automations: it auto-starts PR reviews on install (cubic-docs-4, cubic-docs-41), can auto-approve clean PRs under policy (cubic-docs-12, cubic-docs-35), runs codebase scans deploying many AI agents (cubic-docs-21), keeps an AI wiki current via rolling PRs (cubic-docs-23), does cross-repo checks (cubic-docs-37), and auto-purchases flex capacity to keep reviews running (cubic-docs-24) — all without manual triggering. Missing for 10: evidence of user-defined scheduled/cron-style custom automations beyond PR-triggered events, and independent hands-on confirmation that these autonomous flows run reliably unattended.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [claimed-docs] “cubic can approve clean pull requests automatically when your repository policy allows it. Start in shadow mode to see which PRs cubic would…”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”

   proof ↗⚑ flag

   Slate~partialclaimed5/10

   Slate supports background subagents, parallel task orchestration, and built-in workflows like goal/deep-research that run while the user keeps interacting, which shows some autonomous background execution. However, this is task-level parallelism within an active session, not scheduled or trigger-based automations that run independently of user presence. missing for 10: evidence of scheduled/cron-like automations, persistent background jobs surviving session end, or trigger-based (event-driven) autonomous runs without an active user session.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round drawn
   cubic✓fullclaimed7/10

   Cubic ships a built-in AI chat/assistant experience where users can delegate tasks — asking chat to 'tour this PR', adding code to AI chat for contextual Q&A, requesting one-click fixes ('Fix with cubic') that get generated and pushed automatically, and interacting via PR comments to trigger reviews or fixes. This is a genuine in-product assistant, not just an external agent integration. Missing for 10: independent/hands-on validation specifically of the chat-delegation UX (community evidence only covers review-comment quality, not the assistant/chat delegation flow), and no detail on task-completion reliability or scope limits of delegated tasks.

   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “The chat sidebar helps you quickly understand and navigate your pull requests (PRs) with intelligent, context-aware assistance directly with…”

   proof ↗⚑ flag

   Slate✓fullcommunity7/10

   Slate is a CLI-based AI assistant where users delegate whole tasks (e.g., 'review architecture and write ARCH.md') and it spins up parallel subagents, orchestration programs like goal/deep-research, and long multi-hour sessions per first-party docs. Community evidence (comm-1/2/3) raises skepticism about output quality/novelty but does not contradict the core delegation mechanism itself. Missing for 10: independent hands-on validation that delegated multi-agent tasks reliably complete as advertised.

   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round drawn
   cubic✓fullclaimed7/10

   cubic supports natural-language interaction via PR comments and chat: users can type commands like '@cubic-dev-ai review this PR', ask chat to 'tour this PR', reply to comments for clarification, request fixes, and connect an MCP server so a coding agent can trigger reviews and manage settings conversationally. Missing for 10: independent/hands-on evidence validating the quality and reliability of these NL interactions, and no evidence of broader free-form command coverage beyond the documented set of trigger phrases.

   • [claimed-docs] “To review a PR that was opened _before_ you installed the app, comment: `@cubic-dev-ai review this PR`.”
   • [claimed-docs] “Reply to a review comment to ask for clarification”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “Post this comment on GitHub to start a review: text theme={null} @cubic-dev-ai review this PR ”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “The chat sidebar helps you quickly understand and navigate your pull requests (PRs) with intelligent, context-aware assistance directly with…”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “You can now ask your coding agent to check your cubic subscription, manage team seats and roles, and purchase more seats without leaving you…”

   proof ↗⚑ flag

   Slate✓fullclaimed7/10

   Docs show Slate is driven primarily via natural-language prompts (e.g. the quickstart example 'Please review the architecture of my entire codebase...') alongside slash-commands, shell escapes, and file references, indicating natural-language is the core interaction mode for an AI-native agent CLI. Missing for 10: independent/hands-on confirmation that complex natural-language commands are reliably parsed and executed as intended (community evidence only discusses code-porting quality, not NL command usage itself).

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Api quality

1. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   cubic—none0/10

   The probe explicitly checked common OpenAPI spec locations and all returned 404, and there is no other evidence of a downloadable machine-readable API spec for cubic's Analytics API or other endpoints; only an llms.txt is present, which is not an OpenAPI/API spec equivalent.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.cubic.dev/llms.txt # cubic documentation > cubic reviews code on GitHub and in local coding workfl…”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs site was directly probed for an OpenAPI/swagger spec at standard locations and all returned 404, and no documentation anywhere mentions a machine-readable API spec for AI-native consumption.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”

   proof ↗⚑ flag

2. ai-native userRely on versioned APIs with a documented deprecation policy

   weight 2 · round drawn
   cubic—none0/10

   There is an Analytics API mentioned (cubic-docs-20) but no evidence of API versioning scheme or a documented deprecation policy anywhere in the docs; the OpenAPI probe even returned 404s for spec endpoints. missing for 10: versioning scheme documentation, deprecation policy, changelog/migration guides for API changes, any mention of API stability guarantees.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is a CLI coding agent product; no evidence of any versioned public API, API reference, or deprecation policy documentation exists—openapi probes returned 404 and no docs mention API versioning or deprecation. Absence of evidence for this applicable axis (a product could plausibly document API stability) yields 'none'.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round drawn
   cubic~partialclaimed6/10

   cubic supports some bulk-like operations — codebase scans that 'deploy thousands of AI agents to find bugs across your repository' (cubic-docs-21), cross-repo reviews that check for related changes across multiple repos (cubic-docs-37/46), and analytics/CSV exports of PR-level data across a team (cubic-docs-19, cubic-docs-20) — but these are review/scan/export operations, not a general-purpose bulk-action capability (e.g., batch-fixing or batch-approving many PRs/items at once) with independent confirmation of scale. Missing for 10: explicit documentation of a bulk-action command/API for acting on many PRs, issues, or files simultaneously, and independent/hands-on evidence corroborating the 'thousands of agents' claim at scale.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository. Link related repositories so reviews can chec…”
   • [claimed-docs] “You can export team member data as CSV from both [AI coding](/analytics/ai-coding#csv-export) and [De”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs describe running many agents in parallel and orchestrating multiple tasks simultaneously (grid of subagent cards, spinning up more agents to parallelize work), which supports bulk-style operations across many items. However, there's no independent corroboration of this working at scale and no detail on failure handling, limits, or item-level bulk operations (e.g., bulk file edits/refactors) beyond task orchestration. Missing for 10: independent/hands-on verification of large-scale parallel task execution, concrete examples of bulk item processing (files/records), and failure/error handling details at scale.

   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to cubic
   cubic~partialclaimed6/10

   cubic supports several rule-based automated actions triggered by events within its code-review domain: auto-review on new PR (cubic-docs-4/41), auto-approval of clean PRs per repository policy (cubic-docs-12/35), auto thread resolution when an issue is fixed (cubic-docs-27), custom agents enforcing org rules across PRs (cubic-docs-34), and a spend-limit trigger that auto-purchases extra capacity (cubic-docs-24/48), all configurable via cubic.yaml (cubic-docs-16/36). These are genuine user-defined rule→action automations, but they are scoped to the code-review/PR lifecycle rather than a general-purpose event/rule engine for arbitrary triggers and actions. Missing for 10: a generic rules/automation builder spanning non-review events, explicit UI for defining custom trigger conditions beyond built-in policies, and independent confirmation these automations behave reliably at scale.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic can approve clean pull requests automatically when your repository policy allows it. Start in shadow mode to see which PRs cubic would…”
   • [claimed-docs] “Enable automatic thread resolution to close findings when the issue is fixed”
   • [claimed-docs] “Custom agents are review rules that enforce your organization's specific best practices across pull requests.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”
   • [claimed-docs] “Flex capacity keeps GitHub PR AI reviews running after your workspace uses its included reviewed-line capacity. You set a monthly spend limi…”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “cubic.yaml lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, an…”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs describe agent rules for permissions/behavior ordering (docs-15, docs-20) and orchestration of parallel agents (docs-12, docs-13), but there is no evidence of user-defined rules that trigger actions automatically on external events (e.g., file changes, webhooks, schedule, git events). This is a plausible axis for a coding agent (many support hooks/triggers), so absence of evidence yields none rather than na.

   • [claimed-docs] “Slate by default respects agent rules in the following order”
   • [claimed-docs] “Each permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   cubic—none0/10

   cubic is a code review/PR automation tool triggered by PR events, webhooks, or manual commands (e.g., @cubic-dev-ai review, cubic review CLI), but no evidence describes scheduling recurring jobs or workflows on a time-based cadence (cron-like automation). Codebase scans and wiki updates appear event/PR-triggered, not user-schedulable recurring jobs.

   ⚑ flag

   Slate—none0/10

   Slate is a coding-agent CLI with orchestration/parallel-agent features and sessions, but nothing in the evidence describes scheduling recurring jobs or workflows (e.g., cron-like triggers, timed recurring runs). Orchestration docs cover on-demand parallelization, not recurrence.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

4. ai-native userVersion, review, and roll back my automations

   weight 1 · round to cubic
   cubic~partialclaimed4/10

   cubic.yaml (the config defining review behavior and custom agents) lives in the repo root, so it inherits git's native versioning and can be reviewed like any code change (cubic-docs-16, cubic-docs-11), but there is no dedicated changelog, rollback UI, or history feature specifically for cubic's automations/config themselves. Missing for 10: explicit rollback/version-history feature for automation configs, evidence of reviewing changes to cubic.yaml itself, dedicated UI for managing automation versions.

   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”
   • [claimed-docs] “Create a repository named `cubic-config` in your organization and add a `cubic.yaml` file to the root directory. cubic automatically applies…”

   proof ↗⚑ flag

   Slate—none0/10

   Evidence shows session management (/sessions, /workspace) and built-in 'programs' like goal/deep-research, but nothing about versioning automations, reviewing history of changes, or rolling back to prior states of an automation/workflow. Missing for 10: any documentation of version history, diffing, or rollback mechanisms for automations/workflows.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Background execution

1. ai-native userHave a cloud agent build, test, and demo a feature end-to-end for my review

   weight 2 · round to Slate
   cubic—none0/10

   cubic is an AI code-review platform: it reviews PRs, fixes flagged issues, generates PR descriptions, and can auto-approve clean PRs, but there is no evidence it autonomously builds a feature from scratch, runs tests, and produces a demo for review — it only acts on existing diffs/PRs authored by humans or other coding agents.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “cubic helps your team spend less time writing PR descriptions automatically by generating clear, concise summaries.”

   proof ↗⚑ flag

   Slate!disputedcontradicted4/10

   Slate's docs claim orchestration of parallel background subagents and being 'one of the few agents capable of performing integration tests manually,' suggesting it could build and test a feature autonomously, but no docs mention a 'demo' output or cloud-hosted execution environment. Community hands-on critique of an actual Slate-produced port directly contradicts the build/test claim: reviewers found the work excluded tests/examples and provided no verifiable repo, undermining confidence that Slate reliably builds+tests end-to-end for review. Missing for 10: evidence of cloud/remote execution infra, an explicit demo-generation feature, and independent confirmation that test suites are actually run and pass.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [community] “Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/exampl…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Parallel agents

1. ai-native userLaunch fleets of autonomous agents that work in parallel on different tasks for hours or days

   weight 2 · round to Slate
   cubic—none0/10

   cubic is positioned as an AI code-review, codebase-scan, and wiki-generation tool, not a platform for users to launch autonomous agent fleets to work on arbitrary tasks for hours/days. 'Codebase scans deploy thousands of AI agents' (cubic-docs-21) is an internal review mechanism, not a user-directed fleet of autonomous agents working independently over long time horizons, and no evidence describes user-initiated multi-agent parallel task execution.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”

   proof ↗⚑ flag

   Slate~partialcommunity7/10

   Docs describe genuine parallel agent orchestration (grid of subagent cards, spinning up more agents while others run in background) and explicitly support multi-hour sessions, matching much of the story. However, evidence only confirms 'multi-hour' not multi-day autonomy, and community commentary raises skepticism about output quality/novelty without directly refuting the parallel-agent mechanics themselves. Missing for 10: confirmation of multi-day unattended runs, independent hands-on validation of fleet-scale parallel task completion.

   • [claimed-docs] “Slate works with you across long, multi-hour sessions.”
   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [community] “Commenter compared the approach to 'Ralph as a service' referencing an existing agentic coding technique (ghuntley.com/ralph), suggesting Sl…”

   proof ↗⚑ flag

Scheduled automation

1. ai-native userSet up always-on agents that run on schedules or triggers to maintain and fix my software autonomously

   weight 2 · round to cubic
   cubic~partialclaimed6/10

   cubic ships trigger-based automation — it auto-reviews every new PR, reacts to force-pushes, can auto-fix flagged issues, auto-approve clean PRs, and runs codebase-wide scans with 'thousands of AI agents' plus a self-updating wiki via rolling PRs — which covers autonomous, trigger-driven maintenance of software. However, there is no evidence of user-defined schedules (cron-like) or general-purpose 'always-on agent' configuration beyond PR/code-review events. Missing for 10: explicit schedule/cron-based agent triggers, evidence of autonomous fixes/maintenance outside the PR-review workflow, and independent confirmation these agents run continuously without human PR-based triggers.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic can approve clean pull requests automatically when your repository policy allows it. Start in shadow mode to see which PRs cubic would…”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “cubic now reviews the new changes after a force-push when it can safely compare them with a previously reviewed version.”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs describe parallel subagent orchestration within a live session (background agents you keep talking to, spin up more agents to parallelize tasks) but there is no evidence of scheduling, event/webhook triggers, or persistent always-on agents that run autonomously outside an active session to maintain/fix software over time.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Debugging

1. developerDebug issues and troubleshoot using natural-language queries

   weight 2 · round to cubic
   cubic~partialcommunity6/10

   cubic supports natural-language interaction for understanding and troubleshooting issues it finds in code review — e.g., replying to review comments for clarification, asking chat to 'tour this PR', adding code to AI chat with diff/codebase context, and its MCP server lets agents 'read review findings... and triage PR or codebase scan issues.' However, this is scoped to PR-review/bug-flagging conversations rather than general-purpose debugging of runtime errors or arbitrary issues outside the review flow. Missing for 10: evidence of open-ended debugging (e.g., stack trace analysis, runtime error investigation) beyond PR/code-review context, and independent hands-on confirmation that these NL Q&A features actually resolve real bugs (community comments dispute overall comment quality/bug-catching rate).

   • [claimed-docs] “Reply to a review comment to ask for clarification”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”

   proof ↗⚑ flag

   Slate~partialclaimed5/10

   Slate's docs show it operates via natural-language prompts, executes shell commands (`!`), references files (`@filename`), and can run integration tests and review codebase architecture in NL form, which implies it could be used for debugging and troubleshooting queries. However there is no explicit example, workflow, or documentation section dedicated to debugging/troubleshooting via natural language, and community evidence is skeptical/unrelated to this specific capability. Missing for 10: explicit debugging-focused examples or docs, independent verification that NL-based debugging works well, dedicated troubleshooting workflow beyond generic agent capabilities.

   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”

   proof ↗⚑ flag

Feature implementation

1. developerDescribe a feature or bug in plain language and have the agent implement or fix it across multiple files

   weight 3 · round to cubic
   cubic~partialclaimed3/10

   Cubic is primarily a code-review platform that finds issues and can push targeted one-click fixes to specific flagged problems (docs-7, docs-44), and its CLI generates a fix prompt for external coding agents (docs-31) rather than implementing features itself. It does not document taking a plain-language feature/bug description and independently implementing changes across multiple files; that work is explicitly handed off to a separate 'coding agent' (docs-15, docs-30). Missing for 10: evidence of accepting an open-ended natural-language feature/bug description (not just a flagged review comment) and autonomously implementing multi-file changes, plus any hands-on validation of such end-to-end generation.

   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”

   proof ↗⚑ flag

   Slate!disputedcontradicted5/10

   Docs imply broad multi-file code work (e.g. the quickstart example asks Slate to review an entire codebase and produce ARCH.md, plus orchestration features for parallelizing tasks across files/agents), suggesting Slate can act on plain-language requests across a codebase. However, independent community scrutiny of a specific real-world claim (a 'ported library' from one sentence) found it was actually a trivial JS->TS rename, excluded tests, lacked a verifiable repo, and drew explicit skepticism about the quality/usefulness of the generated code — concretely contradicting the marketed multi-file code-generation capability. Missing for 10: first-party documentation of a genuine multi-file bug-fix/feature-implementation workflow with verifiable before/after results, and independent hands-on confirmation that resolves the community dispute.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [community] “Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/exampl…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Maintenance automation

1. developerHave the agent write tests, fix lint errors, resolve merge conflicts, and update dependencies for me

   weight 3 · round drawn
   cubic~partialclaimed3/10

   cubic can automatically fix issues it flags in review (e.g., 'Fix with cubic' pushes a fix commit, docs-7/44) which could cover some lint-style issues, but there is no evidence it writes tests, resolves merge conflicts, or updates dependencies — cubic is positioned as a review/fix-on-comment tool, not a general-purpose coding agent for these tasks. missing for 10: test generation, merge-conflict resolution, dependency updates, and any evidence beyond review-triggered lint/bug fixes.

   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”

   proof ↗⚑ flag

   Slate~partialcommunity3/10

   Slate is documented as a general-purpose coding agent with shell execution, file editing, permissioning, and orchestration of multiple sub-agents (random-labs-docs-9, random-labs-docs-13, random-labs-docs-16), which implies it could perform tasks like running tests or lint/dependency commands, but the evidence never explicitly documents test-writing, lint-fixing, merge-conflict resolution, or dependency updates as capabilities. Community commentary raises quality concerns about generated code but doesn't specifically address these tasks. Missing for 10: explicit documentation or examples of writing/fixing tests, resolving lint errors, resolving merge conflicts, and updating dependencies.

   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Codebase mapping

1. developerUnderstand how a codebase fits together to find where to start making changes

   weight 3 · round to cubic
   cubic~partialclaimed6/10

   cubic's AI wiki auto-indexes the codebase into a searchable wiki with architecture diagrams and source-code links, and its MCP server/chat features let developers query the codebase and diffs for context (cubic-docs-22, cubic-docs-23, cubic-docs-15, cubic-docs-10), which directly supports understanding how a codebase fits together before making changes. Codebase scans (cubic-docs-21) add bug/vuln discovery but aren't about architectural navigation. Missing for 10: independent/hands-on validation that the wiki or chat actually helps developers locate where to start changes, and community evidence is silent on this specific capability (only comments on PR review quality exist).

   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”

   proof ↗⚑ flag

   Slate~partialclaimed5/10

   The quickstart example explicitly shows Slate producing an ARCH.md architecture review of an entire codebase with improvement suggestions, directly supporting codebase-understanding use cases, and @filename references plus workspace management help navigate a repo. However there's no dedicated codebase-mapping/search feature (e.g., symbol index, dependency graph) documented beyond this one example, and no independent evidence confirming quality of such architecture summaries. missing for 10: dedicated code-navigation/search tooling, independent validation of architecture-summary accuracy, more than a single example of codebase-understanding workflow.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”

   proof ↗⚑ flag

2. developerHave the agent map and explain an entire unfamiliar codebase without manually selecting context files

   weight 3 · round drawn
   cubic~partialclaimed6/10

   cubic's AI wiki automatically indexes the entire codebase and produces searchable wikis with architecture diagrams and source links, and codebase scans deploy AI agents across the whole repo — both let a developer get a full-codebase map/explanation without hand-picking context files. However, this is documented only in first-party docs with no independent hands-on validation of how well it 'explains' an unfamiliar codebase, and community commentary focuses on PR-review quality rather than the wiki/codebase-scan features. Missing for 10: independent/hands-on verification of the AI wiki's accuracy and usefulness, and community evidence specifically evaluating whole-codebase explanation quality.

   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”

   proof ↗⚑ flag

   Slate~partialcommunity6/10

   Docs show Slate's quickstart example explicitly demonstrates asking it to 'review the architecture of my entire codebase' and generate an ARCH.md without manual file selection, and it has orchestration/subagent features for broad exploration. However there's no independent/hands-on verification that this codebase-mapping actually works well on large unfamiliar repos, and community evidence raises quality skepticism about other generated outputs. missing for 10: independent hands-on validation of full-codebase mapping accuracy, evidence of handling very large/unfamiliar codebases without manual curation, detail on how context is auto-selected under the hood.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Context management

1. developerHave the agent build and recall memory automatically across sessions

   weight 2 · round to cubic
   cubic~partialclaimed3/10

   Cubic maintains some persistent state — it compares force-pushed changes against previously reviewed versions and its AI wiki auto-indexes and keeps codebase docs current — but there's no documented feature describing agent 'memory' that is built and recalled across chat/review sessions in the way the story implies. missing for 10: explicit session-memory mechanism, evidence of recall in later interactions, independent confirmation of persistent context use.

   • [claimed-docs] “cubic now reviews the new changes after a force-push when it can safely compare them with a previously reviewed version.”
   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”

   proof ↗⚑ flag

   Slate—none0/10

   Docs describe session switching (/sessions), long multi-hour session support, and diagnostic context attachment, but there is no evidence of automatic cross-session memory building or recall — sessions appear to be manually selected/switched contexts, not an automatic memory system. Missing for higher verdict: any documentation of persistent memory storage, automatic recall of past codebase context, or memory summarization across sessions.

   • [claimed-docs] “Slate works with you across long, multi-hour sessions.”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Slate automatically attaches relevant diagnostic information (OS, version, session context) to your report.”

   proof ↗⚑ flag

2. developerInclude multiple project directories in a single session for broader context

   weight 2 · round to Slate
   cubic~partialclaimed4/10

   Cubic's 'cross-repo reviews' feature lets teams link related repositories so a review can check shared APIs, schemas, or docs across them, which is the closest analogue to including multiple project directories for broader context — but this is scoped narrowly to PR review consistency checks, not a general chat/agent session that loads multiple directories for open-ended Q&A. Missing for 10: evidence of a chat/agent session (e.g., MCP or CLI) that lets a developer add multiple arbitrary project directories as context, and any hands-on confirmation of cross-repo context quality.

   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository. Link related repositories so reviews can chec…”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs mention a `/workspace` manager for reviewing and removing 'workspace directories' (plural), implying support for multiple project directories in one session, but there's no detailed documentation on how directories are added or how context is merged across them, and no independent/hands-on confirmation. Missing for 10: explicit instructions/examples for adding multiple directories, and independent verification that broader multi-directory context actually works in practice.

   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”

   proof ↗⚑ flag

3. developerAdd a project instructions file to set coding standards and conventions the agent follows

   weight 3 · round drawn
   cubic~partialclaimed6/10

   cubic supports a `cubic.yaml` config file at the repo root (or a shared `cubic-config` repo) that acts as 'the source of truth for AI review behavior, ignore patterns, PR descriptions, and custom agents,' and 'Custom agents' are documented as a way to 'enforce your team's coding standards.' This is a project-level instructions/config mechanism the agent follows, though it's framed around PR review behavior rather than a general-purpose coding-standards instructions file for all agent interactions. Missing for 10: explicit documentation of a plain-text/markdown instructions file (like AGENTS.md-style) covering broader coding conventions beyond review/ignore rules, and independent confirmation that custom agents reliably enforce standards in practice.

   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “Create a repository named `cubic-config` in your organization and add a `cubic.yaml` file to the root directory. cubic automatically applies…”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs confirm Slate 'respects agent rules' in a defined precedence order and supports Skills (markdown instruction packages, including Claude Code-compatible `.claude/skills/` paths), which cover project-level conventions/instructions, but there's no explicit example of a single top-level 'instructions file' analogous to AGENTS.md/CLAUDE.md being demonstrated end-to-end. missing for 10: explicit naming/format of the project instructions file, a worked example showing the agent following custom conventions from it, and independent/community confirmation it works as documented.

   • [claimed-docs] “Slate by default respects agent rules in the following order”
   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “`.claude/skills/` | Claude Code compatibility”

   proof ↗⚑ flag

Issue diagnosis

1. developerReproduce issues, narrow down root causes, and verify fixes

   weight 3 · round drawn
   cubic~partialclaimed4/10

   cubic is fundamentally an AI code-review/PR platform: it can flag bugs during review (codebase scans, PR review), generate and push fixes ('Fix with cubic'), and auto-resolve threads when issues are fixed, which covers some root-cause flagging and fix verification. However there is no evidence of actual issue reproduction (running the app/tests to trigger a bug) or root-cause debugging via execution—cubic's analysis is static/AI-review based, not a runtime debugger. Missing for 10: reproduction of bugs via execution/testing, dynamic root-cause tracing, and independent verification of fixes beyond thread auto-resolution.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Enable automatic thread resolution to close findings when the issue is fixed”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”

   proof ↗⚑ flag

   Slate~partialclaimed4/10

   Slate documents shell execution (`!`), file references, and being 'one of the few agents capable of performing integration tests manually,' which are plausible building blocks for debugging workflows, but there's no explicit documentation of a reproduce→diagnose→verify-fix workflow. Missing for 10: explicit debugging/root-cause-analysis workflow documentation, evidence of test-driven verification loops, and independent hands-on confirmation that Slate helps developers actually reproduce and fix bugs.

   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”

   proof ↗⚑ flag

Marketplace

1. developerEquip the agent with custom skills to perform specialized tasks

   weight 1 · round to Slate
   cubic~partialclaimed4/10

   cubic supports 'custom agents' configured via cubic.yaml to enforce coding standards, which is a limited form of custom skill/persona equipping for the review agent, but this is scoped narrowly to code-review behavior rather than general-purpose specialized task skills. Missing for 10: documentation on creating arbitrary custom skills/tools beyond coding-standard enforcement, examples of diverse specialized tasks, and independent validation of the custom agents feature.

   • [claimed-docs] “**Custom agents**: Enforce your team’s coding standards”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”

   proof ↗⚑ flag

   Slate✓fullclaimed7/10

   Slate has a documented Skills system: markdown instruction packages that give the agent domain-specific knowledge/behavior, with example skill definitions and compatibility with Claude Code's `.claude/skills/` format, letting developers equip the agent with custom specialized capabilities. Missing for 10: independent/hands-on verification that custom skills work as documented, and more detail on skill authoring/discovery beyond the single example.

   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “description: "Create distinctive, production-grade frontend interfaces."”
   • [claimed-docs] “`.claude/skills/` | Claude Code compatibility”

   proof ↗⚑ flag

2. engineering-leadIntegrate third-party partner-built agent apps into my workflows

   weight 1 · round to cubic
   cubic~partialprobed6/10

   cubic documents concrete integrations with third-party agent apps - connecting ChatGPT Plus or Claude Code subscriptions for local reviews, exposing an MCP server so coding agents can pull review findings and request PRs, pushing fixes via coding agents, and Linear or Jira issue-analysis integration - showing real ecosystem hooks for partner-built agent tools. Missing for 10: a documented marketplace or catalog of certified partner agent apps, examples beyond the major AI vendors, and independent evidence confirming these integrations work smoothly in practice.

   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “cubic can automatically analyze your pull requests to see if they meet the requirements from your linked Linear or Jira issues.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is a coding CLI agent focused on subagents, skills, sessions, and model orchestration; there is no evidence of an ecosystem for integrating third-party partner-built agent apps (e.g., a marketplace, app store, or partner integration framework). Skills compatibility with Claude Code is mentioned but that is file-format compatibility, not partner app integration.

   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “`.claude/skills/` | Claude Code compatibility”

   proof ↗⚑ flag

Team knowledge

1. engineering-leadCreate a shared workspace from my docs and repos as a common source of truth for the team

   weight 1 · round to cubic
   cubic~partialclaimed5/10

   cubic's AI wiki automatically indexes a repo's codebase into a searchable, shared wiki (with architecture diagrams) that's exported into the repo and kept current via PRs, giving teams a common source of truth derived from code — but this is scoped to repos, not to ingesting a team's existing docs into one workspace. Missing for 10: explicit support for importing/aggregating external docs, cross-repo/team-wide workspace view (only per-repo wiki + cross-repo review linking), and any independent evidence the wiki is actually used as a 'workspace' by teams.

   • [claimed-docs] “cubic's AI wiki automatically indexes your codebase and produces searchable wikis, complete with links to source code, architecture diagrams…”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository.”
   • [claimed-docs] “Cross-repo reviews help cubic catch changes that need a matching update in another repository. Link related repositories so reviews can chec…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is a CLI coding agent focused on individual sessions, workspaces (local directories), skills, and orchestration of subagents—there is no evidence of a shared team workspace or collaborative source-of-truth feature built from docs and repos. The 'workspace' concept here refers to local directory management (/workspace), not a shared team hub.

   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”
   • [claimed-docs] “Slate by default respects agent rules in the following order”
   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”

   proof ↗⚑ flag

Tool integration

1. developerConnect the agent to workflow tools like Jira, Slack, and Google Drive to extend its context

   weight 3 · round drawn
   cubic—none0/10

   cubic's documented integrations are limited to GitHub, an MCP server for coding agents, and ChatGPT/Claude Code subscriptions for local reviews; there is no evidence of connectors to Jira, Slack, or Google Drive for extending context.

   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [community] “As far as I can see, this doesn't directly integrate with github (we currently use coderabbit on github)? Is it on your timeline?”
   • [community] “Would be great to have support for GitLab also (have a project there that I would love to try this on and I can't switch it to GitHub)”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence anywhere in the docs pack mentions integrations with Jira, Slack, Google Drive, or any workflow tools/MCP connectors; the docs focus on CLI usage, sessions, skills, and permissions with no mention of external tool connectivity.

   ⚑ flag

2. developerKick off agent tasks directly from GitHub, GitLab, Linear, or Slack

   weight 2 · round to cubic
   cubic~partialcommunity4/10

   cubic clearly supports triggering reviews and fixes from GitHub (PR comments like `@cubic-dev-ai review this PR`, 'Fix with cubic', auto-review on install) and links to Linear/Jira for issue-requirement checks, but there's no evidence of Slack integration and community comments explicitly note GitLab support is missing/requested, not confirmed. Missing for 10: documented Slack task-triggering, confirmed GitLab support, and independent corroboration that Linear integration goes beyond issue-analysis to actually kicking off agent tasks.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “To review a PR that was opened _before_ you installed the app, comment: `@cubic-dev-ai review this PR`.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [claimed-docs] “Post this comment on GitHub to start a review: text theme={null} @cubic-dev-ai review this PR ”
   • [claimed-docs] “cubic can automatically analyze your pull requests to see if they meet the requirements from your linked Linear or Jira issues.”
   • [community] “Would be great to have support for GitLab also (have a project there that I would love to try this on and I can't switch it to GitHub)”
   • [community] “It looks like graphite.dev has pivoted into this space too, which is annoying since they still don't have gitlab support after several years…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence of any integration with GitHub, GitLab, Linear, or Slack for triggering agent tasks; Slate's documentation covers CLI usage, sessions, skills, and configuration but nothing about ecosystem/platform triggers.

   ⚑ flag

Cross device continuity

1. developerStart a task on one device and continue it later from another device or browser

   weight 2 · round to cubic
   cubic~partialclaimed3/10

   cubic's reviews, chat, and fix actions happen inside GitHub PR comments and threads (docs-29, docs-45, docs-7), which are cloud-hosted and thus technically accessible from any device/browser, but cubic never documents an explicit cross-device 'resume task' or session-continuity feature for a developer's own work-in-progress task. Missing for 10: explicit session/task persistence across CLI, IDE, and browser, documented device-handoff workflow, and any first-party or community confirmation of resuming an in-progress task on a new device.

   • [claimed-docs] “Interact with cubic in PR comments to ask questions, trigger reviews, and fix issues.”
   • [claimed-docs] “Ask follow-up questions about code changes without leaving the PR”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”

   proof ↗⚑ flag

   Slate—none0/10

   Docs show session management within Slate (e.g. `/sessions` to switch sessions, `Ctrl+X N` for new session) but only describe local session switching, not any cloud sync or cross-device/browser continuation mechanism. Slate appears to be a terminal-only CLI tool with no mention of a browser interface or account-based sync for resuming tasks elsewhere.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Ctrl+X then N New session”
   • [claimed-docs] “npm i -g @randomlabs/slate”

   proof ↗⚑ flag

Ide integration

1. developerChat with the coding assistant directly inside my IDE for contextual help

   weight 3 · round to Slate
   cubic~partialclaimed5/10

   cubic offers chat-based interaction (an 'Add to AI chat' feature with diff/codebase context, a chat sidebar for PR navigation, and an MCP server that lets coding agents in the IDE read review findings), but these are mostly scoped to reviewing PRs/code review rather than a general-purpose in-IDE chat assistant for arbitrary contextual coding help. Missing for 10: evidence of a native IDE chat panel for general coding questions (not tied to PR/diff review), and independent hands-on confirmation of in-IDE chat quality.

   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “The chat sidebar helps you quickly understand and navigate your pull requests (PRs) with intelligent, context-aware assistance directly with…”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Slate is documented as a terminal-based coding agent with session management, `@filename` references, shell execution, and workspace context — providing contextual chat help that developers can run alongside their editor in a terminal. However, there is no evidence of a native IDE extension/panel (e.g., VS Code/JetBrains plugin) that embeds Slate directly inside the IDE UI itself. missing for 10: dedicated IDE extension/panel integration, evidence of in-editor chat UI beyond terminal, independent corroboration of IDE workflow usage.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”
   • [claimed-docs] “Ctrl+X then N New session”

   proof ↗⚑ flag

Terminal workflow

1. developerRun a coding agent locally from my terminal

   weight 3 · round to Slate
   cubic~partialprobed5/10

   cubic ships an official local CLI (`cubic review`) that runs from the terminal to review uncommitted changes before push, and can connect to Claude Code/ChatGPT subscriptions for local reviews, but this is a review agent rather than a general-purpose coding agent that writes/edits code interactively in the terminal. Missing for 10: evidence of an interactive terminal coding-agent loop (code generation/editing, multi-turn task execution) beyond review-only CLI use.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate✓fullprobed8/10

   Slate ships as a global npm CLI (`npm i -g @randomlabs/slate`) that runs interactively in the terminal, with documented terminal-native features like hotkeys, shell command execution (`!`), file references (`@filename`), session management (`/sessions`), and configuration via `slate.json` — all consistent with a locally-run terminal coding agent. Missing for 10: independent hands-on confirmation of local terminal usage (community evidence only discusses porting-quality skepticism, not terminal operation itself) and no evidence of offline/non-terminal fallback limitations.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Press Tab to queue the current message so it runs after the current turn finishes.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Ctrl+X then N New session”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”

   proof ↗⚑ flag

2. developerRun the agent non-interactively in scripts for workflow automation

   weight 2 · round to cubic
   cubic~partialprobed5/10

   cubic ships a CLI (`cubic review`) that reviews local/uncommitted changes and automatically reviews PRs on GitHub without manual intervention, both of which suggest it can be woven into automated workflows (docs-4, docs-8, docs-31, docs-41). However, there is no explicit documentation of a non-interactive/headless mode, CI pipeline integration, exit codes, or scripting flags for the CLI. missing for 10: explicit CI/script integration docs, non-interactive mode flags, exit-code/output-format guarantees for automation, independent evidence of scripted use.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “cubic automatically starts reviewing new pull requests in your selected repositories.”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate—none0/10

   The evidence shows Slate is a CLI-based interactive agent (npm install, onboarding, in-session commands like /sessions, !, @filename) but nowhere documents a non-interactive/headless mode, flags for scripted execution, or CI/automation usage; --dangerously-skip-permissions bypasses prompts but is not shown as enabling scripted/non-interactive invocation. Missing for 10: documentation of a non-interactive/print/exec mode, exit-code or piping behavior, or any CI/scripting examples.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to cubic
   cubic~partialprobed4/10

   cubic exposes some functionality outside the UI — an Analytics API for PR-level data (cubic-docs-20), an MCP server for reading review findings, requesting reviews, and even managing subscriptions/seats (cubic-docs-3, cubic-docs-15), and a CLI for local reviews (cubic-docs-8, cubic-probe-4) — but there is no general-purpose public API (openapi probes 404, cubic-probe-2) covering the full UI surface (codebase scans, AI wiki, cubic.yaml config, analytics dashboard CSV exports, custom agents, auto-approve settings). Missing for 10: a comprehensive REST/GraphQL API or OpenAPI spec covering all UI features, evidence of API parity for wiki/codebase-scan/config management, and independent confirmation that MCP+CLI+Analytics API together replicate full UI functionality.

   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”
   • [claimed-docs] “You can now ask your coding agent to check your cubic subscription, manage team seats and roles, and purchase more seats without leaving you…”
   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”
   • [probe] “official MCP server documented at https://docs.cubic.dev/ide/mcp-server”
   • [probe] “official CLI documented at https://docs.cubic.dev/ide/cli-review”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence of any public API for Slate — the openapi.json/swagger.json probes returned 404s and no docs reference programmatic endpoints; Slate is documented purely as a CLI/terminal agent with slash-commands, hotkeys, and config files, not an API-driven product with UI/API parity.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”
   • [claimed-docs] “npm i -g @randomlabs/slate”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to cubic
   cubic~partialclaimed4/10

   cubic offers some data portability: CSV export of team analytics (cubic-docs-19), an Analytics API for PR-level data (cubic-docs-20), and AI wiki content exported as markdown files into the repo (cubic-docs-23). However, there's no evidence of comprehensive export covering all review history, comments, configs, or account data in open formats, nor any documented account deletion/migration path for 'leaving' the platform. Missing for 10: full account/data export (reviews, comments, configs), explicit data-portability policy, independent confirmation of export completeness.

   • [claimed-docs] “You can export team member data as CSV from both [AI coding](/analytics/ai-coding#csv-export) and [De”
   • [claimed-docs] “The Analytics API gives you PR-level data on how many issues were flagged, how many were fixed, how much AI code was authored, etc.”
   • [claimed-docs] “cubic exports the wiki as markdown files into a directory in your repo (default `.cubic/wiki`) and keeps them current through a rolling pull…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the docs or elsewhere describes any data export functionality, open-format export, or data portability mechanism for Slate. Sessions, workspace history, and configurations appear stored locally but no documented export/leave path is mentioned. Missing for 10: any documentation of export commands, data format specifications, or account/data portability guarantees.

   ⚑ flag

3. ai-native userRead the product's source under an open license

   weight 2 · round drawn
   cubic—none0/10

   No evidence in the pack indicates cubic's source code is open or available under any open license; it appears to be a closed, commercial SaaS/CLI product with only documentation exposed publicly. Missing for 10: any open-source repository, license file, or public source code reference.

   ⚑ flag

   Slate—none0/10

   No evidence of an open-source license or public source repository for Slate; the CLI is distributed via npm install with no mention of source availability. missing for 10: open-source license declaration, public source repo link, license file/OSS registry evidence.

   ⚑ flag

4. ai-native userSelf-host the core product

   weight 3 · round drawn
   cubic—none0/10

   cubic is presented as a hosted SaaS code review platform (GitHub app, cloud dashboard, analytics, flex capacity billing) with no documentation of a self-hostable core, on-prem deployment, or open-source release. Absence of any self-hosting evidence for an applicable axis (a code review tool could plausibly be self-hosted) means this is 'none'.

   • [claimed-docs] “Once installed, cubic automatically reviews new pull requests.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”
   • [claimed-docs] “Flex capacity keeps GitHub PR AI reviews running after your workspace uses its included reviewed-line capacity. You set a monthly spend limi…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence anywhere in the docs of Slate being open-source or offering a self-hosted deployment option; it's installed via npm as a CLI that connects to model subscriptions/credits, implying a hosted/service model rather than self-hostable core infrastructure. Missing for 10: any mention of self-hosting instructions, open-source repo, or on-prem deployment option.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

Authentication

1. developerAuthenticate with an API key instead of an account login

   weight 2 · round drawn
   cubic—none0/10

   No evidence in the pack mentions API key authentication as an alternative to account login; cubic's docs describe GitHub app installation, roles/permissions, and subscription management but nothing about API-key-based auth for developers. The OpenAPI probe also returned 404s, suggesting no documented API surface with key auth.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.cubic.dev/openapi.json, https://docs.cubic.dev/swagger.json, https://docs.cubic.dev/api…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence pack mentions API key authentication as an alternative to account login; onboarding docs only describe choosing a model source (ChatGPT/Codex, SuperGrok, or Slate credits subscription), not API-key auth. No mention of an API key mechanism anywhere, and the openapi probe returned 404s, giving no indication of an API-key based auth path.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”

   proof ↗⚑ flag

2. engineering-leadAuthenticate through an enterprise identity or cloud platform for compliance and scalability

   weight 2 · round drawn
   cubic—none0/10

   The evidence pack shows role-based access control for team/subscription management (cubic-docs-47) but no mention of SSO, SAML, OAuth enterprise identity provider integration, or cloud IAM authentication anywhere in the docs or community items. missing for 10: SSO/SAML support, enterprise IdP integration (Okta/Azure AD/Google Workspace), cloud IAM authentication, any compliance certification tied to auth.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence of SSO/SAML/OIDC enterprise identity integration or cloud-platform authentication for compliance; onboarding only mentions choosing a model source (ChatGPT/Codex, SuperGrok, or Slate credits), not enterprise identity federation.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

3. developerSign in with my existing product subscription plan to use the coding agent

   weight 2 · round to Slate
   cubic~partialclaimed6/10

   cubic explicitly lets developers connect an existing ChatGPT Plus/Pro or Claude Code subscription to power local CLI reviews, which matches 'sign in with existing subscription to use the coding agent.' However, this only applies to local review via CLI, not the full agent/reviewer product, and there's no independent verification of this flow working in practice. Missing for 10: broader applicability beyond CLI reviews, and community/hands-on confirmation of the subscription linking process.

   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”

   proof ↗⚑ flag

   Slate✓fullclaimed8/10

   Docs explicitly state onboarding lets you choose your model source as your existing ChatGPT/Codex subscription or SuperGrok subscription (in addition to Slate credits), directly matching the story of signing in with an existing subscription plan to use the agent. Missing for 10: independent/hands-on confirmation that subscription sign-in actually works end-to-end and any detail on limitations of that mode vs credits.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

4. developerSign in with a personal account to get free-tier access without managing API keys

   weight 1 · round to Slate
   cubic—none0/10

   cubic is a code-review/PR platform with team subscriptions, seats, and flex-capacity billing; no evidence describes a personal-account sign-in path granting free-tier access without API key management—this pricing/auth model story is unaddressed in the pack.

   ⚑ flag

   Slate~partialclaimed4/10

   Docs show onboarding lets users choose a model source including an existing ChatGPT/Codex or SuperGrok subscription instead of managing API keys, implying account-based auth is supported, but there's no explicit mention of a free tier or of signing in with a personal Slate account for free credits without a paid subscription. Missing for 10: explicit free-tier account sign-in flow, confirmation that 'Slate credits' option requires no payment, and any account-based (not subscription-based) login mechanism.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

Model choice

1. developerLet the tool automatically pick the best model for each task

   weight 1 · round to Slate
   cubic—none0/10

   Cubic's docs describe distinct manually-invoked review modes (standard review vs. Ultrareview) and let users connect their own ChatGPT/Claude subscriptions for local reviews, but there is no evidence the tool automatically selects the best model per task based on cost or complexity — mode selection is user-driven, not automatic.

   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models, and typically takes a…”
   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “You set a monthly spend limit, and cubic buys extra reviewed-line capacity only when a review would otherwise be paused.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs explicitly claim Slate 'automatically selects the right model for the job' and also allow developers to set preferred default models per slot via `/models` or `slate.json`, suggesting a hybrid automatic+manual approach relevant to pricing/limits tradeoffs. However, there's no detail on the selection logic, cost-awareness, or independent verification that auto-selection actually optimizes for task/price. Missing for 10: independent hands-on confirmation of auto-selection quality, explanation of selection criteria (cost vs capability), and evidence of pricing-limit awareness in model choice.

   • [claimed-docs] “Slate automatically selects the right model for the job.”
   • [claimed-docs] “Set preferred default models for each slot with the `/models` dialog or `slate.json` under `models`.”

   proof ↗⚑ flag

2. developerChoose which underlying AI model powers my session from multiple providers

   weight 2 · round to Slate
   cubic~partialclaimed5/10

   Cubic docs state you can "connect your existing ChatGPT Plus/Pro or Claude Code subscription to use its models for local reviews" via the CLI, showing some model-provider choice, but PR reviews and Ultrareview use cubic's own proprietary 'most capable review models' with no indication of choosing among alternative providers there. missing for 10: model choice for the core PR/Ultrareview review sessions (not just local CLI), a documented list of selectable providers, and independent confirmation of the feature working in practice.

   • [claimed-docs] “Connect your existing **ChatGPT Plus/Pro** or **Claude Code** subscription to use its models for local reviews.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models, and typically takes a…”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs confirm model source can be chosen at onboarding (ChatGPT/Codex, SuperGrok, or Slate credits) and that default models per 'slot' can be set via `/models` or slate.json, showing multi-provider flexibility. However, this is framed around subscription/credit sources rather than a clear list of many independent model providers, and there's no independent/hands-on verification of switching providers mid-session. missing for 10: independent corroboration of provider switching, a full list of supported model providers, and confirmation this works reliably in practice.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [claimed-docs] “Set preferred default models for each slot with the `/models` dialog or `slate.json` under `models`.”

   proof ↗⚑ flag

1. ai-native userChoose where my data is stored (region/residency)

   weight 2 · round drawn
   cubic—none0/10

   No evidence in the pack mentions data residency, region selection, or storage location controls for cubic; the docs focus entirely on code review, PR workflows, and analytics with no privacy/data-residency configuration options mentioned.

   ⚑ flag

   Slate—none0/10

   Slate is a CLI coding agent tool; the evidence pack contains no mention of data residency, region selection, or storage location controls. Missing for 10: any documentation of data residency options, regional storage configuration, or compliance controls.

   ⚑ flag

2. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   cubic—none0/10

   No evidence in the pack addresses data usage for AI model training, opt-out policies, or data privacy commitments — cubic's docs focus entirely on code review features with no mention of training data controls.

   ⚑ flag

   Slate—none0/10

   No evidence in the pack addresses data-training opt-out, privacy policy, or any control over model training use; the documentation covers CLI usage, orchestration, and skills but nothing about data privacy posture. Missing for 10: any privacy policy statement, opt-out settings, or data usage terms regarding AI training.

   ⚑ flag

3. ai-native userControl data retention and deletion

   weight 2 · round drawn
   cubic—none0/10

   No evidence in the pack addresses data retention policies, deletion controls, or privacy settings for AI-native users; docs cover review features, analytics, wiki, and pricing but nothing on retention/deletion of data. Missing for 10: any documentation on data retention periods, deletion requests, or privacy controls.

   ⚑ flag

   Slate—none0/10

   No evidence pack items mention data retention policies, deletion controls, or privacy settings for user data/sessions; docs cover workspace management and permissions but not data retention/deletion. Missing for 10: any documentation of data retention periods, deletion mechanisms, or export/erase controls.

   ⚑ flag

4. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round drawn
   cubic—none0/10

   No evidence pack item addresses telemetry opt-out or usage-tracking controls; cubic's docs cover review features, analytics dashboards, and RBAC but never mention a privacy/telemetry toggle. missing for 10: any mention of telemetry collection, opt-out settings, or privacy controls.

   ⚑ flag

   Slate—none0/10

   No evidence pack item mentions telemetry, usage tracking, analytics, or an opt-out setting anywhere in Slate's docs or community coverage; the closest item (diagnostic attachment on bug reports) doesn't address general telemetry opt-out. Missing for 10: any mention of telemetry collection, a privacy policy, or a documented opt-out flag/setting.

   • [claimed-docs] “Slate automatically attaches relevant diagnostic information (OS, version, session context) to your report.”

   proof ↗⚑ flag

Data governance

1. engineering-leadOpt out of having my code and prompts used for AI model training

   weight 1 · round drawn
   cubic—none0/10

   No evidence in the pack addresses data-privacy or AI training opt-out policies for code/prompts; nothing in the docs, changelog, or community discussion mentions this capability. missing for 10: any documentation of data usage policy, training opt-out settings, or privacy controls.

   ⚑ flag

   Slate—none0/10

   No evidence in the pack addresses data usage, training opt-out, or privacy policy for prompts/code submitted to Slate or its model providers.

   ⚑ flag

Pr review

1. developerHave the agent stage changes, write commit messages, create branches, and open pull requests

   weight 3 · round to cubic
   cubic~partialclaimed4/10

   cubic can push fix commits directly to an existing PR branch and auto-generate PR descriptions/summaries (cubic-docs-30, cubic-docs-44, cubic-docs-26, cubic-docs-49), but its own docs show the developer still runs the initial git workflow (checkout -b, commit, push) to create the branch and open the PR (cubic-docs-51) — cubic is a review/fix layer, not an agent that autonomously stages changes, writes original commit messages, creates branches, or opens PRs from scratch. missing for 10: evidence of cubic independently creating a new branch, staging changes, and opening a brand-new pull request without a human first running git/opening the PR.

   • [claimed-docs] “By default, cubic pushes commits directly to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Generates PR descriptions based on code changes”
   • [claimed-docs] “cubic helps your team spend less time writing PR descriptions automatically by generating clear, concise summaries.”
   • [claimed-docs] “you can keep using normal Git commands exactly as before (e.g., `git checkout -b my-feature`, `git commit -m "message"`, `git push`). Using …”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the pack mentions git operations like staging, committing, branching, or opening pull requests; documentation covers sessions, orchestration, skills, permissions, and CLI setup but not any git/PR workflow. Absence of evidence for this applicable capability means the verdict is none.

   ⚑ flag

2. developerInspect diffs and run checks to catch problems before merging

   weight 3 · round to cubic
   cubic✓fullcommunity8/10

   cubic provides diff-focused PR review (hiding tests, force-push re-review), a CLI (`cubic review`) to check uncommitted changes before pushing, Ultrareview for deep multi-pass checks, and auto-fix/auto-approval gating before merge — directly matching 'inspect diffs and run checks before merging'. Community feedback corroborates real-world use but also raises concerns about comment relevance and false-positive rates, tempering confidence. Missing for 10: independent quantitative validation of bug-catch accuracy and resolution of noise/false-positive concerns raised by users.

   • [claimed-docs] “Run a review before you push to catch issues while you're working.... review your uncommitted changes: `cubic review`”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “The **cubic CLI** reviews local changes before you push. It finds bugs and generates a prompt that your coding agent can use to fix them.”
   • [claimed-docs] “cubic now reviews the new changes after a force-push when it can safely compare them with a previously reviewed version.”
   • [claimed-docs] “Focus on implementation changes by hiding test files from the PR diff and file tree.”
   • [claimed-docs] “Auto-approval lets you skip human review for pull requests that cubic determines are low risk and issue-free.”
   • [community] “I've been testing this for the last few months, and it is now much quieter than before, and even more useful.”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”

   proof ↗⚑ flag

   Slate~partialclaimed3/10

   Slate's docs mention it can perform integration tests manually (random-labs-docs-16), implying some check-running capability, but there is no evidence of diff inspection, git diff review, PR-style change summaries, or pre-merge validation workflows. missing for 10: diff/change inspection UI or command, explicit pre-merge check/test running workflow, and any corroborating hands-on evidence of catching problems before merge.

   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”

   proof ↗⚑ flag

Safe execution

1. engineering-leadControl which external tools and integrations the agent is allowed to access

   weight 2 · round to Slate
   cubic—none0/10

   Evidence shows cubic has RBAC for subscription/settings management (cubic-docs-47) and cubic.yaml config for review behavior (cubic-docs-16/36), but nothing documents an engineering-lead controlling which external tools, MCP servers, or integrations the cubic agent itself is permitted to access. Missing for 10: any admin-facing tool/integration allowlist or permission gate for the agent's external tool access.

   • [claimed-docs] “cubic uses a role-based access control system to manage who can make changes to your team's subscription and settings.”
   • [claimed-docs] “`cubic.yaml` lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, …”
   • [claimed-docs] “cubic.yaml lives in the root of your repository and becomes the source of truth for AI review behavior, ignore patterns, PR descriptions, an…”
   • [claimed-docs] “Connect cubic's MCP server to your coding agent to read review findings and codebase context, request PR reviews, and triage PR or codebase …”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Slate's configuration docs describe a permission system where each permission key maps to allow/ask/deny actions or fine-grained pattern objects, which supports controlling what tools/actions the agent can perform, and a `--yolo` flag exists to bypass these prompts entirely. However there's no explicit documentation of controlling specific external integrations (e.g., MCP servers, API connectors) or org/team-level lockdown for an engineering lead specifically. Missing for 10: explicit external-integration/MCP allowlist docs, engineering-lead/team-level enforcement (vs individual config), and independent verification that permission enforcement can't be trivially bypassed.

   • [claimed-docs] “Each permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.”
   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”

   proof ↗⚑ flag

Security checks

1. engineering-leadSee license and public-code matching references for AI-suggested code

   weight 1 · round drawn
   cubic—none0/10

   cubic's evidence covers PR review, bug/vulnerability detection, custom agents, analytics, and codebase scans, but there is no mention of license compliance checking or public-code/plagiarism matching references for AI-suggested code. Missing for 10: license detection features, public-code/match provenance references, any SCA or license-compliance tooling.

   ⚑ flag

   Slate—none0/10

   No evidence anywhere in the pack mentions license compliance checks, public-code/OSS matching, or provenance references for AI-suggested code; the docs cover orchestration, skills, permissions, and CLI usage but nothing about code provenance/license scanning.

   ⚑ flag

2. developerGet contextual explanations and automatic fixes for security vulnerabilities

   weight 2 · round to cubic
   cubic~partialcommunity7/10

   cubic's docs show explicit support for finding vulnerabilities (codebase scans, Ultrareview for 'security-sensitive changes'), contextual explanations (chat sidebar, 'tour this PR', reply-to-comment clarification), and automatic fixes ('Fix with cubic' pushes a fix commit; CLI generates fix prompts for coding agents). However there is no vendor or independent evidence specifically validating fix quality/accuracy for security vulnerabilities, and community comments raise general skepticism about comment relevance and false-positive rates for AI review tools of this class. missing for 10: security-specific hands-on validation of fix correctness, independent benchmarking on vulnerability detection/fix accuracy.

   • [claimed-docs] “Codebase scans deploy thousands of AI agents to find bugs and vulnerabilities across your repository.”
   • [claimed-docs] “Ultrareview runs a longer review using cubic's most capable review models, which is useful for risky migrations, security-sensitive changes,…”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models”
   • [claimed-docs] “Ultrareview is cubic's deepest review. It runs a longer, multi-pass analysis using cubic's most capable review models, and typically takes a…”
   • [claimed-docs] “Click **Fix with cubic** on a review comment... cubic generates the fix and pushes it to your PR branch.”
   • [claimed-docs] “cubic can automatically fix issues identified during code review. Request a targeted fix with one click.”
   • [claimed-docs] “Ask chat to "tour this PR" for a step-by-step review of the changes and what to check.”
   • [claimed-docs] “Select code and choose **Add to AI chat** to ask about it with the diff and codebase as context.”
   • [claimed-docs] “Reply to a review comment to ask for clarification”
   • [community] “what I saw using 5-6 tools like this: PR description is never useful, they barely summarize file changes; 90% of comments are wrong or irrel…”
   • [community] “When I read '51% fewer false positives' followed immediately by 'Median comments per pull request cut by half' it makes me wonder how many t…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the pack mentions security vulnerability detection, explanations, or automatic fixes; documentation covers session management, orchestration, skills, and configuration but nothing about security review or vulnerability remediation. Missing for 10: any mention of vulnerability scanning, security explanations, or auto-fix capability.

   ⚑ flag