Aider vs Slate

Agent access

1. ai-native userPoint an agent at llms.txt or agent-oriented docs

   weight 2 · round to Slate
   Aider—none0/10

   Probes explicitly show no llms.txt (404) and no machine-readable docs endpoints (404s for .md docs and openapi), and no evidence of agent-oriented docs formats elsewhere in the pack.

   • [probe] “PROBE llms.txt: HTTP 404 at https://aider.chat/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://aider.chat/docs/usage.html.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://aider.chat/openapi.json, https://aider.chat/swagger.json, https://aider.chat/api/openapi.jso…”

   proof ↗⚑ flag

   Slate✓fullprobed8/10

   A probe confirms Slate's docs site serves a valid llms.txt at the root with links to actual docs pages, directly satisfying the ability to point an agent at agent-oriented docs. Missing for 10: no independent/community confirmation that agents successfully consume this llms.txt in practice, and no broader agent-oriented doc format beyond the single file.

   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.randomlabs.ai/llms.txt # Slate ## Docs - [Introduction](https://docs.randomlabs.ai/en/getting-sta…”

   proof ↗⚑ flag

2. ai-native userRun the product headlessly / in CI for automation

   weight 2 · round to Aider
   Aider✓fullcommunity8/10

   Aider's scripting docs explicitly support headless/non-interactive use: `--message` for one-shot instructions that apply edits and exit, plus a Python API (`Coder.create`/`coder.run`) for programmatic/CI integration, alongside config via CLI switches, env vars, or .aider.conf.yml which suits automation pipelines. Community evidence corroborates interest in scriptable use (e.g., chaining PR review agents) though notes it's less commonly used that way. Missing for 10: no first-party CI/CD example (e.g., GitHub Actions workflow) or independent case study of Aider running fully unattended in a pipeline.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [community] “I only use Aider interactively, but I really should consider Aider in the 'scriptable' sense more... I might add another step after each PR …”

   proof ↗⚑ flag

   Slate—none0/10

   The docs describe Slate as an interactive terminal agent (onboarding, slash commands, hotkeys, subagent cards) with a permission-bypass flag (--dangerously-skip-permissions/--yolo), but there is no mention of a headless mode, non-interactive CLI flags, exit-code/scriptable output, or CI integration examples. Missing for 10: documented headless/non-interactive invocation, CI pipeline examples, scriptable output format, and any evidence of automation use outside the interactive TUI.

   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”
   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”

   proof ↗⚑ flag

3. ai-native userPlug MCP servers into this product so it can use their tools

   weight 3 · round drawn
   Aider—none0/10

   No evidence in the pack that Aider supports connecting to MCP servers or using MCP-provided tools; its documented extensibility is via slash commands, scripting API, linters/tests, and web/voice input, not MCP.

   ⚑ flag

   Slate—none0/10

   No evidence in the pack mentions MCP servers or integrating external tool providers into Slate; the docs cover skills, permissions, orchestration, and CLI usage but never MCP support. Missing for 10: any documentation or claim about connecting/plugging in MCP servers, configuring MCP tool sources, or using MCP-provided tools.

   ⚑ flag

4. ai-native userUse an official CLI

   weight 2 · round to Aider
   Aider✓fullprobed9/10

   Aider is itself a CLI tool, installed via pip/curl and driven entirely through command-line invocation, flags, scripting (--message), and config files/env vars, making it a native fit for AI-native, agentic workflows. missing for 10: independent third-party benchmarking of CLI robustness/versioning beyond docs and forum mentions.

   • [claimed-docs] “python -m pip install aider-install aider-install”
   • [claimed-docs] “curl -LsSf https://aider.chat/install.sh | sh”
   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an .aider.conf.yml file... Or by setting…”
   • [probe] “official CLI documented at https://aider.chat/docs/usage.html”

   proof ↗⚑ flag

   Slate✓fullprobed8/10

   Slate is delivered as an official CLI (npm-installed, terminal-based) with rich first-party docs covering install, sessions, hotkeys, shell execution, and configuration — squarely matching the 'official CLI' story for an AI-native user. Missing for 10: independent/hands-on corroboration of the CLI experience itself (community evidence found only relates to unrelated porting-quality claims, not CLI usage).

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Press Tab to queue the current message so it runs after the current turn finishes.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Ctrl+X then N New session”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”

   proof ↗⚑ flag

5. ai-native userDrive the product through a documented public API

   weight 3 · round to Aider
   Aider~partialprobed6/10

   Aider documents a scriptable Python API (Coder.create/coder.run) and a CLI --message mode for programmatic, non-interactive driving, which serves as a public API surface for AI-native automation. However, probes confirm there is no REST/OpenAPI-style API or llms.txt (404s across all candidate endpoints), so 'documented public API' is limited to the Python scripting library and CLI flags rather than a formal service API. Missing for 10: a REST/HTTP or OpenAPI-documented API, and independent/hands-on validation of the scripting API in production use beyond docs.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”
   • [probe] “PROBE llms.txt: HTTP 404 at https://aider.chat/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://aider.chat/docs/usage.html.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://aider.chat/openapi.json, https://aider.chat/swagger.json, https://aider.chat/api/openapi.jso…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is documented as a CLI/terminal agent with configuration, skills, and hotkeys, but there is no evidence of a documented public API for programmatic/agentic access—the OpenAPI probe returned 404 across all candidate paths and no SDK or REST/API docs are mentioned anywhere in the pack.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”
   • [probe] “PROBE llms.txt: HTTP 200 at https://docs.randomlabs.ai/llms.txt # Slate ## Docs - [Introduction](https://docs.randomlabs.ai/en/getting-sta…”

   proof ↗⚑ flag

6. ai-native userBuild against official SDKs

   weight 2 · round to Aider
   Aider~partialclaimed5/10

   Aider ships a documented Python scripting interface (Coder.create/coder.run) and a --message CLI mode that let developers build automation on top of it, which functions as a de facto SDK for AI-native workflows. However, there's no dedicated multi-language SDK, versioned package for third-party integration, or independent corroboration of building products atop it beyond docs. missing for 10: dedicated SDK package/versioning beyond scripting.html snippet, independent developer reports of building against it, multi-language SDK support.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”

   proof ↗⚑ flag

   Slate—none0/10

   The evidence pack covers Slate's CLI, skills, configuration, and orchestration features but contains no mention of an official SDK (Python/TypeScript/etc.) for building applications on top of Slate, and the OpenAPI probe returned 404s across all candidate paths. Missing for 10: any documented SDK package, API reference, or programmatic interface for building against Slate.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”
   • [claimed-docs] “npm i -g @randomlabs/slate”

   proof ↗⚑ flag

Agentic features

1. ai-native userGet AI-generated insights and suggestions from my data inside the product

   weight 2 · round to Aider
   Aider✓fullcommunity7/10

   Aider provides AI-generated code understanding, suggestions, and edits directly from the user's codebase via /ask, /architect, repo-map, and chat-based Q&A, with community reports confirming it effectively surfaces insights about unfamiliar codebases. missing for 10: no dedicated analytics/insights dashboard, no proactive suggestion surfacing beyond chat-driven queries, and independent evidence is limited to a single HN thread rather than broad corroboration.

   • [claimed-docs] “**/ask** Ask questions about the code base without editing any files.”
   • [claimed-docs] “**/map** Print out the current repository map”
   • [claimed-docs] “Aider uses a **concise map of your whole git repository** that includes the most important classes and functions along with their types and …”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “Aider can answer questions I can't search for via LSP, like 'what code would process the following URL' and similar.”

   proof ↗⚑ flag

   Slate~partialcommunity4/10

   Slate is a coding-agent CLI whose evidence shows it can analyze a codebase and produce suggestions (e.g., generating an ARCH.md with improvement ideas), which maps loosely to 'AI-generated insights from data' but only in the narrow sense of source code, not general data analysis. Community evidence also raises skepticism about the real quality of generated output (e.g., criticism of a ported-code example as low quality/unverified). Missing for 10: evidence of insights/suggestions over non-code datasets, dashboards or analytics-style outputs, and independent validation of suggestion quality.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [community] “Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/exampl…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

2. ai-native userSet up automations that run autonomously in the background

   weight 2 · round to Slate
   Aider~partialcommunity4/10

   Aider is fundamentally an interactive/scriptable pair-programming CLI, not a background automation scheduler; it can be invoked via --message or Python API for one-shot scripted runs, and community reports mention an experimental 'navigator-mode' adding autonomy akin to Claude Code, but there is no documented persistent background daemon, scheduler, or trigger-based autonomous execution. missing for 10: no first-party support for scheduled/triggered background jobs, no persistent autonomous loop or daemon mode, no evidence of unattended multi-step task execution without a human invoking a command each time.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [community] “I only use Aider interactively, but I really should consider Aider in the 'scriptable' sense more... I might add another step after each PR …”
   • [community] “Over the last two days, I've built out support for autonomy in Aider (a lot like Claude Code) that hybridizes with the rest of the app, uplo…”
   • [community] “It's... decidedly expensive to run an LLM this way right now (Gemini 2.5 Pro is your best bet) with Aider's navigator/autonomy mode, but cos…”

   proof ↗⚑ flag

   Slate~partialclaimed5/10

   Slate supports background subagents, parallel task orchestration, and built-in workflows like goal/deep-research that run while the user keeps interacting, which shows some autonomous background execution. However, this is task-level parallelism within an active session, not scheduled or trigger-based automations that run independently of user presence. missing for 10: evidence of scheduled/cron-like automations, persistent background jobs surviving session end, or trigger-based (event-driven) autonomous runs without an active user session.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

3. ai-native userDelegate tasks to a built-in AI assistant inside the product

   weight 3 · round to Aider
   Aider✓fullcommunity9/10

   Aider's entire product is built around delegating coding tasks to an LLM assistant via chat commands (/ask, /architect, /run, /test), CLI --message scripting, and a scriptable Python API (coder.run), with community confirming real-world delegation use (codebase Q&A, autonomous 'navigator mode'). Missing for 10: more independent benchmarking of task delegation reliability beyond anecdotal HN comments.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “**/ask** Ask questions about the code base without editing any files.”
   • [claimed-docs] “**/architect** Enter architect/editor mode using 2 different models. If no prompt provided, switches to architect/editor mode.”
   • [claimed-docs] “/ask Ask questions about the code base without editing any files. If no prompt provided, switches to ask mode.”
   • [claimed-docs] “You can configure aider to run your test suite after each time the AI edits your code using the --test-cmd <test-command> and --auto-test sw…”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “I revisited Aider a couple of days ago, after going in circles with AutoGPT - which seemed to either forget or go lazy after a few prompts. …”
   • [community] “Over the last two days, I've built out support for autonomy in Aider (a lot like Claude Code) that hybridizes with the rest of the app, uplo…”

   proof ↗⚑ flag

   Slate✓fullcommunity7/10

   Slate is a CLI-based AI assistant where users delegate whole tasks (e.g., 'review architecture and write ARCH.md') and it spins up parallel subagents, orchestration programs like goal/deep-research, and long multi-hour sessions per first-party docs. Community evidence (comm-1/2/3) raises skepticism about output quality/novelty but does not contradict the core delegation mechanism itself. Missing for 10: independent hands-on validation that delegated multi-agent tasks reliably complete as advertised.

   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

4. ai-native userOperate the product with natural-language commands

   weight 2 · round to Aider
   Aider✓fullcommunity8/10

   Aider is fundamentally natural-language driven: users type plain-English instructions in chat, via --message CLI flag, via voice command, or via #AI comments in watched files, and it executes edits accordingly, with community reports confirming real-world natural-language usage. missing for 10: no independent third-party benchmark of NL command robustness across edge cases, and some community reports note inconsistent quality/laziness in following instructions.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “Use the in-chat `/voice` command to start recording, and press `ENTER` when you’re done speaking. Your voice coding instructions will be tra…”
   • [claimed-docs] “AI! triggers aider to make changes to your code.”
   • [claimed-docs] “Rather than using /add to add a file inside the aider chat, you can simply put an #AI comment in it and save the file.”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “I revisited Aider a couple of days ago, after going in circles with AutoGPT - which seemed to either forget or go lazy after a few prompts. …”
   • [community] “Aider is the only tool I use for coding now with ChatGPT... It still suffers from ChatGPT laziness sometimes, you can see it retrying severa…”

   proof ↗⚑ flag

   Slate✓fullclaimed7/10

   Docs show Slate is driven primarily via natural-language prompts (e.g. the quickstart example 'Please review the architecture of my entire codebase...') alongside slash-commands, shell escapes, and file references, indicating natural-language is the core interaction mode for an AI-native agent CLI. Missing for 10: independent/hands-on confirmation that complex natural-language commands are reliably parsed and executed as intended (community evidence only discusses code-porting quality, not NL command usage itself).

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Api quality

1. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

   weight 2 · round drawn
   Aider—none0/10

   Aider is a CLI coding tool, not an API service, but the story asks about a downloadable machine-readable API spec; probes explicitly confirm no OpenAPI/swagger spec exists at any expected path and no llms.txt is served.

   • [probe] “PROBE llms.txt: HTTP 404 at https://aider.chat/llms.txt”
   • [probe] “PROBE docs-md: HTTP 404 at https://aider.chat/docs/usage.html.md”
   • [probe] “PROBE openapi: all candidate paths 404 (https://aider.chat/openapi.json, https://aider.chat/swagger.json, https://aider.chat/api/openapi.jso…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs site was directly probed for an OpenAPI/swagger spec at standard locations and all returned 404, and no documentation anywhere mentions a machine-readable API spec for AI-native consumption.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”

   proof ↗⚑ flag

1. ai-native userPerform bulk operations across many items at once

   weight 2 · round to Slate
   Aider~partialclaimed5/10

   Aider's scripting API lets an AI-native user drive repeated `coder.run()` calls or `--message` invocations across many files/instructions programmatically, and multiple files can be added to a single chat session for combined edits, but there is no documented native bulk/batch command (e.g., apply-to-all, multi-repo loop) built into the CLI — bulk operation requires the user to write their own looping script. missing for 10: a first-party bulk/batch command or documented pattern for applying one operation across many items automatically, and independent evidence of successful large-scale bulk runs.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”
   • [claimed-docs] “To edit files, you need to “add them to the chat”. Do this by naming them on the aider command line. Or, you can use the in-chat `/add` comm…”
   • [claimed-docs] “If you run aider with `--watch-files`, it will watch all files in your repo and look for any AI coding instructions you add using your favor…”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs describe running many agents in parallel and orchestrating multiple tasks simultaneously (grid of subagent cards, spinning up more agents to parallelize work), which supports bulk-style operations across many items. However, there's no independent corroboration of this working at scale and no detail on failure handling, limits, or item-level bulk operations (e.g., bulk file edits/refactors) beyond task orchestration. Missing for 10: independent/hands-on verification of large-scale parallel task execution, concrete examples of bulk item processing (files/records), and failure/error handling details at scale.

   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

2. ai-native userDefine rules that trigger actions automatically on events

   weight 3 · round to Aider
   Aider~partialcommunity5/10

   Aider offers some built-in event-triggered automation: --watch-files lets AI!/AI? comments in files trigger actions, and --auto-test/--auto-lint automatically run after edits. However, these are fixed, predefined triggers rather than a general user-definable rules/automation engine (e.g., no custom event types, schedules, or webhook triggers). Missing for 10: user-defined custom rule/event definitions, broader trigger types beyond file-watch and post-edit, and independent evidence of reliability for these triggers.

   • [claimed-docs] “If you run aider with `--watch-files`, it will watch all files in your repo and look for any AI coding instructions you add using your favor…”
   • [claimed-docs] “AI! triggers aider to make changes to your code.”
   • [claimed-docs] “AI? triggers aider to answer your question.”
   • [claimed-docs] “Rather than using /add to add a file inside the aider chat, you can simply put an #AI comment in it and save the file.”
   • [claimed-docs] “You can configure aider to run your test suite after each time the AI edits your code using the --test-cmd <test-command> and --auto-test sw…”
   • [community] “Aider has a web mode and a 'watch mode', where you can use your normal editor and if you leave a comment like '# make this darker ai!', Aide…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs describe agent rules for permissions/behavior ordering (docs-15, docs-20) and orchestration of parallel agents (docs-12, docs-13), but there is no evidence of user-defined rules that trigger actions automatically on external events (e.g., file changes, webhooks, schedule, git events). This is a plausible axis for a coding agent (many support hooks/triggers), so absence of evidence yields none rather than na.

   • [claimed-docs] “Slate by default respects agent rules in the following order”
   • [claimed-docs] “Each permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.”

   proof ↗⚑ flag

3. ai-native userSchedule recurring jobs or workflows

   weight 2 · round drawn
   Aider—none0/10

   Aider offers one-shot scripting (--message, Python API) but there is no evidence of any built-in scheduler, cron-like trigger, or recurring workflow orchestration feature; users would need external tooling (e.g., cron) not documented as part of Aider itself.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is a coding-agent CLI with orchestration/parallel-agent features and sessions, but nothing in the evidence describes scheduling recurring jobs or workflows (e.g., cron-like triggers, timed recurring runs). Orchestration docs cover on-demand parallelization, not recurrence.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

4. ai-native userVersion, review, and roll back my automations

   weight 1 · round to Aider
   Aider✓fullcommunity8/10

   Aider auto-commits every AI edit with a descriptive commit message, tags 'aider' as the author, supports /undo, /git for raw git history management, and lets users 'go back in git history to review the changes that aider made' — directly satisfying version/review/rollback for its automations. Community feedback confirms git-based commit behavior is real but criticizes commit message quality, a minor caveat rather than a contradiction of the core capability. Missing for 10: independent hands-on verification of rollback reliability across complex multi-file changes, and richer diff/review tooling beyond git log/git commands.

   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider’s change…”
   • [claimed-docs] “You can always use the `/undo` command to undo AI changes that you don’t like.”
   • [claimed-docs] “`/git` will let you run raw git commands to do more complex management of your git history.”
   • [claimed-docs] “Go back in the git history to review the changes that aider made to your code”
   • [claimed-docs] “If aider authored the changes in a commit, they will have “(aider)” appended to the git author and git committer name metadata.”
   • [community] “It gets commit messages wrong. Commit messages should signal intent, not what the patch does. 'changing an enum' is a horrible commit messag…”

   proof ↗⚑ flag

   Slate—none0/10

   Evidence shows session management (/sessions, /workspace) and built-in 'programs' like goal/deep-research, but nothing about versioning automations, reviewing history of changes, or rolling back to prior states of an automation/workflow. Missing for 10: any documentation of version history, diffing, or rollback mechanisms for automations/workflows.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Background execution

1. ai-native userHave a cloud agent build, test, and demo a feature end-to-end for my review

   weight 2 · round to Slate
   Aider—none0/10

   Aider is a local CLI/library pair-programming tool run against your own repo (add files, /test, /run, scripting via Coder.run) with no evidence of a cloud-hosted agent that autonomously builds, tests, and demos a feature end-to-end for asynchronous review; even community mentions of an experimental 'navigator/autonomy mode' describe local execution, not a cloud agent with a demo/review flow.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “You can run tests with `/test <test-command>`. Aider will run the test command without any arguments. If there are test errors, aider expect…”
   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”
   • [community] “Over the last two days, I've built out support for autonomy in Aider (a lot like Claude Code) that hybridizes with the rest of the app, uplo…”
   • [community] “It's... decidedly expensive to run an LLM this way right now (Gemini 2.5 Pro is your best bet) with Aider's navigator/autonomy mode, but cos…”

   proof ↗⚑ flag

   Slate!disputedcontradicted4/10

   Slate's docs claim orchestration of parallel background subagents and being 'one of the few agents capable of performing integration tests manually,' suggesting it could build and test a feature autonomously, but no docs mention a 'demo' output or cloud-hosted execution environment. Community hands-on critique of an actual Slate-produced port directly contradicts the build/test claim: reviewers found the work excluded tests/examples and provided no verifiable repo, undermining confidence that Slate reliably builds+tests end-to-end for review. Missing for 10: evidence of cloud/remote execution infra, an explicit demo-generation feature, and independent confirmation that test suites are actually run and pass.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [community] “Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/exampl…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

2. developerDelegate longer-running coding tasks to run in the background in an isolated cloud environment

   weight 3 · round drawn
   Aider—none0/10

   Aider is a local CLI/scripting tool that runs synchronously in the developer's own environment (terminal, IDE, or scripted via Coder.create); there is no evidence of a cloud-hosted, isolated execution environment or background/async task delegation. Community notes only mention an experimental 'navigator-mode' autonomy feature, not cloud/background execution.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [community] “Over the last two days, I've built out support for autonomy in Aider (a lot like Claude Code) that hybridizes with the rest of the app, uplo…”
   • [community] “It's... decidedly expensive to run an LLM this way right now (Gemini 2.5 Pro is your best bet) with Aider's navigator/autonomy mode, but cos…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs describe subagents running 'in the background' locally while you keep chatting and orchestration/parallelization of tasks, but there is no mention of an isolated cloud environment, remote execution sandbox, or delegation to a hosted service — everything described appears to run within the local CLI session. This axis is applicable to coding agent tools generally, but no evidence supports a cloud-isolated background execution capability for Slate.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Slate works with you across long, multi-hour sessions.”
   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”

   proof ↗⚑ flag

Parallel agents

1. ai-native userLaunch fleets of autonomous agents that work in parallel on different tasks for hours or days

   weight 2 · round to Slate
   Aider—none0/10

   Aider is designed as a single-session CLI pair-programming tool driven interactively or via one-shot scripting (--message, coder.run); there is no evidence of orchestrating multiple parallel autonomous agents running for hours/days. Community mentions a third-party experimental 'navigator-mode' for autonomy, but this is not fleet/parallel multi-agent orchestration and is explicitly noted as costly/experimental, not a documented fleet-management capability.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [community] “Over the last two days, I've built out support for autonomy in Aider (a lot like Claude Code) that hybridizes with the rest of the app, uplo…”
   • [community] “It's... decidedly expensive to run an LLM this way right now (Gemini 2.5 Pro is your best bet) with Aider's navigator/autonomy mode, but cos…”

   proof ↗⚑ flag

   Slate~partialcommunity7/10

   Docs describe genuine parallel agent orchestration (grid of subagent cards, spinning up more agents while others run in background) and explicitly support multi-hour sessions, matching much of the story. However, evidence only confirms 'multi-hour' not multi-day autonomy, and community commentary raises skepticism about output quality/novelty without directly refuting the parallel-agent mechanics themselves. Missing for 10: confirmation of multi-day unattended runs, independent hands-on validation of fleet-scale parallel task completion.

   • [claimed-docs] “Slate works with you across long, multi-hour sessions.”
   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [community] “Commenter compared the approach to 'Ralph as a service' referencing an existing agentic coding technique (ghuntley.com/ralph), suggesting Sl…”

   proof ↗⚑ flag

2. developerRun several task attempts in parallel and compare results before choosing one

   weight 1 · round to Slate
   Aider—none0/10

   Aider's docs describe a single interactive/scripted session per invocation (add files, /run, /test, scripting API) with no mechanism to launch multiple parallel attempts on a task or compare/select among them; one community comment even suggests a user 'might add' a review-and-compare step manually, implying it's not a built-in feature.

   • [community] “I only use Aider interactively, but I really should consider Aider in the 'scriptable' sense more... I might add another step after each PR …”
   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Slate's orchestration docs show multiple subagents running in parallel as a grid of cards while the user keeps working, directly supporting parallel task execution (docs-12, docs-13). However, there's no explicit documentation of a compare/diff view or a 'choose winning attempt' workflow for reconciling multiple parallel results into one choice. Missing for 10: explicit comparison/selection UI or workflow for multiple attempts of the same task, and independent/hands-on confirmation of this specific use case.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Scheduled automation

1. ai-native userSet up always-on agents that run on schedules or triggers to maintain and fix my software autonomously

   weight 2 · round drawn
   Aider—none0/10

   Aider offers scripting (--message, Python API), file-watch mode triggered by in-file comments, and an experimental 'navigator-mode' for autonomy, but none of this constitutes an always-on agent that runs on schedules or external triggers to autonomously maintain/fix software; it remains an interactive/one-shot CLI tool invoked by a human or script.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “If you run aider with `--watch-files`, it will watch all files in your repo and look for any AI coding instructions you add using your favor…”
   • [claimed-docs] “AI! triggers aider to make changes to your code.”
   • [community] “Over the last two days, I've built out support for autonomy in Aider (a lot like Claude Code) that hybridizes with the rest of the app, uplo…”
   • [community] “It's... decidedly expensive to run an LLM this way right now (Gemini 2.5 Pro is your best bet) with Aider's navigator/autonomy mode, but cos…”

   proof ↗⚑ flag

   Slate—none0/10

   Slate's docs describe parallel subagent orchestration within a live session (background agents you keep talking to, spin up more agents to parallelize tasks) but there is no evidence of scheduling, event/webhook triggers, or persistent always-on agents that run autonomously outside an active session to maintain/fix software over time.

   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “`goal` and `deep-research` are built-in programs. They are user-visible workflows, not something you need to author before using Slate.”

   proof ↗⚑ flag

Debugging

1. developerDebug a live running web application directly from my coding assistant

   weight 1 · round drawn
   Aider—none0/10

   Aider is a terminal/CLI coding assistant focused on editing files, running tests/lint, and running local commands via /run — there is no evidence of runtime debugging capabilities like attaching to a live process, inspecting running application state, browser devtools integration, or stepping through a live web app. The /web command only scrapes static pages, not live-app debugging.

   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”
   • [claimed-docs] “You can run tests with `/test <test-command>`. Aider will run the test command without any arguments. If there are test errors, aider expect…”
   • [claimed-docs] “**/web** Scrape a webpage, convert to markdown and send in a message”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the pack mentions debugging live running applications, attaching to running processes, browser/runtime debugging, or any live-app inspection capability; Slate's docs focus on codebase review, shell commands, orchestration, and skills, none of which address live debugging.

   ⚑ flag

2. developerDebug issues and troubleshoot using natural-language queries

   weight 2 · round to Aider
   Aider✓fullcommunity7/10

   Aider supports /ask mode for querying the codebase without editing, /run and /test to surface errors, /map to inspect repo structure, and community reports confirm it's used to understand and troubleshoot unfamiliar codebases via natural language ('what code would process this URL', faster than grep/google). missing for 10: no dedicated debugging/stack-trace-analysis workflow documented, no independent benchmark of troubleshooting accuracy, and some community reports note subtle errors requiring correction.

   • [claimed-docs] “**/ask** Ask questions about the code base without editing any files.”
   • [claimed-docs] “/ask Ask questions about the code base without editing any files. If no prompt provided, switches to ask mode.”
   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”
   • [claimed-docs] “You can use the /run command in the chat to run your code and optionally share the output with aider.”
   • [claimed-docs] “**/map** Print out the current repository map”
   • [claimed-docs] “/map Print out the current repository map”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “Aider can answer questions I can't search for via LSP, like 'what code would process the following URL' and similar.”

   proof ↗⚑ flag

   Slate~partialclaimed5/10

   Slate's docs show it operates via natural-language prompts, executes shell commands (`!`), references files (`@filename`), and can run integration tests and review codebase architecture in NL form, which implies it could be used for debugging and troubleshooting queries. However there is no explicit example, workflow, or documentation section dedicated to debugging/troubleshooting via natural language, and community evidence is skeptical/unrelated to this specific capability. Missing for 10: explicit debugging-focused examples or docs, independent verification that NL-based debugging works well, dedicated troubleshooting workflow beyond generic agent capabilities.

   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”

   proof ↗⚑ flag

Feature implementation

1. developerTurn a tracked issue into a complete pull request end-to-end

   weight 3 · round drawn
   Aider—none0/10

   Aider's documented workflow covers editing files, committing changes locally with descriptive messages, and running tests/lint — but there is no evidence of reading a tracked issue (e.g., GitHub/GitLab issue) or automatically opening a pull request. It only performs local git commits (aider-docs-4, aider-docs-29) with no PR creation or issue-tracker integration mentioned anywhere in the pack.

   ⚑ flag

   Slate—none0/10

   The evidence pack covers Slate's session management, orchestration, skills, and permissions but contains no mention of issue-tracker integration (e.g., GitHub issues) or automated pull-request creation/submission. Without evidence of ingesting a tracked issue and producing a PR end-to-end, this capability is unshown.

   ⚑ flag

2. developerDescribe a feature or bug in plain language and have the agent implement or fix it across multiple files

   weight 3 · round to Aider
   Aider✓fullcommunity9/10

   Aider's core documented workflow is exactly this: describe a change in natural language, it edits multiple files added to chat (or auto-detects which files to edit), commits changes, and community reports confirm it works well across real codebases including multi-file navigation/modification. Missing for 10: no rigorous independent benchmark of multi-file bug-fix accuracy beyond anecdotal HN reports, and community notes occasional errors/laziness with certain models.

   • [claimed-docs] “To edit files, you need to “add them to the chat”. Do this by naming them on the aider command line. Or, you can use the in-chat `/add` comm…”
   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “You can use aider without adding any files, and it will try to figure out which files need to be edited based on your requests.”
   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider’s change…”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “I revisited Aider a couple of days ago, after going in circles with AutoGPT - which seemed to either forget or go lazy after a few prompts. …”
   • [community] “Big fan of Aider. We are interested in integrating Aider as a tool for Dosu to help it navigate and modify a codebase on issues.”

   proof ↗⚑ flag

   Slate!disputedcontradicted5/10

   Docs imply broad multi-file code work (e.g. the quickstart example asks Slate to review an entire codebase and produce ARCH.md, plus orchestration features for parallelizing tasks across files/agents), suggesting Slate can act on plain-language requests across a codebase. However, independent community scrutiny of a specific real-world claim (a 'ported library' from one sentence) found it was actually a trivial JS->TS rename, excluded tests, lacked a verifiable repo, and drew explicit skepticism about the quality/usefulness of the generated code — concretely contradicting the marketed multi-file code-generation capability. Missing for 10: first-party documentation of a genuine multi-file bug-fix/feature-implementation workflow with verifiable before/after results, and independent hands-on confirmation that resolves the community dispute.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Parallelize working and orchestration of many tasks at once.”
   • [community] “Blog post claimed porting a library with one sentence, but critic noted it was JS->TS (trivial rename) not Python->TS, excluded tests/exampl…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Maintenance automation

1. developerHave the agent write tests, fix lint errors, resolve merge conflicts, and update dependencies for me

   weight 3 · round to Aider
   Aider~partialcommunity6/10

   Aider documents linting (auto-lint after edits), running tests via /test or --test-cmd/--auto-test, and general code editing that could write tests or resolve conflicts via natural language instructions, plus dependency-related edits are plausible through general file editing. However, there is no explicit, dedicated documentation or evidence for automated merge-conflict resolution or automated dependency-version updates as distinct workflows, and community evidence notes reliability issues (subtle errors, retries) that temper confidence in unattended correctness. missing for 10: explicit merge-conflict-resolution feature/docs, explicit dependency-update workflow/docs, independent hands-on evidence confirming these four tasks (tests, lint, merge conflicts, dependency updates) work reliably end-to-end.

   • [claimed-docs] “By default, aider will lint any files which it edits.”
   • [claimed-docs] “You can run tests with `/test <test-command>`. Aider will run the test command without any arguments. If there are test errors, aider expect…”
   • [claimed-docs] “You can configure aider to run your test suite after each time the AI edits your code using the --test-cmd <test-command> and --auto-test sw…”
   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”
   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [community] “I just tried it and it's amazingly cool, but the quality of the output just isn't there for me yet. It makes too much subtle errors to be as…”
   • [community] “Aider is the only tool I use for coding now with ChatGPT... It still suffers from ChatGPT laziness sometimes, you can see it retrying severa…”

   proof ↗⚑ flag

   Slate~partialcommunity3/10

   Slate is documented as a general-purpose coding agent with shell execution, file editing, permissioning, and orchestration of multiple sub-agents (random-labs-docs-9, random-labs-docs-13, random-labs-docs-16), which implies it could perform tasks like running tests or lint/dependency commands, but the evidence never explicitly documents test-writing, lint-fixing, merge-conflict resolution, or dependency updates as capabilities. Community commentary raises quality concerns about generated code but doesn't specifically address these tasks. Missing for 10: explicit documentation or examples of writing/fixing tests, resolving lint errors, resolving merge conflicts, and updating dependencies.

   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Multimodal generation

1. ai-native userGenerate a working app from a sketch, image, or PDF design

   weight 2 · round to Aider
   Aider~partialclaimed3/10

   Aider docs confirm images and web pages can be added to chat for visual context (screenshots, reference docs), which could support sketch-driven coding, but there is no evidence of PDF input support or a dedicated 'generate app from design' workflow like dedicated design-to-code tools. missing for 10: PDF input support, an explicit end-to-end sketch/PDF-to-app workflow, and any hands-on example of this being done successfully.

   • [claimed-docs] “Add images and web pages to the chat to provide visual context, screenshots, reference docs, etc.”
   • [claimed-docs] “Aider works with most popular programming languages: python, javascript, rust, ruby, go, cpp, php, html, css, and dozens more.”

   proof ↗⚑ flag

   Slate—none0/10

   The evidence describes Slate as a terminal-based CLI agent for coding sessions, orchestration, skills, and permissions, but nothing in the docs or community evidence mentions accepting sketches, images, or PDF designs as input to generate an app. missing for 10: any mention of image/sketch/PDF input, multimodal design-to-code capability, or UI mockup ingestion.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “description: "Create distinctive, production-grade frontend interfaces."”

   proof ↗⚑ flag

Codebase mapping

1. developerUnderstand how a codebase fits together to find where to start making changes

   weight 3 · round to Aider
   Aider✓fullcommunity9/10

   Aider builds a repo map (concise summary of key classes/functions/signatures across the whole git repo) and offers `/map` and `/ask` commands to explore and understand a codebase without editing it, which directly supports finding where to start making changes; community testimonials corroborate this working well for unfamiliar codebases and languages. Missing for 10: no independent benchmark or deeper hands-on validation of repo-map accuracy on large/complex codebases.

   • [claimed-docs] “Aider uses a **concise map of your whole git repository** that includes the most important classes and functions along with their types and …”
   • [claimed-docs] “**/map** Print out the current repository map”
   • [claimed-docs] “**/ask** Ask questions about the code base without editing any files.”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “Aider can answer questions I can't search for via LSP, like 'what code would process the following URL' and similar.”
   • [community] “Aider is one of my favorite AI agents, especially because it can work with existing codebases. We've seen a lot of good results from folks w…”

   proof ↗⚑ flag

   Slate~partialclaimed5/10

   The quickstart example explicitly shows Slate producing an ARCH.md architecture review of an entire codebase with improvement suggestions, directly supporting codebase-understanding use cases, and @filename references plus workspace management help navigate a repo. However there's no dedicated codebase-mapping/search feature (e.g., symbol index, dependency graph) documented beyond this one example, and no independent evidence confirming quality of such architecture summaries. missing for 10: dedicated code-navigation/search tooling, independent validation of architecture-summary accuracy, more than a single example of codebase-understanding workflow.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”

   proof ↗⚑ flag

2. developerHave the agent map and explain an entire unfamiliar codebase without manually selecting context files

   weight 3 · round to Aider
   Aider✓fullcommunity8/10

   Aider builds an automatic repo map of the whole git repository without requiring manual file selection, and the /map and /ask commands let developers query and understand the codebase without editing files or adding them manually. Community reports corroborate this: users describe using aider to understand unfamiliar codebases in unfamiliar tech stacks faster than manual grep/search methods. Missing for 10: independent benchmark/quantitative evidence on very large codebases and more detail on repo-map scaling limits.

   • [claimed-docs] “Aider uses a **concise map of your whole git repository** that includes the most important classes and functions along with their types and …”
   • [claimed-docs] “Aider uses a concise map of your whole git repository that includes the most important classes and functions along with their types and call…”
   • [claimed-docs] “**/ask** Ask questions about the code base without editing any files.”
   • [claimed-docs] “/ask Ask questions about the code base without editing any files. If no prompt provided, switches to ask mode.”
   • [claimed-docs] “**/map** Print out the current repository map”
   • [claimed-docs] “/map Print out the current repository map”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “Aider can answer questions I can't search for via LSP, like 'what code would process the following URL' and similar.”

   proof ↗⚑ flag

   Slate~partialcommunity6/10

   Docs show Slate's quickstart example explicitly demonstrates asking it to 'review the architecture of my entire codebase' and generate an ARCH.md without manual file selection, and it has orchestration/subagent features for broad exploration. However there's no independent/hands-on verification that this codebase-mapping actually works well on large unfamiliar repos, and community evidence raises quality skepticism about other generated outputs. missing for 10: independent hands-on validation of full-codebase mapping accuracy, evidence of handling very large/unfamiliar codebases without manual curation, detail on how context is auto-selected under the hood.

   • [claimed-docs] “Please review the architecture of my entire codebase creating an ARCH.md and then give me ways I can improve it.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [community] “"Why trumpet code that is so ready for the garbage that you wouldn't even bother to publish it" - skepticism about the quality/usefulness of…”

   proof ↗⚑ flag

Context management

1. developerHave the agent build and recall memory automatically across sessions

   weight 2 · round drawn
   Aider—none0/10

   Aider's docs describe repo mapping, git-commit history, and chat commands, but there is no evidence of automatic persistent memory that is built and recalled across separate sessions — chat history logs and repo maps are not the same as cross-session memory recall. No first-party or community evidence describes such a feature.

   ⚑ flag

   Slate—none0/10

   Docs describe session switching (/sessions), long multi-hour session support, and diagnostic context attachment, but there is no evidence of automatic cross-session memory building or recall — sessions appear to be manually selected/switched contexts, not an automatic memory system. Missing for higher verdict: any documentation of persistent memory storage, automatic recall of past codebase context, or memory summarization across sessions.

   • [claimed-docs] “Slate works with you across long, multi-hour sessions.”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Slate automatically attaches relevant diagnostic information (OS, version, session context) to your report.”

   proof ↗⚑ flag

2. developerInclude multiple project directories in a single session for broader context

   weight 2 · round to Slate
   Aider~partialcommunity4/10

   Aider's docs show you can add arbitrary files to a chat session via the CLI or `/add` command, which implicitly allows pulling files from outside the current directory, and it builds a repo map for whole-repository context. However, there is no explicit documentation or community evidence describing support for multiple separate project directories/repos in one session (e.g., cross-repo repomap or multi-root workspace). missing for 10: explicit multi-directory/multi-repo session support, evidence of repomap spanning more than one git repo, and confirmation that /add works across unrelated project roots.

   • [claimed-docs] “To edit files, you need to “add them to the chat”. Do this by naming them on the aider command line. Or, you can use the in-chat `/add` comm…”
   • [claimed-docs] “Aider uses a **concise map of your whole git repository** that includes the most important classes and functions along with their types and …”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs mention a `/workspace` manager for reviewing and removing 'workspace directories' (plural), implying support for multiple project directories in one session, but there's no detailed documentation on how directories are added or how context is merged across them, and no independent/hands-on confirmation. Missing for 10: explicit instructions/examples for adding multiple directories, and independent verification that broader multi-directory context actually works in practice.

   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”

   proof ↗⚑ flag

3. developerAdd a project instructions file to set coding standards and conventions the agent follows

   weight 3 · round to Slate
   Aider—none0/10

   The evidence pack documents aider's config file (.aider.conf.yml) for command-line options and repo-map features, but contains no mention of a dedicated project instructions/conventions file (e.g. CONVENTIONS.md or read-only context file) for setting coding standards that the agent follows. Absence of evidence for this applicable capability means it cannot be credited.

   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an .aider.conf.yml file... Or by setting…”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs confirm Slate 'respects agent rules' in a defined precedence order and supports Skills (markdown instruction packages, including Claude Code-compatible `.claude/skills/` paths), which cover project-level conventions/instructions, but there's no explicit example of a single top-level 'instructions file' analogous to AGENTS.md/CLAUDE.md being demonstrated end-to-end. missing for 10: explicit naming/format of the project instructions file, a worked example showing the agent following custom conventions from it, and independent/community confirmation it works as documented.

   • [claimed-docs] “Slate by default respects agent rules in the following order”
   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “`.claude/skills/` | Claude Code compatibility”

   proof ↗⚑ flag

Issue diagnosis

1. developerReproduce issues, narrow down root causes, and verify fixes

   weight 3 · round to Aider
   Aider~partialcommunity7/10

   Aider provides tools that support this story indirectly: `/ask` for exploring the codebase without editing, the repo-map for navigating structure, `/run` and `/test`/`--auto-test` for executing code and test suites to reproduce and verify fixes, and community reports confirm it's effective for understanding unfamiliar codebases faster than manual search. However, there's no dedicated bug-reproduction or root-cause-analysis workflow beyond these general commands, and community feedback notes subtle errors and inconsistent output quality that could undermine verification confidence. Missing for 10: dedicated debugging/tracing tooling, explicit root-cause analysis features, and independent hands-on validation specifically of fix verification.

   • [claimed-docs] “**/ask** Ask questions about the code base without editing any files.”
   • [claimed-docs] “**/map** Print out the current repository map”
   • [claimed-docs] “You can run tests with `/test <test-command>`. Aider will run the test command without any arguments. If there are test errors, aider expect…”
   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”
   • [claimed-docs] “You can configure aider to run your test suite after each time the AI edits your code using the --test-cmd <test-command> and --auto-test sw…”
   • [claimed-docs] “Aider uses a **concise map of your whole git repository** that includes the most important classes and functions along with their types and …”
   • [community] “I've used aider to understand new codebases using technologies I don't know and it did a fantastic job; much faster than grep/find + google.”
   • [community] “Aider can answer questions I can't search for via LSP, like 'what code would process the following URL' and similar.”
   • [community] “I just tried it and it's amazingly cool, but the quality of the output just isn't there for me yet. It makes too much subtle errors to be as…”

   proof ↗⚑ flag

   Slate~partialclaimed4/10

   Slate documents shell execution (`!`), file references, and being 'one of the few agents capable of performing integration tests manually,' which are plausible building blocks for debugging workflows, but there's no explicit documentation of a reproduce→diagnose→verify-fix workflow. Missing for 10: explicit debugging/root-cause-analysis workflow documentation, evidence of test-driven verification loops, and independent hands-on confirmation that Slate helps developers actually reproduce and fix bugs.

   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”

   proof ↗⚑ flag

Marketplace

1. developerEquip the agent with custom skills to perform specialized tasks

   weight 1 · round to Slate
   Aider—none0/10

   No evidence of a skills/plugin system, custom tool definitions, or extension API in Aider's docs; it exposes built-in slash commands (/architect, /web, /run) but no mechanism for developers to add custom specialized skills.

   ⚑ flag

   Slate✓fullclaimed7/10

   Slate has a documented Skills system: markdown instruction packages that give the agent domain-specific knowledge/behavior, with example skill definitions and compatibility with Claude Code's `.claude/skills/` format, letting developers equip the agent with custom specialized capabilities. Missing for 10: independent/hands-on verification that custom skills work as documented, and more detail on skill authoring/discovery beyond the single example.

   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “description: "Create distinctive, production-grade frontend interfaces."”
   • [claimed-docs] “`.claude/skills/` | Claude Code compatibility”

   proof ↗⚑ flag

2. engineering-leadIntegrate third-party partner-built agent apps into my workflows

   weight 1 · round drawn
   Aider—none0/10

   Aider is a CLI/library coding assistant; there is no evidence of an ecosystem for integrating third-party partner-built agent apps (no plugin marketplace, app store, or partner integrations documented) beyond one community mention of someone wanting to embed Aider itself as a tool inside another product (Dosu), which is the reverse relationship. No evidence Aider itself supports plugging in external partner agent apps.

   • [community] “Big fan of Aider. We are interested in integrating Aider as a tool for Dosu to help it navigate and modify a codebase on issues.”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is a coding CLI agent focused on subagents, skills, sessions, and model orchestration; there is no evidence of an ecosystem for integrating third-party partner-built agent apps (e.g., a marketplace, app store, or partner integration framework). Skills compatibility with Claude Code is mentioned but that is file-format compatibility, not partner app integration.

   • [claimed-docs] “Skills are markdown instruction packages that give the agent domain-specific knowledge and behavior.”
   • [claimed-docs] “`.claude/skills/` | Claude Code compatibility”

   proof ↗⚑ flag

Tool integration

1. developerConnect the agent to workflow tools like Jira, Slack, and Google Drive to extend its context

   weight 3 · round drawn
   Aider—none0/10

   Aider's documented features cover file editing, git integration, web scraping, and voice input, but there is no evidence of any integration with workflow tools like Jira, Slack, or Google Drive.

   ⚑ flag

   Slate—none0/10

   No evidence anywhere in the docs pack mentions integrations with Jira, Slack, Google Drive, or any workflow tools/MCP connectors; the docs focus on CLI usage, sessions, skills, and permissions with no mention of external tool connectivity.

   ⚑ flag

2. developerKick off agent tasks directly from GitHub, GitLab, Linear, or Slack

   weight 2 · round drawn
   Aider—none0/10

   No evidence of any GitHub/GitLab/Linear/Slack integration that lets users trigger Aider agent tasks from those platforms; Aider is a CLI/scriptable tool invoked locally or via its own scripting API, with no mention of issue-tracker or chat-platform triggers.

   ⚑ flag

   Slate—none0/10

   No evidence of any integration with GitHub, GitLab, Linear, or Slack for triggering agent tasks; Slate's documentation covers CLI usage, sessions, skills, and configuration but nothing about ecosystem/platform triggers.

   ⚑ flag

Cross device continuity

1. developerStart a task on one device and continue it later from another device or browser

   weight 2 · round drawn
   Aider—none0/10

   Aider is a local CLI/git-based tool with an experimental local browser UI, but there's no evidence of any account, session, or cloud state that would let a user resume a task on a different device/browser—chat history and repo map are local to the machine running aider. Git commits persist code changes but don't constitute a portable 'continue where I left off' session across devices.

   • [claimed-docs] “Use aider’s new experimental browser UI to collaborate with LLMs to edit code in your local git repo.”
   • [claimed-docs] “Use aider's new experimental browser UI to collaborate with LLMs to edit code in your local git repo.”
   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider’s change…”
   • [claimed-docs] “Aider uses a **concise map of your whole git repository** that includes the most important classes and functions along with their types and …”

   proof ↗⚑ flag

   Slate—none0/10

   Docs show session management within Slate (e.g. `/sessions` to switch sessions, `Ctrl+X N` for new session) but only describe local session switching, not any cloud sync or cross-device/browser continuation mechanism. Slate appears to be a terminal-only CLI tool with no mention of a browser interface or account-based sync for resuming tasks elsewhere.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Ctrl+X then N New session”
   • [claimed-docs] “npm i -g @randomlabs/slate”

   proof ↗⚑ flag

Ide integration

1. developerChat with the coding assistant directly inside my IDE for contextual help

   weight 3 · round to Slate
   Aider~partialcommunity5/10

   Aider is fundamentally a terminal/CLI chat tool, but its --watch-files mode lets developers trigger AI edits from within their own IDE/editor by leaving '# ... ai!' comments, which the docs frame as IDE-integrated workflow. There's no evidence of a native embedded chat panel or official IDE extension providing conversational context inside the editor itself. missing for 10: dedicated IDE plugin/panel for direct chat, evidence of contextual chat UI inside an IDE rather than terminal+file-watch workaround.

   • [claimed-docs] “If you run aider with `--watch-files`, it will watch all files in your repo and look for any AI coding instructions you add using your favor…”
   • [claimed-docs] “AI! triggers aider to make changes to your code.”
   • [claimed-docs] “AI? triggers aider to answer your question.”
   • [claimed-docs] “Rather than using /add to add a file inside the aider chat, you can simply put an #AI comment in it and save the file.”
   • [community] “Aider has a web mode and a 'watch mode', where you can use your normal editor and if you leave a comment like '# make this darker ai!', Aide…”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Slate is documented as a terminal-based coding agent with session management, `@filename` references, shell execution, and workspace context — providing contextual chat help that developers can run alongside their editor in a terminal. However, there is no evidence of a native IDE extension/panel (e.g., VS Code/JetBrains plugin) that embeds Slate directly inside the IDE UI itself. missing for 10: dedicated IDE extension/panel integration, evidence of in-editor chat UI beyond terminal, independent corroboration of IDE workflow usage.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”
   • [claimed-docs] “Ctrl+X then N New session”

   proof ↗⚑ flag

Session management

1. developerReview diffs visually and run multiple sessions side by side in a desktop app

   weight 2 · round drawn
   Aider—none0/10

   Aider is a CLI/terminal tool (with an experimental browser UI for chat), not a desktop app with visual diff review or multi-session side-by-side management; evidence shows no such GUI capability. Missing for 10: any desktop application, visual diff viewer, or multi-session UI evidence.

   • [claimed-docs] “Use aider’s new experimental browser UI to collaborate with LLMs to edit code in your local git repo.”
   • [claimed-docs] “Use aider's new experimental browser UI to collaborate with LLMs to edit code in your local git repo.”

   proof ↗⚑ flag

   Slate—none0/10

   Slate is documented as a terminal/CLI tool (npm install, terminal-background onboarding, hotkeys, `/sessions` switching, subagent grid) with no mention of a desktop GUI or visual diff review; session switching is terminal-based, not side-by-side desktop windows. Missing for 10: any evidence of a desktop application, a visual diff viewer, or GUI-based side-by-side session comparison.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “Ctrl+X then N New session”

   proof ↗⚑ flag

2. engineering-leadManage multiple agent-driven coding sessions from one unified workspace

   weight 2 · round to Slate
   Aider—none0/10

   Aider is a single-session CLI/terminal pair-programming tool; the evidence shows no unified workspace/dashboard for managing multiple concurrent agent sessions, no session orchestration, or multi-project management UI. It's designed for one developer driving one chat session at a time in a repo, with no evidence of a workspace for engineering leads to oversee multiple agent sessions.

   ⚑ flag

   Slate✓fullclaimed8/10

   Docs describe first-class multi-session/multi-agent workspace features: `/sessions` to switch sessions, `/workspace` manager, new-session hotkey, and orchestration showing a grid of inline subagent cards while continuing to chat, queue tasks, or spin up more parallel agents — directly matching the engineering-lead's need to manage multiple concurrent agent sessions from one place. Missing for 10: independent/hands-on verification of this workspace at scale and any lead-specific team-management features beyond individual session switching.

   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Use `/workspace` to open the workspace manager, where you can review and remove workspace directories.”
   • [claimed-docs] “Those agents show up as a grid of inline subagent cards, one per agent.”
   • [claimed-docs] “While one or more agents run in the background, you can keep talking with Slate: plan next steps, queue up additional tasks, or spin up more…”
   • [claimed-docs] “Ctrl+X then N New session”

   proof ↗⚑ flag

Terminal workflow

1. developerRun a coding agent locally from my terminal

   weight 3 · round to Aider
   Aider✓fullcommunity9/10

   Aider is a terminal-based coding assistant, installed via pip/curl script and run directly from the command line with rich in-chat commands, file editing, git integration, and local model support, all extensively documented and corroborated by hands-on community reports. Missing for 10: independent benchmarking of terminal UX quality and no first-party video/demo evidence beyond docs and forum posts.

   • [claimed-docs] “python -m pip install aider-install aider-install”
   • [claimed-docs] “curl -LsSf https://aider.chat/install.sh | sh”
   • [claimed-docs] “To edit files, you need to “add them to the chat”. Do this by naming them on the aider command line. Or, you can use the in-chat `/add` comm…”
   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [community] “I revisited Aider a couple of days ago, after going in circles with AutoGPT - which seemed to either forget or go lazy after a few prompts. …”
   • [community] “Big fan of Aider. We are interested in integrating Aider as a tool for Dosu to help it navigate and modify a codebase on issues.”

   proof ↗⚑ flag

   Slate✓fullprobed8/10

   Slate ships as a global npm CLI (`npm i -g @randomlabs/slate`) that runs interactively in the terminal, with documented terminal-native features like hotkeys, shell command execution (`!`), file references (`@filename`), session management (`/sessions`), and configuration via `slate.json` — all consistent with a locally-run terminal coding agent. Missing for 10: independent hands-on confirmation of local terminal usage (community evidence only discusses porting-quality skepticism, not terminal operation itself) and no evidence of offline/non-terminal fallback limitations.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [claimed-docs] “Use `/sessions` to switch between existing sessions”
   • [claimed-docs] “Press Tab to queue the current message so it runs after the current turn finishes.”
   • [claimed-docs] “Execute shell commands directly with `!`”
   • [claimed-docs] “Use `@filename` references”
   • [claimed-docs] “Ctrl+X then N New session”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”

   proof ↗⚑ flag

2. developerRun the agent non-interactively in scripts for workflow automation

   weight 2 · round to Aider
   Aider✓fullcommunity8/10

   Aider has a documented scripting mode with a --message flag to run one instruction non-interactively and exit, plus a Python API (Coder.create/coder.run) for programmatic/scripted invocation, both explicitly designed for automation workflows. missing for 10: independent hands-on evidence of scripted/CI usage at scale, and more detail on exit codes/error handling for pipeline integration.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”
   • [community] “I only use Aider interactively, but I really should consider Aider in the 'scriptable' sense more... I might add another step after each PR …”

   proof ↗⚑ flag

   Slate—none0/10

   The evidence shows Slate is a CLI-based interactive agent (npm install, onboarding, in-session commands like /sessions, !, @filename) but nowhere documents a non-interactive/headless mode, flags for scripted execution, or CI/automation usage; --dangerously-skip-permissions bypasses prompts but is not shown as enabling scripted/non-interactive invocation. Missing for 10: documentation of a non-interactive/print/exec mode, exit-code or piping behavior, or any CI/scripting examples.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”

   proof ↗⚑ flag

1. ai-native userDo everything through the API that I can do in the UI

   weight 2 · round to Aider
   Aider~partialprobed4/10

   Aider exposes a scripting/Python API (`Coder.create`/`coder.run`) and a `--message` CLI mode for programmatic single-instruction execution, but this is far narrower than the interactive chat/browser UI, which offers many features (e.g. /architect, /voice, /web, /map, /test, /run, /model, watch-files) not exposed through the scripting API. No REST/OpenAPI surface exists (confirmed 404s), so API parity with the UI is only partial. missing for 10: programmatic access to slash-commands like /architect, /voice, /web, /map, /test, /run via the scripting API; a documented REST/OpenAPI interface; independent confirmation of API-UI feature parity.

   • [claimed-docs] “Aider takes a `--message` argument, where you can give it a natural language instruction. It will do that one thing, apply the edits to the …”
   • [claimed-docs] “coder = Coder.create(main_model=model, fnames=fnames) # This will execute one instruction on those files and then return coder.run("make a …”
   • [claimed-docs] “aider --message "make a script that prints hello" hello.js”
   • [claimed-docs] “coder.run("make a script that prints hello world")”
   • [claimed-docs] “Use aider’s new experimental browser UI to collaborate with LLMs to edit code in your local git repo.”
   • [claimed-docs] “**/architect** Enter architect/editor mode using 2 different models. If no prompt provided, switches to architect/editor mode.”
   • [claimed-docs] “**/web** Scrape a webpage, convert to markdown and send in a message”
   • [claimed-docs] “Use the in-chat `/voice` command to start recording, and press `ENTER` when you’re done speaking. Your voice coding instructions will be tra…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://aider.chat/openapi.json, https://aider.chat/swagger.json, https://aider.chat/api/openapi.jso…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence of any public API for Slate — the openapi.json/swagger.json probes returned 404s and no docs reference programmatic endpoints; Slate is documented purely as a CLI/terminal agent with slash-commands, hotkeys, and config files, not an API-driven product with UI/API parity.

   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”
   • [probe] “official CLI documented at https://docs.randomlabs.ai/en/getting-started/quickstart”
   • [claimed-docs] “npm i -g @randomlabs/slate”

   proof ↗⚑ flag

2. ai-native userExport all of my data in open formats and leave

   weight 3 · round to Aider
   Aider~partialclaimed5/10

   Aider operates entirely on local files and git repos, committing all AI edits as standard git commits (plain text, open format) rather than locking data in a proprietary store, and config is a plain YAML file — so there's little vendor lock-in by design. However, there is no explicit documentation of a data-export feature, chat/session history format, or any messaging about portability/'leaving' the product. Missing for 10: explicit chat/session export documentation, statement on session data formats, and any first-party 'no lock-in/data portability' claim.

   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider’s change…”
   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider's change…”
   • [claimed-docs] “`/git` will let you run raw git commands to do more complex management of your git history.”
   • [claimed-docs] “/git will let you run raw git commands to do more complex management of your git history.”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an .aider.conf.yml file... Or by setting…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the docs or elsewhere describes any data export functionality, open-format export, or data portability mechanism for Slate. Sessions, workspace history, and configurations appear stored locally but no documented export/leave path is mentioned. Missing for 10: any documentation of export commands, data format specifications, or account/data portability guarantees.

   ⚑ flag

3. ai-native userRead the product's source under an open license

   weight 2 · round drawn
   Aider—none0/10

   The evidence pack contains only usage/feature docs and community discussion of Aider's coding capabilities; none of the citations mention a public source repository, license, or any statement about open licensing. Without evidence of an accessible, openly-licensed source, this axis cannot be credited as delivered.

   ⚑ flag

   Slate—none0/10

   No evidence of an open-source license or public source repository for Slate; the CLI is distributed via npm install with no mention of source availability. missing for 10: open-source license declaration, public source repo link, license file/OSS registry evidence.

   ⚑ flag

4. ai-native userSelf-host the core product

   weight 3 · round to Aider
   Aider✓fullclaimed7/10

   Aider is a local CLI/Python tool installed via pip or a script, runs entirely on the user's machine, and can operate with fully local LLMs (Ollama or any OpenAI-compatible local endpoint), meaning the entire core product can be self-hosted with no vendor cloud dependency. missing for 10: explicit self-hosting/deployment guide (e.g. Docker/server setup), independent confirmation of running fully offline with local models, and discussion of self-hosting a team-shared instance

   • [claimed-docs] “python -m pip install aider-install aider-install”
   • [claimed-docs] “curl -LsSf https://aider.chat/install.sh | sh”
   • [claimed-docs] “Aider can work also with local models, for example using [Ollama]”
   • [claimed-docs] “Aider can work also with local models, for example using Ollama. It can also access local models that provide an Open AI compatible API.”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence anywhere in the docs of Slate being open-source or offering a self-hosted deployment option; it's installed via npm as a CLI that connects to model subscriptions/credits, implying a hosted/service model rather than self-hostable core infrastructure. Missing for 10: any mention of self-hosting instructions, open-source repo, or on-prem deployment option.

   • [claimed-docs] “npm i -g @randomlabs/slate”
   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

Authentication

1. developerAuthenticate with an API key instead of an account login

   weight 2 · round to Aider
   Aider~partialclaimed6/10

   Aider's docs describe configuration via command-line switches, an `.aider.conf.yml` file, and environment variables like `AIDER_xxx`, which is the standard mechanism for supplying LLM provider API keys, and Aider has no account-login system of its own — it authenticates purely through provider API keys. However, the evidence pack never explicitly shows an API-key setup example or names an env var like OPENAI_API_KEY, so the authentication story is implied rather than directly documented. missing for 10: explicit documentation/example of setting an API key (e.g., OPENAI_API_KEY) and confirmation that no account-login alternative exists.

   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an .aider.conf.yml file... Or by setting…”
   • [claimed-docs] “Aider can work also with local models, for example using [Ollama]”
   • [claimed-docs] “Aider can work also with local models, for example using Ollama. It can also access local models that provide an Open AI compatible API.”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence pack mentions API key authentication as an alternative to account login; onboarding docs only describe choosing a model source (ChatGPT/Codex, SuperGrok, or Slate credits subscription), not API-key auth. No mention of an API key mechanism anywhere, and the openapi probe returned 404s, giving no indication of an API-key based auth path.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [probe] “PROBE openapi: all candidate paths 404 (https://docs.randomlabs.ai/openapi.json, https://docs.randomlabs.ai/swagger.json, https://docs.rando…”

   proof ↗⚑ flag

2. engineering-leadAuthenticate through an enterprise identity or cloud platform for compliance and scalability

   weight 2 · round drawn
   Aider—none0/10

   Aider is a local CLI coding tool with no evidence of SSO/SAML, enterprise identity provider integration, or cloud-platform authentication for compliance; only API key based LLM auth is documented, which does not address enterprise identity/compliance needs.

   ⚑ flag

   Slate—none0/10

   No evidence of SSO/SAML/OIDC enterprise identity integration or cloud-platform authentication for compliance; onboarding only mentions choosing a model source (ChatGPT/Codex, SuperGrok, or Slate credits), not enterprise identity federation.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

3. developerSign in with my existing product subscription plan to use the coding agent

   weight 2 · round to Slate
   Aider—none0/10

   Aider is a BYO-API-key CLI tool that connects to LLM providers (or local models); there's no evidence of a subscription-based sign-in (e.g., ChatGPT Plus/Claude Pro login) to use Aider itself. No mention of OAuth/subscription sign-in flow anywhere in docs or community evidence.

   ⚑ flag

   Slate✓fullclaimed8/10

   Docs explicitly state onboarding lets you choose your model source as your existing ChatGPT/Codex subscription or SuperGrok subscription (in addition to Slate credits), directly matching the story of signing in with an existing subscription plan to use the agent. Missing for 10: independent/hands-on confirmation that subscription sign-in actually works end-to-end and any detail on limitations of that mode vs credits.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

4. developerSign in with a personal account to get free-tier access without managing API keys

   weight 1 · round to Slate
   Aider—none0/10

   Aider is a local CLI tool requiring users to supply their own LLM API keys (or local models); there is no evidence of an account sign-in or free-tier hosted access mechanism. No mention of OAuth login, hosted free tier, or account-based access in any evidence.

   ⚑ flag

   Slate~partialclaimed4/10

   Docs show onboarding lets users choose a model source including an existing ChatGPT/Codex or SuperGrok subscription instead of managing API keys, implying account-based auth is supported, but there's no explicit mention of a free tier or of signing in with a personal Slate account for free credits without a paid subscription. Missing for 10: explicit free-tier account sign-in flow, confirmation that 'Slate credits' option requires no payment, and any account-based (not subscription-based) login mechanism.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”

   proof ↗⚑ flag

Model choice

1. developerLet the tool automatically pick the best model for each task

   weight 1 · round to Slate
   Aider—none0/10

   Aider lets users manually switch models via /model or choose two different models for architect/editor mode, but there is no evidence of any automatic selection of 'best model for each task' — the choice is always explicit and user-driven.

   • [claimed-docs] “During your chat you can switch models with the in-chat /model command.”
   • [claimed-docs] “**/architect** Enter architect/editor mode using 2 different models. If no prompt provided, switches to architect/editor mode.”
   • [claimed-docs] “/architect Enter architect/editor mode using 2 different models. If no prompt provided, switches to architect/editor mode.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs explicitly claim Slate 'automatically selects the right model for the job' and also allow developers to set preferred default models per slot via `/models` or `slate.json`, suggesting a hybrid automatic+manual approach relevant to pricing/limits tradeoffs. However, there's no detail on the selection logic, cost-awareness, or independent verification that auto-selection actually optimizes for task/price. Missing for 10: independent hands-on confirmation of auto-selection quality, explanation of selection criteria (cost vs capability), and evidence of pricing-limit awareness in model choice.

   • [claimed-docs] “Slate automatically selects the right model for the job.”
   • [claimed-docs] “Set preferred default models for each slot with the `/models` dialog or `slate.json` under `models`.”

   proof ↗⚑ flag

2. developerChoose which underlying AI model powers my session from multiple providers

   weight 2 · round to Aider
   Aider✓fullcommunity8/10

   Aider explicitly supports switching models via the in-chat /model command and documents compatibility with OpenAI, Anthropic (Claude), Ollama, and other OpenAI-API-compatible local models; community threads confirm developers actively switching between GPT-4, Claude Opus, and Gemini within Aider. Minor friction is noted (e.g., a tokenizer error for a specific Claude alias, cost/latency tradeoffs across providers) but the core multi-provider capability is clearly delivered. Missing for 10: a comprehensive first-party list of all supported providers and independent benchmarking of switching reliability across the full provider set.

   • [claimed-docs] “During your chat you can switch models with the in-chat /model command.”
   • [claimed-docs] “Aider can work also with local models, for example using [Ollama]”
   • [claimed-docs] “Aider can work also with local models, for example using Ollama. It can also access local models that provide an Open AI compatible API.”
   • [community] “Have been having too many problems with the diffs from gpt-4-turbo in aider... if aider supports Opus then will switch.”
   • [community] “From the Aider blog post discussion: Claude 3 Opus and Sonnet are both slower and more expensive than OpenAI's models; you can get almost th…”
   • [community] “does anyone know how to run aider with claude 3 opus? aider --model anthropic/claude-3-opus gives ValueError: No known tokenizer for model: …”
   • [community] “It's... decidedly expensive to run an LLM this way right now (Gemini 2.5 Pro is your best bet) with Aider's navigator/autonomy mode, but cos…”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Docs confirm model source can be chosen at onboarding (ChatGPT/Codex, SuperGrok, or Slate credits) and that default models per 'slot' can be set via `/models` or slate.json, showing multi-provider flexibility. However, this is framed around subscription/credit sources rather than a clear list of many independent model providers, and there's no independent/hands-on verification of switching providers mid-session. missing for 10: independent corroboration of provider switching, a full list of supported model providers, and confirmation this works reliably in practice.

   • [claimed-docs] “Onboarding asks for your terminal background, multiline input preference, and model source: your ChatGPT/Codex subscription, SuperGrok subsc…”
   • [claimed-docs] “Set preferred default models for each slot with the `/models` dialog or `slate.json` under `models`.”

   proof ↗⚑ flag

1. ai-native userPrevent my data from being used to train AI models

   weight 3 · round drawn
   Aider—none0/10

   No evidence in the pack addresses data usage/training opt-outs, privacy policy, or data retention controls for Aider or the LLM providers it connects to; Aider primarily relies on third-party LLM APIs whose training-data policies aren't documented here.

   ⚑ flag

   Slate—none0/10

   No evidence in the pack addresses data-training opt-out, privacy policy, or any control over model training use; the documentation covers CLI usage, orchestration, and skills but nothing about data privacy posture. Missing for 10: any privacy policy statement, opt-out settings, or data usage terms regarding AI training.

   ⚑ flag

2. ai-native userControl data retention and deletion

   weight 2 · round drawn
   Aider—none0/10

   The evidence pack covers usage, git integration, and LLM configuration but contains no mention of data retention, storage, or deletion policies for user code, chat history, or LLM interactions. While Aider is local-first (using git and local models), no docs address how conversation/data sent to LLM providers is retained or how a user can delete it.

   ⚑ flag

   Slate—none0/10

   No evidence pack items mention data retention policies, deletion controls, or privacy settings for user data/sessions; docs cover workspace management and permissions but not data retention/deletion. Missing for 10: any documentation of data retention periods, deletion mechanisms, or export/erase controls.

   ⚑ flag

3. ai-native userOpt out of telemetry and usage tracking

   weight 2 · round drawn
   Aider—none0/10

   No evidence in the pack addresses telemetry, usage tracking, or opt-out settings for Aider; documentation covers usage, git integration, config files, and models but nothing about analytics/telemetry controls. missing for 10: any mention of telemetry collection, privacy policy, or an opt-out flag/env var.

   ⚑ flag

   Slate—none0/10

   No evidence pack item mentions telemetry, usage tracking, analytics, or an opt-out setting anywhere in Slate's docs or community coverage; the closest item (diagnostic attachment on bug reports) doesn't address general telemetry opt-out. Missing for 10: any mention of telemetry collection, a privacy policy, or a documented opt-out flag/setting.

   • [claimed-docs] “Slate automatically attaches relevant diagnostic information (OS, version, session context) to your report.”

   proof ↗⚑ flag

Pr review

1. developerHave the agent stage changes, write commit messages, create branches, and open pull requests

   weight 3 · round to Aider
   Aider~partialcommunity4/10

   Aider auto-commits every AI edit with a descriptive commit message and supports /git for raw git commands and git-history review/undo, covering the 'stage changes + commit messages' part of the story. However, there is no documented feature for creating branches or opening pull requests — these would require manual use of /git or external tools, and one community report even criticizes the quality of auto-generated commit messages. missing for 10: dedicated branch-creation workflow, native PR-opening capability, and evidence of reliable commit-message quality.

   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider’s change…”
   • [claimed-docs] “`/git` will let you run raw git commands to do more complex management of your git history.”
   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider's change…”
   • [claimed-docs] “Go back in the git history to review the changes that aider made to your code”
   • [claimed-docs] “/git will let you run raw git commands to do more complex management of your git history.”
   • [community] “It gets commit messages wrong. Commit messages should signal intent, not what the patch does. 'changing an enum' is a horrible commit messag…”

   proof ↗⚑ flag

   Slate—none0/10

   No evidence in the pack mentions git operations like staging, committing, branching, or opening pull requests; documentation covers sessions, orchestration, skills, permissions, and CLI setup but not any git/PR workflow. Absence of evidence for this applicable capability means the verdict is none.

   ⚑ flag

2. developerInspect diffs and run checks to catch problems before merging

   weight 3 · round to Aider
   Aider✓fullcommunity8/10

   Aider auto-commits every change with a descriptive message, letting developers review diffs via normal git tooling and use /undo or /git to inspect or roll back history; it also supports linting by default, /test and --auto-test for running test suites, and /run for executing code before accepting changes. This directly covers inspecting diffs and running checks pre-merge. Missing for 10: no built-in diff viewer/PR-style review UI (relies on external git tools) and no independent hands-on corroboration of the review workflow specifically (one community comment notes users still bolt on separate review agents).

   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider’s change…”
   • [claimed-docs] “Whenever aider edits a file, it commits those changes with a descriptive commit message. This makes it easy to undo or review aider's change…”
   • [claimed-docs] “Go back in the git history to review the changes that aider made to your code”
   • [claimed-docs] “`/git` will let you run raw git commands to do more complex management of your git history.”
   • [claimed-docs] “/git will let you run raw git commands to do more complex management of your git history.”
   • [claimed-docs] “By default, aider will lint any files which it edits.”
   • [claimed-docs] “You can run tests with `/test <test-command>`. Aider will run the test command without any arguments. If there are test errors, aider expect…”
   • [claimed-docs] “You can configure aider to run your test suite after each time the AI edits your code using the --test-cmd <test-command> and --auto-test sw…”
   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”
   • [community] “I only use Aider interactively, but I really should consider Aider in the 'scriptable' sense more... I might add another step after each PR …”

   proof ↗⚑ flag

   Slate~partialclaimed3/10

   Slate's docs mention it can perform integration tests manually (random-labs-docs-16), implying some check-running capability, but there is no evidence of diff inspection, git diff review, PR-style change summaries, or pre-merge validation workflows. missing for 10: diff/change inspection UI or command, explicit pre-merge check/test running workflow, and any corroborating hands-on evidence of catching problems before merge.

   • [claimed-docs] “Slate is one of the few agents capable of performing integration tests manually.”

   proof ↗⚑ flag

Safe execution

1. engineering-leadControl which external tools and integrations the agent is allowed to access

   weight 2 · round to Slate
   Aider—none0/10

   Aider's docs describe config files, command-line switches, and model selection, but there is no evidence of a permissions/allowlist system for controlling which external tools, plugins, or integrations (e.g., MCP servers, web scraping, code execution) the agent may access. Given Aider does have features like /web, /run, and file editing that could pose access-control concerns, an engineering-lead's ability to gate these is a fair question, but no such control mechanism is documented.

   • [claimed-docs] “Aider has many options which can be set with command line switches. Most options can also be set in an `.aider.conf.yml` file... Or by setti…”
   • [claimed-docs] “**/web** Scrape a webpage, convert to markdown and send in a message”
   • [claimed-docs] “You can use the `/run` command in the chat to run your code and optionally share the output with aider.”

   proof ↗⚑ flag

   Slate~partialclaimed6/10

   Slate's configuration docs describe a permission system where each permission key maps to allow/ask/deny actions or fine-grained pattern objects, which supports controlling what tools/actions the agent can perform, and a `--yolo` flag exists to bypass these prompts entirely. However there's no explicit documentation of controlling specific external integrations (e.g., MCP servers, API connectors) or org/team-level lockdown for an engineering lead specifically. Missing for 10: explicit external-integration/MCP allowlist docs, engineering-lead/team-level enforcement (vs individual config), and independent verification that permission enforcement can't be trivially bypassed.

   • [claimed-docs] “Each permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.”
   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”

   proof ↗⚑ flag

2. engineering-leadHave the agent operate inside a sandbox when interacting with code, tools, and network resources

   weight 2 · round drawn
   Aider—none0/10

   No evidence that Aider provides sandboxed execution for code, tools, or network interactions—docs describe git-based commit/undo safety nets, linting, and test running directly on the host, but nothing about containerization, sandboxing, or isolated execution environments; instead Aider runs commands, edits files, and executes tests directly in the local repo/environment.

   ⚑ flag

   Slate—none0/10

   The evidence shows a permission system (allow/ask/deny actions) and a --yolo flag to bypass prompts, but there is no mention of sandboxed execution, containerization, or network isolation for the agent's code/tool interactions. missing for 10: any documentation of sandbox/container execution, network isolation controls, or filesystem confinement mechanisms.

   • [claimed-docs] “Each permission key maps to an action ("allow", "ask", or "deny"), or a pattern object for fine-grained control.”
   • [claimed-docs] “We support `--dangerously-skip-permissions` (alias: `--yolo`) to bypass permission prompts.”

   proof ↗⚑ flag

Security checks

1. engineering-leadSee license and public-code matching references for AI-suggested code

   weight 1 · round drawn
   Aider—none0/10

   No evidence that Aider provides license compliance checks or public-code/match provenance detection for AI-suggested code; the docs cover editing, git commits, linting, and testing but nothing about license or code-matching references.

   ⚑ flag

   Slate—none0/10

   No evidence anywhere in the pack mentions license compliance checks, public-code/OSS matching, or provenance references for AI-suggested code; the docs cover orchestration, skills, permissions, and CLI usage but nothing about code provenance/license scanning.

   ⚑ flag

2. developerGet contextual explanations and automatic fixes for security vulnerabilities

   weight 2 · round drawn
   Aider—none0/10

   No evidence that Aider detects, explains, or auto-fixes security vulnerabilities; it is a general-purpose AI pair-programming/coding tool with linting/testing/git features, but no dedicated security-scanning or vulnerability-remediation capability is documented.

   ⚑ flag

   Slate—none0/10

   No evidence in the pack mentions security vulnerability detection, explanations, or automatic fixes; documentation covers session management, orchestration, skills, and configuration but nothing about security review or vulnerability remediation. Missing for 10: any mention of vulnerability scanning, security explanations, or auto-fix capability.

   ⚑ flag