Skip to content
ProductArena

Agent Skills & Extensions Arena

Agent Skills & Extensions arenaBuyer checklist

Every requirement we judge agent skills & extensions products against, as a ready-to-send RFP checklist — with each item's priority, why it matters, and how the top-ranked products score on it today.

52 requirements · 13 themes · verdicts for 5 products · updated 2026-09-16 · priorities mirror the story weights our scoring uses (methodology)

Procurement report →
Show the markdown export
# Agent Skills & Extensions — buyer checklist (RFP)

Derived from ProductArena's evidence-graded user-story taxonomy for Agent Skills & Extensions: 52 judged requirements. Priorities mirror story weights (3 = must-have, 2 = should-have, 1 = nice-to-have).

## Agent workflows

- [ ] **[must-have]** My coding agent can install a skill by itself — a non-interactive, promptless install path an agent can run headlessly end to end
- [ ] **[should-have]** My agent can author and package a new skill end to end by following the project's own spec, template, or meta-skill

## Agenticness

- [ ] **[must-have]** Plug MCP servers into this product so it can use their tools
- [ ] **[must-have]** Connect an agent via an official MCP server
- [ ] **[must-have]** Drive the product through a documented public API
- [ ] **[must-have]** Delegate tasks to a built-in AI assistant inside the product
- [ ] **[should-have]** Point an agent at llms.txt or agent-oriented docs
- [ ] **[should-have]** Run the product headlessly / in CI for automation
- [ ] **[should-have]** Use an official CLI
- [ ] **[should-have]** Issue scoped/least-privilege API credentials for an agent
- [ ] **[should-have]** Build against official SDKs
- [ ] **[should-have]** Subscribe to events via webhooks
- [ ] **[should-have]** Get AI-generated insights and suggestions from my data inside the product
- [ ] **[should-have]** Set up automations that run autonomously in the background
- [ ] **[should-have]** Operate the product with natural-language commands
- [ ] **[should-have]** Explore an interactive API reference with runnable examples
- [ ] **[should-have]** Download a machine-readable API spec (OpenAPI or equivalent)
- [ ] **[should-have]** Rely on versioned APIs with a documented deprecation policy
- [ ] **[nice-to-have]** Test against a sandbox environment without touching production data

## Automation depth

- [ ] **[must-have]** Define rules that trigger actions automatically on events
- [ ] **[should-have]** Perform bulk operations across many items at once
- [ ] **[should-have]** Schedule recurring jobs or workflows
- [ ] **[nice-to-have]** Version, review, and roll back my automations

## Cross agent portability

- [ ] **[must-have]** Install the same collection into multiple different coding agents — Claude Code, Codex, Cursor, and others — with per-harness instructions
- [ ] **[should-have]** Skills are plain markdown files and folders I can read, copy, and carry to another harness — not a proprietary binary format

## Discovery distribution

- [ ] **[must-have]** Installed skills trigger automatically from task context, with descriptions engineered so the agent activates the right skill at the right moment
- [ ] **[should-have]** Browse or search a catalog of available skills — a registry, leaderboard, or marketplace listing — before installing anything
- [ ] **[should-have]** Distribute a standard skill set to my whole team — via a marketplace, a shared repo, or files committed to the project

## Docs onboarding

- [ ] **[must-have]** A quickstart takes me from nothing to a working installed skill in under five minutes
- [ ] **[should-have]** Every skill documents what it does and when it activates, so I can predict my agent's new behavior before it surprises me

## Install experience

- [ ] **[must-have]** Install a skill collection with one documented command — a package-manager one-liner, CLI, or in-agent marketplace command — and it is active in my next session
- [ ] **[should-have]** Choose install scope — project-local files committed with my repo, or user-global across all projects
- [ ] **[should-have]** Install only the specific skills I want from a collection instead of taking the whole bundle
- [ ] **[nice-to-have]** List what is installed and remove skills cleanly, without orphaned files or lingering instructions

## Openness

- [ ] **[must-have]** Export all of my data in open formats and leave
- [ ] **[must-have]** Self-host the core product
- [ ] **[should-have]** Do everything through the API that I can do in the UI
- [ ] **[should-have]** Read the product's source under an open license

## Privacy posture

- [ ] **[must-have]** Prevent my data from being used to train AI models
- [ ] **[should-have]** Choose where my data is stored (region/residency)
- [ ] **[should-have]** Control data retention and deletion
- [ ] **[should-have]** Opt out of telemetry and usage tracking

## Safety review

- [ ] **[must-have]** Review exactly what instructions and scripts a skill will add — list contents before installing and read every file afterward
- [ ] **[should-have]** The project documents its security posture — what skills can execute, the trust model for third-party skills, and any telemetry or data collection

## Skill authoring

- [ ] **[must-have]** Author a new skill from a documented template — a SKILL.md with name and description frontmatter — without reverse-engineering existing skills
- [ ] **[should-have]** The collection ships a meta-skill or tool that guides my agent through writing, improving, and packaging new skills
- [ ] **[should-have]** Skills follow the open Agent Skills specification so the same skill folder is valid beyond this one vendor's tooling

## Testing quality

- [ ] **[should-have]** The collection is actively maintained — recent releases, triaged issues, and accepted community contributions
- [ ] **[should-have]** The collection maintains tests or evals for its skills so changes are verified against regressions rather than shipped on vibes

## Versioning updates

- [ ] **[must-have]** There is a documented update path — marketplace auto-updates or an explicit update command — so I get fixes without reinstalling from scratch
- [ ] **[nice-to-have]** Control when skill changes reach my team — pinned versions or a lockfile rather than silent behind-the-back updates
- [ ] **[nice-to-have]** Releases ship with notes or a changelog so I can see what changed in the skills before I take an update

---

Source: https://ultrametric.ai/productarena/arena/agent-skills (evidence-graded verdicts for 5 products) · methodology: https://ultrametric.ai/productarena/methodology

Chips show the top 5 ranked products' current verdict on each requirement — ✓ full · ~ partial · ! disputed · — none · n/a not applicable.

Agent workflows — stories about agent workflows in this arenaAgent workflows· 2 items

Stories about agent workflows in this arena

Agenticness — how well agents can access and operate the productAgenticness· 17 items

How well agents can access and operate the product

Automation depth — how much of the product can run unattendedAutomation depth· 4 items

How much of the product can run unattended

Cross agent portability — stories about cross agent portability in this arenaCross agent portability· 2 items

Stories about cross agent portability in this arena

Discovery distribution — stories about discovery distribution in this arenaDiscovery distribution· 3 items

Stories about discovery distribution in this arena

Docs onboarding — stories about docs onboarding in this arenaDocs onboarding· 2 items

Stories about docs onboarding in this arena

Install experience — stories about install experience in this arenaInstall experience· 4 items

Stories about install experience in this arena

Openness — open source, data portability, and self-hosting storiesOpenness· 4 items

Open source, data portability, and self-hosting stories

Privacy posture — data-handling and privacy storiesPrivacy posture· 4 items

Data-handling and privacy stories

Safety review — stories about safety review in this arenaSafety review· 2 items

Stories about safety review in this arena

Skill authoring — stories about skill authoring in this arenaSkill authoring· 3 items

Stories about skill authoring in this arena

Testing quality — stories about testing quality in this arenaTesting quality· 2 items

Stories about testing quality in this arena

Versioning updates — stories about versioning updates in this arenaVersioning updates· 3 items

Stories about versioning updates in this arena

Full evidence behind every verdict lives on the arena page and each product page — chips above deep-link straight to the judged story.