Feature Flags & Experimentation arenaFeature Flags & Experimentation
Feature flag and experimentation platforms for shipping software behind toggles — judged on targeting depth, progressive and guarded rollouts, A/B experimentation and metrics, SDK latency and edge/local evaluation, audit trails and approval workflows, self-host options, pricing truth, and whether an AI agent can manage flags safely (with approvals) through APIs, CLIs, and MCP. Dedicated flag/experiment platforms only: PostHog's flags ship inside its all-in-one product-analytics suite and are judged in Product Analytics.
54 user stories · 270 judged cells · updated 2026-09-05 · Evidence as of 2026-09-11
Leaderboard — every product ranked by evidenceLeaderboard
| 1 | free-tier vs GrowthBook ↗ | 60/100 | 19/100 | 6/100 | 73/100 | 37/100 | ★ 6.5k▲ 791/yrnpm 113.7k/wk | 24/40 verified · 1 disputed | 42/100 integrity | ||
| 2 | free-tier vs Flagsmith ↗ | 62/100 | 28/100 | 11/100 | 59/100 | 23/100 | ★ 8.4k▲ 1.6k/yrnpm 701.9k/wk | 31/43 verified | 70/100 integrity | ||
| 3 | subscription-per-seat vs Flagsmith ↗ | 60/100 | 22/100 | 10/100 | 50/100 | 22/100 | ★ 13.8k▲ 1.2k/yrnpm 567.9k/wk | 18/37 verified | 50/100 integrity | ||
| 4 | free-tier vs Flagsmith ↗ | 66/100 | 22/100 | 10/100 | 6/100 | 38/100 | npm 1.8M/wk | 27/37 verified | 57/100 integrity | ||
| 5 | free-tier vs Flagsmith ↗ | 69/100 | 23/100 | 0/100 | 23/100 | 21/100 | npm 2.3M/wk | 16/32 verified | 47/100 integrity |
Best by user type — persona-weighted winnersBest by user type
Per persona, the product with the highest persona-weighted coverage over just that persona's stories — not the same ranking as the overall PA Score leaderboard above.
Best for platform-engineer
GrowthBook
63/100
Runner-up:
Flagsmith (53/100)
10 platform-engineer stories scored
Story matrix — every product × every judged storyStory matrix
Agenticness — how well agents can access and operate the productAgenticness
Agent access
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Agenticness — how well agents can access and operate the productPoint an agent at llms.txt or agent-oriented docs | ai-native | none 0/10 | fullT 9/10 | fullT 9/10 | partialT 5/10 | fullT 9/10 |
| Agenticness — how well agents can access and operate the productRun the product headlessly / in CI for automation | ai-native | fullT 7/10 | fullT 8/10 | fullT 8/10 | fullT 8/10 | fullT 8/10 |
| Agenticness — how well agents can access and operate the productPlug MCP servers into this product so it can use their tools | ai-native | n/a | n/a⚿ | n/a | n/a | n/a |
| Agenticness — how well agents can access and operate the productConnect an agent via an official MCP server | ai-native | fullT 9/10 | fullT⚿ 9/10 | fullT 9/10 | fullT 9/10 | fullT 8/10 |
| Agenticness — how well agents can access and operate the productUse an official CLI | ai-native | fullT 9/10 | fullT 9/10 | none 0/10 | fullT 8/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productDrive the product through a documented public API | ai-native | fullT 7/10 | fullT 9/10 | fullT 9/10 | fullT 8/10 | fullT 9/10 |
| Agenticness — how well agents can access and operate the productIssue scoped/least-privilege API credentials for an agent | ai-native | partialT 6/10 | partialT⚿ 3/10 | partialT 5/10 | partialT 5/10 | partialT 6/10 |
| Agenticness — how well agents can access and operate the productBuild against official SDKs | ai-native | fullT 8/10 | fullC 7/10 | fullX 9/10 | partialC 6/10 | fullC 8/10 |
| Agenticness — how well agents can access and operate the productSubscribe to events via webhooks | ai-native | fullC 8/10 | none 0/10 | none 0/10 | partialC 5/10 | none 0/10 |
Agentic features
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Agenticness — how well agents can access and operate the productGet AI-generated insights and suggestions from my data inside the product | ai-native | none 0/10 | partialT⚿ 5/10 | partialT 4/10 | none 0/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productSet up automations that run autonomously in the background | ai-native | partialT 5/10 | partialT 6/10 | partialT 4/10 | partialT 7/10 | partialT 5/10 |
| Agenticness — how well agents can access and operate the productDelegate tasks to a built-in AI assistant inside the product | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productOperate the product with natural-language commands | ai-native | fullT 7/10 | partialT⚿ 6/10 | fullT 8/10 | partialT 7/10 | fullT 7/10 |
Api quality
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Agenticness — how well agents can access and operate the productExplore an interactive API reference with runnable examples | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productDownload a machine-readable API spec (OpenAPI or equivalent) | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
| Agenticness — how well agents can access and operate the productTest against a sandbox environment without touching production data | ai-native | fullC 7/10 | none 0/10 | fullT 8/10 | partialT 7/10 | fullT 7/10 |
| Agenticness — how well agents can access and operate the productRely on versioned APIs with a documented deprecation policy | ai-native | none 0/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
Automation depth — how much of the product can run unattendedAutomation depth
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Automation depth — how much of the product can run unattendedPerform bulk operations across many items at once | ai-native | partialT 5/10 | partialT 6/10 | partialT 5/10 | partialT 6/10 | partialC 3/10 |
| Automation depth — how much of the product can run unattendedDefine rules that trigger actions automatically on events | ai-native | fullC 7/10 | partialC 4/10 | partialC 5/10 | partialC 6/10 | partialC 6/10 |
| Automation depth — how much of the product can run unattendedSchedule recurring jobs or workflows | ai-native | none 0/10 | none 0/10 | none 0/10 | partialC 4/10 | none 0/10 |
| Automation depth — how much of the product can run unattendedVersion, review, and roll back my automations | ai-native | partialC 5/10 | partialC 4/10 | partialX 6/10 | fullC 7/10 | partialC 5/10 |
Deployment self host — stories about deployment self host in this arenaDeployment self host
Proxy
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Deployment self host — stories about deployment self host in this arenaRun a relay/edge proxy so flags stay served when the vendor is unreachable and SDK traffic stays inside my network | platform-engineer | fullX 8/10 | none 0/10 | fullX 9/10 | fullC 8/10 | fullC 8/10 |
Self host
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Deployment self host — stories about deployment self host in this arenaSelf-host the full flag platform from an open-source distribution, keeping evaluation data on my infrastructure | platform-engineer | none 0/10 | none 0/10 | fullT 9/10 | fullT 9/10 | fullT 9/10 |
Experimentation — stories about experimentation in this arenaExperimentation
Agent ops
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Experimentation — stories about experimentation in this arenaRead experiment configurations and results programmatically to summarize outcomes and recommend ship/rollback decisions | ai-native | partialT 5/10 | fullT⚿ 8/10 | fullT 8/10 | partialT 5/10 | partialT 5/10 |
Analysis
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Experimentation — stories about experimentation in this arenaTrust a documented statistics engine (Bayesian or frequentist, with variance-reduction options) behind experiment results | product-manager | partialC 6/10 | partialX 6/10 | fullX 9/10 | partialC 6/10 | none 0/10 |
Experiments
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Experimentation — stories about experimentation in this arenaRun A/B and multivariate experiments on flags and see which variation wins on my metrics | product-manager | fullX 8/10 | fullX 9/10 | fullX 8/10 | fullC 7/10 | partialC 5/10 |
Metrics
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Experimentation — stories about experimentation in this arenaDefine experiment metrics from my own data — warehouse tables or ingested events — instead of a black-box metric store | product-manager | none 0/10 | fullC 7/10 | fullX 8/10 | none 0/10 | none 0/10 |
Flag management — stories about flag management in this arenaFlag management
Environments
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Flag management — stories about flag management in this arenaManage separate environments (dev/staging/prod) with independent flag states and scoped SDK keys | developer | fullX 9/10 | none 0/10 | fullT 8/10 | fullT 8/10 | fullT 9/10 |
Flags
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Flag management — stories about flag management in this arenaCreate a feature flag and toggle it live in production within minutes of signing up | developer | fullX 7/10 | fullX 8/10 | fullT 9/10 | fullT 9/10 | fullT 9/10 |
| Flag management — stories about flag management in this arenaServe multivariate flags and dynamic configuration values (strings, numbers, JSON), not just booleans | developer | partialX 6/10 | partialC 6/10 | fullT 7/10 | fullT 9/10 | partialT 6/10 |
Lifecycle
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Flag management — stories about flag management in this arenaFind stale flags and code references so temporary flags actually get removed from the codebase | platform-engineer | partialX 6/10 | none 0/10 | fullC 8/10 | none 0/10 | none 0/10 |
Targeting
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Flag management — stories about flag management in this arenaTarget or exclude specific individual users for a flag (allowlists, beta testers, internal accounts) | developer | fullX 8/10 | fullC 8/10 | fullC 7/10 | fullC 9/10 | partialC 6/10 |
| Flag management — stories about flag management in this arenaTarget flags with attribute-based rules and reusable segments so the right users see the right variation | developer | fullX 9/10 | partialC 5/10 | partialC 6/10 | fullT 9/10 | fullX 7/10 |
Governance audit — stories about governance audit in this arenaGovernance audit
Access
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Governance audit — stories about governance audit in this arenaRestrict who can change which flags with roles, permissions, and scoped API tokens | platform-engineer | fullC 8/10 | partialC 4/10 | partialC 5/10 | fullC 9/10 | fullC 8/10 |
Agent ops
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Governance audit — stories about governance audit in this arenaCreate and toggle flags through documented APIs, CLIs, or MCP — and the platform can force my changes through approval workflows instead of letting me write to production unreviewed | ai-native | fullT 7/10 | partialT⚿ 4/10 | partialT 6/10 | fullT 7/10 | partialT 7/10 |
Approvals
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Governance audit — stories about governance audit in this arenaRequire approvals or change requests before production flag changes go live | platform-engineer | fullC 8/10 | none 0/10 | fullC 8/10 | fullC 9/10 | fullC 8/10 |
Audit
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Governance audit — stories about governance audit in this arenaEvery flag change is recorded in an audit log — who changed what, when, and to which value | platform-engineer | partialX 6/10 | none 0/10 | partialC 5/10 | fullC 9/10 | none 0/10 |
Openness — open source, data portability, and self-hosting storiesOpenness
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Openness — open source, data portability, and self-hosting storiesDo everything through the API that I can do in the UI | ai-native | partialT 5/10 | fullT 8/10 | fullT 7/10 | fullT 9/10 | partialT 7/10 |
| Openness — open source, data portability, and self-hosting storiesExport all of my data in open formats and leave | ai-native | none 0/10 | partialC 4/10 | partialX 5/10 | partialT 6/10 | partialC 5/10 |
| Openness — open source, data portability, and self-hosting storiesRead the product's source under an open license | ai-native | none 0/10 | none 0/10 | partialX 5/10 | fullC 7/10 | partialC 5/10 |
| Openness — open source, data portability, and self-hosting storiesSelf-host the core product | ai-native | none 0/10 | none 0/10 | fullT 10/10 | fullT 10/10 | fullT 9/10 |
Pricing plans — plan structure and value — what each tier costs and what it unlocksPricing plans
Pricing
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Pricing plans — plan structure and value — what each tier costs and what it unlocksSee published pricing and understand what drives cost (seats, MAUs, events, requests) before committing | product-manager | partialX 6/10 | partialC 3/10 | partialC 6/10 | none 0/10 | partialC 3/10 |
Privacy posture — data-handling and privacy storiesPrivacy posture
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Privacy posture — data-handling and privacy storiesChoose where my data is stored (region/residency) | ai-native | none 0/10 | none 0/10 | partialT 6/10 | partialT 6/10 | partialT 5/10 |
| Privacy posture — data-handling and privacy storiesPrevent my data from being used to train AI models | ai-native | n/a | n/a | none 0/10 | n/a | n/a |
| Privacy posture — data-handling and privacy storiesControl data retention and deletion | ai-native | none 0/10 | none 0/10 | partialC 4/10 | partialC 5/10 | none 0/10 |
| Privacy posture — data-handling and privacy storiesOpt out of telemetry and usage tracking | ai-native | none 0/10 | none 0/10 | none 0/10 | n/a | none 0/10 |
Rollouts releases — stories about rollouts releases in this arenaRollouts releases
Rollouts
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Rollouts releases — stories about rollouts releases in this arenaGuard a rollout with metrics so a regression is detected and the release is rolled back automatically | platform-engineer | partialC 6/10 | partialC 5/10 | partialC 4/10 | none 0/10 | fullC 7/10 |
| Rollouts releases — stories about rollouts releases in this arenaRoll a flag out progressively by percentage with consistent bucketing, ramping from 1% to 100% without redeploying | developer | fullX 9/10 | fullC 8/10 | fullT 8/10 | fullT 9/10 | fullC 9/10 |
Scheduling
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Rollouts releases — stories about rollouts releases in this arenaSchedule flag changes and releases to happen at a specific future time | developer | fullC 9/10 | partialC 6/10 | partialC 6/10 | fullC 9/10 | fullC 8/10 |
Sdk delivery — stories about sdk delivery in this arenaSdk delivery
Edge
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Sdk delivery — stories about sdk delivery in this arenaEvaluate flags at the edge (CDN workers or an edge/relay layer) close to users | platform-engineer | fullX 8/10 | none 0/10 | fullC 8/10 | partialX 5/10 | fullC 8/10 |
Evaluation
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Sdk delivery — stories about sdk delivery in this arenaMy server SDKs evaluate flags locally from a cached ruleset — microsecond decisions with no network call per flag check | platform-engineer | partialX 6/10 | partialC 5/10 | fullT 9/10 | disputedD 3/10 | partialC 3/10 |
Sdks
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Sdk delivery — stories about sdk delivery in this arenaUse official SDKs across my whole stack — backend, web, and mobile — with consistent flag behavior | developer | fullX 8/10 | partialC 5/10 | fullX 7/10 | partialX 6/10 | partialC 5/10 |
Standards
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Sdk delivery — stories about sdk delivery in this arenaUse the vendor through OpenFeature providers so my flag code isn't locked to one vendor's SDK API | platform-engineer | fullC 8/10 | none 0/10 | none 0/10 | none 0/10 | none 0/10 |
Streaming
| Story | Persona | |||||
|---|---|---|---|---|---|---|
| Sdk delivery — stories about sdk delivery in this arenaFlag changes propagate to connected SDKs in seconds via streaming or fast polling — a kill switch actually kills | developer | fullX 7/10 | partialC 7/10 | partialX 4/10 | none 0/10 | partialC 4/10 |
Adjacent arenas — categories often shopped togetherAdjacent arenas
Shopping this category often means shopping these too.
Auth & Identity arenaAuth & Identity
5 products · leader: Auth0
Backend as a Service arenaBackend as a Service
4 products · leader: Supabase
Vector Databases & Memory Stores arenaVector Databases & Memory Stores
7 products · leader: Chroma
shares: Pricing plans
MCP Infrastructure & Registries arenaMCP Infrastructure & Registries
6 products · leader: Composio
shares: Deployment self host, Pricing plans