Vibe-Coding App Builders Arena
Vibe-Coding App Builders — procurement report
ProductArena · rankings as of 2026-09-16 · evidence as of 2026-09-16 · 6 products · 52 judged requirements · 312 judged cells
Methodology: Every product is judged against a shared taxonomy of user stories using cited evidence — hands-on probes > repository code > independent community sources > vendor claims — never opinion. Full writeup: https://ultrametric.ai/productarena/methodology
Leaderboard
| # | Product | PA Score | Coverage score | Applicable cells | Confidence |
|---|---|---|---|---|---|
| 1 | Lovable | 27.1 | 43.6 | 49/52 | C |
| 2 | Replit | 26.0 | 30.8 | 50/52 | C |
| 3 | Base44 | 24.7 | 36.8 | 52/52 | B |
| 4 | v0 | 20.8 | 32.8 | 50/52 | B |
| 5 | Floot | 19.5 | 23.1 | 52/52 | C |
| 6 | Bolt.new | 15.8 | 29.0 | 50/52 | B |
PA Score = agent-readiness blend (see methodology). Coverage score = weighted share of judged requirements met. Confidence = how much of the score rests on tested vs claimed evidence (A–D).
Uncertainty note
The current #1/#2 gap in this arena is not close enough to qualify for the multi-judge uncertainty pass (or the pass has not covered it yet) — no extra caveat applies beyond the per-product confidence grades above.
Buyer checklist (RFP)
The arena's 52 judged user stories as requirements, grouped by theme. Priorities mirror the story weights our scoring uses (3 = must-have, 2 = should-have, 1 = nice-to-have). Interactive version with per-requirement verdicts for the top products: /arena/vibe-coding/checklist
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
- ai-native userPlug MCP servers into this product so it can use their toolsmust-have
- ai-native userConnect an agent via an official MCP servermust-have
- ai-native userDrive the product through a documented public APImust-have
- ai-native userDelegate tasks to a built-in AI assistant inside the productmust-have
- ai-native userPoint an agent at llms.txt or agent-oriented docsshould-have
- ai-native userRun the product headlessly / in CI for automationshould-have
- ai-native userUse an official CLIshould-have
- ai-native userIssue scoped/least-privilege API credentials for an agentshould-have
- ai-native userBuild against official SDKsshould-have
- ai-native userSubscribe to events via webhooksshould-have
- ai-native userGet AI-generated insights and suggestions from my data inside the productshould-have
- ai-native userSet up automations that run autonomously in the backgroundshould-have
- ai-native userOperate the product with natural-language commandsshould-have
- ai-native userExplore an interactive API reference with runnable examplesshould-have
- ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)should-have
- ai-native userRely on versioned APIs with a documented deprecation policyshould-have
- ai-native userTest against a sandbox environment without touching production datanice-to-have
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
- ai-native userDefine rules that trigger actions automatically on eventsmust-have
- ai-native userPerform bulk operations across many items at onceshould-have
- ai-native userSchedule recurring jobs or workflowsshould-have
- ai-native userVersion, review, and roll back my automationsnice-to-have
Backend data — stories about backend data in this arenaBackend data
Stories about backend data in this arena
- developerAdd user sign-up and login (email, social providers) scaffolded by the buildermust-have
- developerGet a database provisioned and wired into my app without leaving the buildermust-have
- ai-native userAdd AI features like LLM calls and agents to my generated app without managing provider keys myselfshould-have
- developerHave the platform review my generated app for security issues before it goes liveshould-have
- developerAdd server-side functions and third-party integrations like payments and email from the buildershould-have
Code ownership — stories about code ownership in this arenaCode ownership
Stories about code ownership in this arena
- developerExport the full source code and run or host the app outside the platformmust-have
- developerSync my project to my own GitHub repository and keep changes flowing both waysmust-have
- developerWork on the app locally with my own editor and tooling and push changes back to the platformshould-have
Collaboration teams — stories about collaboration teams in this arenaCollaboration teams
Stories about collaboration teams in this arena
- founderMy team can work on the same project together in a shared workspaceshould-have
Deploy domains — stories about deploy domains in this arenaDeploy domains
Stories about deploy domains in this arena
- founderPublish my app to a live URL in one stepmust-have
- founderConnect a custom domain to my published appshould-have
- developerDeploy the generated app to an external host or my own infrastructurenice-to-have
Iteration editing — stories about iteration editing in this arenaIteration editing
Stories about iteration editing in this arena
- founderRefine my app through follow-up prompts without breaking what already worksmust-have
- ai-native userConnect my own coding agent to the project so it drives the builder alongside or instead of the built-in oneshould-have
- developerOpen and edit the generated source code directly inside the buildershould-have
- founderInteract with a live preview of my app while building, before publishingshould-have
- designerSelect an element and edit its text, style, or layout directly without a prompt round-tripshould-have
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
- ai-native userExport all of my data in open formats and leavemust-have
- ai-native userSelf-host the core productmust-have
- ai-native userDo everything through the API that I can do in the UIshould-have
- ai-native userRead the product's source under an open licenseshould-have
Pricing limits — free-tier ceilings, usage caps, and rate limits before you have to payPricing limits
Free-tier ceilings, usage caps, and rate limits before you have to pay
- founderUnderstand what credits or tokens each action consumes and what my plan includesshould-have
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
- ai-native userPrevent my data from being used to train AI modelsmust-have
- ai-native userChoose where my data is stored (region/residency)should-have
- ai-native userControl data retention and deletionshould-have
- ai-native userOpt out of telemetry and usage trackingshould-have
Prompt to app — stories about prompt to app in this arenaPrompt to app
Stories about prompt to app in this arena
- developerGenerate both frontend UI and backend logic from a single promptmust-have
- founderDescribe an app in natural language and get a working full-stack applicationmust-have
- ai-native userGenerate and manage apps programmatically through a platform APImust-have
- designerImport a Figma file or existing design and have the builder implement itshould-have
Templates ecosystem — stories about templates ecosystem in this arenaTemplates ecosystem
Stories about templates ecosystem in this arena
- founderStart from a template or community project instead of a blank promptshould-have
Appendix: recorded probes
Hands-on probe recordings — transcripts/videos a human can replay, the strongest evidence tier. Watch them at https://ultrametric.ai/productarena/proofs
- Floot
curl -s https://floot.com/llms.txt | head -6terminal · recorded 2026-09-10 · exit 0 - Floot
curl -s -X POST https://mcp.floot.com/mcp -H 'Content-Type: application/json' -d '<jsonrpc initialize>'terminal · recorded 2026-09-10 · exit 0 - Floot
curl -s https://floot.com/.well-known/mcp.json | head -12terminal · recorded 2026-09-10 · exit 0
Cite as: ProductArena by Ultrametric Inc, Vibe-Coding App Builders arena, rankings as of 2026-09-16 — https://ultrametric.ai/productarena/arena/vibe-coding
License: © 2026 Ultrametric Inc. Brief quotation of individual verdicts, scores, or evidence excerpts is permitted with attribution to "ProductArena by Ultrametric Inc (ultrametric.ai/productarena)", as is use of the data to evaluate, contest, or contribute corrections. Bulk copying, redistribution, or use to build competing datasets requires prior written permission (see DATA-LICENSE in the repository).
No liability: rankings, verdicts, and scores are research outputs derived from the cited evidence at a point in time, provided "as is", without warranties. Ultrametric Inc accepts no responsibility for procurement, purchasing, or other decisions made in reliance on them — verify against the cited evidence before acting (https://ultrametric.ai/productarena/terms).