How CrewAI’s scores are calculated

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

• [probe] https://docs.crewai.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.crewai.com/llms.txt # CrewAI - [Edge (199 pages)](https://docs.crewai.com/_llms/en/edge.md): Documentation for Edge. - [v1.15.21 (199 pages”
• [probe] https://docs.crewai.com/en/installation.md“PROBE docs-md: HTTP 200 at https://docs.crewai.com/en/installation.md > ## Documentation Index > Fetch the complete documentation index at: https://docs.crewai.com/llms.txt > Use this file t”
• [claimed-docs] https://docs.crewai.com/en/installation“Copy a ready-to-paste setup prompt for Claude Code, Codex, Cursor, or any coding agent. It installs the official CrewAI skills, checks the CLI, and points the agent at the right docs before it edits code.”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“The CrewAI CLI provides a set of commands to interact with CrewAI, allowing you to create, train, run, and manage crews & flows”
• [claimed-docs] https://docs.crewai.com/en/concepts/testing.md“We added the CLI command crewai test to make it easy to test your crew. This command will run your crew for a specified number of iterations and provide detailed performance metrics”
• [claimed-docs] https://docs.crewai.com/en/concepts/testing.md“We added the CLI command `crewai test` to make it easy to test your crew.”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”
• [probe] https://docs.crewai.com/en/concepts/cli“official CLI documented at https://docs.crewai.com/en/concepts/cli”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the mcps field directly on agents for seamless MCP tool integration. The DSL supports both string references... and structured configurations”
• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the `mcps` field directly on agents for seamless MCP tool integration.”
• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the `mcps` field directly on agents for seamless MCP tool integration. The DSL supports both **string references** (for quick setup) and **structured configurations**”
• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the `mcps` field directly on agents for seamless MCP tool integration. The DSL supports both **string references** (for quick setup) and **structured configurations** (for full control).”

Connect an agent via an official MCP serverweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the mcps field directly on agents for seamless MCP tool integration. The DSL supports both string references... and structured configurations”
• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the `mcps` field directly on agents for seamless MCP tool integration.”
• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the `mcps` field directly on agents for seamless MCP tool integration. The DSL supports both **string references** (for quick setup) and **structured configurations**”
• [claimed-docs] https://docs.crewai.com/en/mcp/overview.md“Use the `mcps` field directly on agents for seamless MCP tool integration. The DSL supports both **string references** (for quick setup) and **structured configurations** (for full control).”

Use an official CLIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“The CrewAI CLI provides a set of commands to interact with CrewAI, allowing you to create, train, run, and manage crews & flows”
• [claimed-docs] https://docs.crewai.com/en/concepts/testing.md“We added the CLI command crewai test to make it easy to test your crew. This command will run your crew for a specified number of iterations and provide detailed performance metrics”
• [claimed-docs] https://docs.crewai.com/en/installation“Run the following command to install crewai CLI: uv tool install crewai”
• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“Create a new crew, flow, tool, skill, or template project.”
• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“These older commands still work but print a yellow deprecation warning.”
• [probe] https://docs.crewai.com/en/concepts/cli“official CLI documented at https://docs.crewai.com/en/concepts/cli”

Drive the product through a documented public APIweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Deploy your crews to a managed infrastructure with a few clicks... Access your deployed crews via REST API for integration with existing systems”
• [probe] https://docs.crewai.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.crewai.com/openapi.json, https://docs.crewai.com/swagger.json, https://docs.crewai.com/api/openapi.json, https://docs.crewai.com/.well-known/openapi.json)”
• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“The CrewAI CLI provides a set of commands to interact with CrewAI, allowing you to create, train, run, and manage crews & flows”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [community] https://news.ycombinator.com/item?id=43354219“On a CrewAI-based personal email agent: 'Local personal agents are going to be a major app type... They run locally on my computer with my full credentials and has access to everything. Once I'm past my trust issues, I'd use these a lot.'”
• [claimed-docs] https://docs.crewai.com/en/concepts/tools.md“CrewAI tools empower agents with capabilities ranging from web searching and data analysis to collaboration and delegating tasks among coworkers”
• [claimed-docs] https://docs.crewai.com/en/concepts/tools.md“A tool in CrewAI is a skill or function that agents can utilize to perform various actions. This includes tools from the [CrewAI Toolkit] and [LangChain Tools]”

Build against official SDKsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/llms.md“CrewAI integrates with multiple LLM providers through providers native sdks, giving you the flexibility to choose the right model for your specific use case”
• [claimed-docs] https://docs.crewai.com/en/concepts/llms.md“CrewAI integrates with multiple LLM providers through providers native sdks, giving you the flexibility to choose the right model for your specific use case.”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”
• [claimed-docs] https://docs.crewai.com/_llms/en/v1-15-21.md“Build collaborative AI agents, crews, and flows — production ready from day one.”
• [probe] https://docs.crewai.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.crewai.com/openapi.json, https://docs.crewai.com/swagger.json, https://docs.crewai.com/api/openapi.json, https://docs.crewai.com/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Webhook Streaming Stream real-time events and updates to your systems”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Stream real-time events and updates to your systems”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Deploy your crews to a managed infrastructure with a few clicks... Access your deployed crews via REST API for integration with existing systems”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”
• [probe] https://docs.crewai.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.crewai.com/openapi.json, https://docs.crewai.com/swagger.json, https://docs.crewai.com/api/openapi.json, https://docs.crewai.com/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://docs.crewai.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.crewai.com/openapi.json, https://docs.crewai.com/swagger.json, https://docs.crewai.com/api/openapi.json, https://docs.crewai.com/.well-known/openapi.json)”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“These older commands still work but print a yellow deprecation warning.”
• [probe] https://docs.crewai.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.crewai.com/llms.txt # CrewAI - [Edge (199 pages)](https://docs.crewai.com/_llms/en/edge.md): Documentation for Edge. - [v1.15.21 (199 pages”
• [probe] https://docs.crewai.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.crewai.com/openapi.json, https://docs.crewai.com/swagger.json, https://docs.crewai.com/api/openapi.json, https://docs.crewai.com/.well-known/openapi.json)”

Do everything through the API that I can do in the UIweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Deploy your crews to a managed infrastructure with a few clicks... Access your deployed crews via REST API for integration with existing systems”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Crew Studio Create and customize crews using a no-code/low-code interface”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Tool Repository Publish and install tools to enhance your crews’ capabilities”
• [probe] https://docs.crewai.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.crewai.com/openapi.json, https://docs.crewai.com/swagger.json, https://docs.crewai.com/api/openapi.json, https://docs.crewai.com/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Read the product's source under an open licenseweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“CrewAI AMP extends the power of the open-source framework with features designed for production deployments, collaboration, and scalability. Deploy your crews to a managed infrastructure and monitor their execution in real-time.”
• [github] https://github.com/crewAIInc/crewAI“It gives developers autonomous agent collaboration through Crews and precise, event-driven control through Flows.”
• [github] https://github.com/crewAIInc/crewAI“Tracing & Observability: Monitor and track your AI agents and workflows in real-time, including metrics, logs, and traces.”

Self-host the core productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“CrewAI AMP extends the power of the open-source framework with features designed for production deployments, collaboration, and scalability. Deploy your crews to a managed infrastructure and monitor their execution in real-time.”
• [claimed-docs] https://docs.crewai.com/en/installation“Run the following command to install crewai CLI: uv tool install crewai”
• [claimed-docs] https://docs.crewai.com/en/installation“Run the following command to install `crewai` CLI: uv tool install crewai ”
• [github] https://github.com/crewAIInc/crewAI“It gives developers autonomous agent collaboration through Crews and precise, event-driven control through Flows.”
• [claimed-docs] https://docs.crewai.com/_llms/en/v1-15-21.md“Build collaborative AI agents, crews, and flows — production ready from day one.”

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/tools.md“CrewAI tools empower agents with capabilities ranging from web searching and data analysis to collaboration and delegating tasks among coworkers”
• [claimed-docs] https://docs.crewai.com/en/concepts/tools.md“CrewAI tools empower agents with capabilities ranging from web searching and data analysis to collaboration and delegating tasks among coworkers.”
• [claimed-docs] https://docs.crewai.com/en/concepts/agents.md“Perform specific tasks * Make decisions based on its role and goal * Use tools to accomplish objectives * Communicate and collaborate with other agents * Maintain memory of interactions * Delegate tasks when allowed”
• [community] https://news.ycombinator.com/item?id=43354219“Show HN: built AI agents with CrewAI to automate an old Gmail account—categorizing emails, drafting replies, Slack alerts for high-priority mail, and auto-deleting low-priority messages. Uses CrewAI's `knowledge_source` param to feed writing style/context to draft-writing agents, and `@after_kickoff` decorator for cleanup tasks.”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Crew Studio Create and customize crews using a no-code/low-code interface”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/agents.md“In the CrewAI framework, an `Agent` is an autonomous unit that can: * Perform specific tasks * Make decisions based on its role and goal * Use tools to accomplish objectives”
• [claimed-docs] https://docs.crewai.com/en/concepts/crews.md“A crew in crewAI represents a collaborative group of agents working together to achieve a set of tasks.”
• [claimed-docs] https://docs.crewai.com/en/concepts/flows.md“Flows allow developers to combine and coordinate coding tasks and Crews efficiently, providing a robust framework for building sophisticated AI automations.”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Deploy your crews to a managed infrastructure with a few clicks... Access your deployed crews via REST API for integration with existing systems”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Webhook Streaming Stream real-time events and updates to your systems”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /resume](https://docs.crewai.com/edge/en/api-reference/resume.md): Resume crew execution with human feedback”
• [claimed-docs] https://docs.crewai.com/_llms/en/edge.md“POST /kickoff](https://docs.crewai.com/edge/en/api-reference/kickoff.md): Start a crew execution - [GET /status/{kickoff_id}](https://docs.crewai.com/edge/en/api-reference/status.md): Get execution status”
• [community] https://news.ycombinator.com/item?id=43354219“Show HN: built AI agents with CrewAI to automate an old Gmail account—categorizing emails, drafting replies, Slack alerts for high-priority mail, and auto-deleting low-priority messages. Uses CrewAI's `knowledge_source` param to feed writing style/context to draft-writing agents, and `@after_kickoff` decorator for cleanup tasks.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“a "Task" is a specific assignment completed by an "Agent". Tasks provide all necessary details for execution, such as a description, the agent responsible, required tools”
• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“a `Task` is a specific assignment completed by an `Agent`. Tasks provide all necessary details for execution, such as a description, the agent responsible, required tools”
• [claimed-docs] https://docs.crewai.com/en/concepts/agents.md“Perform specific tasks * Make decisions based on its role and goal * Use tools to accomplish objectives * Communicate and collaborate with other agents * Maintain memory of interactions * Delegate tasks when allowed”
• [claimed-docs] https://docs.crewai.com/en/concepts/tools.md“CrewAI tools empower agents with capabilities ranging from web searching and data analysis to collaboration and delegating tasks among coworkers”
• [claimed-docs] https://docs.crewai.com/en/concepts/tools.md“CrewAI tools empower agents with capabilities ranging from web searching and data analysis to collaboration and delegating tasks among coworkers.”
• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“process = Process.sequential # or Process.hierarchical”
• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“Sequential: Tasks are executed in the order they are defined * Hierarchical: Tasks are as”
• [claimed-docs] https://docs.crewai.com/en/concepts/crews.md“A crew in crewAI represents a collaborative group of agents working together to achieve a set of tasks.”

Operate the product with natural-language commandsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“The CrewAI CLI provides a set of commands to interact with CrewAI, allowing you to create, train, run, and manage crews & flows”
• [claimed-docs] https://docs.crewai.com/en/concepts/cli.md“Create a new crew, flow, tool, skill, or template project.”
• [claimed-docs] https://docs.crewai.com/en/concepts/agents.md“CrewAI AMP includes a Visual Agent Builder that simplifies agent creation and configuration without writing code. Design your agents visually and test them in real-time.”
• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“The Visual Task Builder enables: Drag-and-drop task creation, Visual task dependencies and flow, Real-time testing and validation”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Crew Studio Create and customize crews using a no-code/low-code interface”

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [community] https://news.ycombinator.com/item?id=43354219“Show HN: built AI agents with CrewAI to automate an old Gmail account—categorizing emails, drafting replies, Slack alerts for high-priority mail, and auto-deleting low-priority messages. Uses CrewAI's `knowledge_source` param to feed writing style/context to draft-writing agents, and `@after_kickoff` decorator for cleanup tasks.”
• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“process = Process.sequential # or Process.hierarchical”
• [claimed-docs] https://docs.crewai.com/en/concepts/tasks.md“Sequential: Tasks are executed in the order they are defined * Hierarchical: Tasks are as”
• [claimed-docs] https://docs.crewai.com/en/concepts/flows.md“Flows allow you to create structured, event-driven workflows. They provide a seamless way to connect multiple tasks, manage state, and control the flow of execution”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

• [claimed-docs] https://docs.crewai.com/en/concepts/flows.md“Flows allow you to create structured, event-driven workflows. They provide a seamless way to connect multiple tasks, manage state, and control the flow of execution”
• [claimed-docs] https://docs.crewai.com/en/concepts/flows.md“Flows allow you to create structured, event-driven workflows. They provide a seamless way to connect multiple tasks, manage state, and control the flow of execution in your AI applications.”
• [claimed-docs] https://docs.crewai.com/en/enterprise/introduction“Webhook Streaming Stream real-time events and updates to your systems”
• [community] https://news.ycombinator.com/item?id=43354219“Show HN: built AI agents with CrewAI to automate an old Gmail account—categorizing emails, drafting replies, Slack alerts for high-priority mail, and auto-deleting low-priority messages. Uses CrewAI's `knowledge_source` param to feed writing style/context to draft-writing agents, and `@after_kickoff` decorator for cleanup tasks.”
• [community] https://news.ycombinator.com/item?id=44561985“Competitor (Portia) founder's take: 'We think Crew AI is great. It's just that a lot of businesses we spoke to want the autonomy/decision making of an LLM but with guardrails you can dial up or down... Our multi-agent runs also have persistent states and deterministic hooks so you can pause an agent... where Crew AI lacks that.'”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 2 (quality) × 0.6 (partial) = 1.2 of 10 max

• [claimed-docs] https://docs.crewai.com/en/concepts/llms.md“The YAML configuration allows you to: * Version control your agent settings * Easily switch between different models”
• [community] https://news.ycombinator.com/item?id=44561985“Competitor (Portia) founder's take: 'We think Crew AI is great. It's just that a lot of businesses we spoke to want the autonomy/decision making of an LLM but with guardrails you can dial up or down... Our multi-agent runs also have persistent states and deterministic hooks so you can pause an agent... where Crew AI lacks that.'”