How LangGraph’s scores are calculated

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

• [probe] https://docs.langchain.com/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.langchain.com/llms.txt # Docs by LangChain > Documentation for LangSmith, Fleet, and our open source packages. Each section index below lists”
• [probe] https://docs.langchain.com/oss/python/langgraph/overview.md“PROBE docs-md: HTTP 200 at https://docs.langchain.com/oss/python/langgraph/overview.md > ## Documentation Index > Fetch the complete documentation index at: https://docs.langchain.com/llms.txt > Use this fil”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

• [github] https://github.com/langchain-ai/langgraph“pip install -U langgraph”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/streaming.md“LangGraph graphs expose the stream (sync) and astream (async) methods to yield streamed outputs as iterators.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/persistence.md“Checkpointers persist a thread's graph state as checkpoints. Use them for short-term, thread-scoped memory, including conversation continuity, human-in-the-loop workflows, time travel, and fault tolerance.”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 6 (quality) × 1.0 (full) = 18.0 of 30 max

• [claimed-docs] https://docs.langchain.com/oss/python/langchain/mcp.md“LangChain agents call tools defined on MCP servers through MCPAdapter, which discovers a server's tools and adapts them into LangChain tools.”

Connect an agent via an official MCP serverweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

• [claimed-docs] https://docs.langchain.com/oss/python/langchain/mcp.md“LangChain agents call tools defined on MCP servers through MCPAdapter, which discovers a server's tools and adapts them into LangChain tools.”

Use an official CLIweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [probe] https://docs.langchain.com/langsmith/cli“official CLI documented at https://docs.langchain.com/langsmith/cli”

Drive the product through a documented public APIweight 3

3 (weight) × 7 (quality) × 0.6 (partial) = 12.6 of 30 max

• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”
• [probe] https://docs.langchain.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.langchain.com/openapi.json, https://docs.langchain.com/swagger.json, https://docs.langchain.com/api/openapi.json, https://docs.langchain.com/.well-known/openapi.json)”
• [probe] https://docs.langchain.com/langsmith/cli“official CLI documented at https://docs.langchain.com/langsmith/cli”
• [community] https://news.ycombinator.com/item?id=43468435“I read the article but have yet to understand why someone would want to use a framework that introduces meaningless abstractions that are not properly documented or well maintained -aka, they often introduce breaking changes.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components: State, Nodes, Edges.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/streaming.md“LangGraph graphs expose the stream (sync) and astream (async) methods to yield streamed outputs as iterators.”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

• [github] https://github.com/langchain-ai/langgraph“pip install -U langgraph”
• [github] https://github.com/langchain-ai/langgraph“LangGraph is a low-level orchestration framework for building, managing, and deploying long-running, stateful agents.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“At its core, LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components: State, Nodes, Edges.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [probe] https://docs.langchain.com/langsmith/cli“official CLI documented at https://docs.langchain.com/langsmith/cli”
• [community] https://news.ycombinator.com/item?id=43468435“I read the article but have yet to understand why someone would want to use a framework that introduces meaningless abstractions that are not properly documented or well maintained -aka, they often introduce breaking changes.”

Subscribe to events via webhooksweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [probe] https://docs.langchain.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.langchain.com/openapi.json, https://docs.langchain.com/swagger.json, https://docs.langchain.com/api/openapi.json, https://docs.langchain.com/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [probe] https://docs.langchain.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.langchain.com/openapi.json, https://docs.langchain.com/swagger.json, https://docs.langchain.com/api/openapi.json, https://docs.langchain.com/.well-known/openapi.json)”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 4 (quality) × 0.6 (partial) = 2.4 of 10 max

• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/add-memory.md“In production, use a checkpointer backed by a database: from langgraph.checkpoint.postgres import PostgresSaver”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [community] https://news.ycombinator.com/item?id=43468435“I read the article but have yet to understand why someone would want to use a framework that introduces meaningless abstractions that are not properly documented or well maintained -aka, they often introduce breaking changes.”

Do everything through the API that I can do in the UIweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [probe] https://docs.langchain.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.langchain.com/openapi.json, https://docs.langchain.com/swagger.json, https://docs.langchain.com/api/openapi.json, https://docs.langchain.com/.well-known/openapi.json)”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”

Export all of my data in open formats and leaveweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/add-memory.md“In production, use a checkpointer backed by a database: from langgraph.checkpoint.postgres import PostgresSaver”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/persistence.md“Stores persist application-defined data outside the graph state. Use them for long-term, cross-thread memory, including user preferences, facts, and shared knowledge.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/persistence.md“Checkpointers persist a thread's graph state as checkpoints. Use them for short-term, thread-scoped memory, including conversation continuity, human-in-the-loop workflows, time travel, and fault tolerance.”
• [github] https://github.com/langchain-ai/langgraph“LangGraph is a low-level orchestration framework for building, managing, and deploying long-running, stateful agents.”

Read the product's source under an open licenseweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

• [github] https://github.com/langchain-ai/langgraph“pip install -U langgraph”
• [github] https://github.com/langchain-ai/langgraph“LangGraph is a low-level orchestration framework for building, managing, and deploying long-running, stateful agents.”
• [github] https://github.com/langchain-ai/langgraph“Low-level orchestration framework for building stateful agents.”

Self-host the core productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

• [github] https://github.com/langchain-ai/langgraph“pip install -U langgraph”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI** is a command-line tool for building and running the [Agent Server](/langsmith/agent-server) locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/add-memory.md“In production, use a checkpointer backed by a database: from langgraph.checkpoint.postgres import PostgresSaver”

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max

• [github] https://github.com/langchain-ai/langgraph“Durable execution — Build agents that persist through failures and can run for extended periods, automatically resuming from exactly where they left off.”
• [github] https://github.com/langchain-ai/langgraph“Production-ready deployment — Deploy sophisticated agent systems confidently with scalable infrastructure designed to handle the unique challenges of stateful, long-running workflows.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/add-memory.md“In production, use a checkpointer backed by a database: from langgraph.checkpoint.postgres import PostgresSaver”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/interrupts.md“Checkpointing keeps your place: the checkpointer writes the exact graph state so you can resume later, even when in an error state.”
• [community] https://hn.algolia.com/api/v1/items/41722243“The one thing I wish was better developed is persistence and streaming - they give sample code to stream, but it's essentially a complete implementation of streaming that every client needs to implement.”

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“At its core, LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components: State, Nodes, Edges.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

• [community] https://news.ycombinator.com/item?id=43468435“LangGraph implements a variant of the Pregel/BSP algorithm for orchestrating workflows with cycles (ie. not DAGs) and parallelism without data races. You can design your graph as a state machine if you so desire.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/streaming.md“LangGraph graphs expose the stream (sync) and astream (async) methods to yield streamed outputs as iterators.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/streaming.md“It exposes graph execution through stream modes such as updates, values, messages, custom, checkpoints, tasks, and debug.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“At its core, LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“By composing Nodes and Edges, you can create complex, looping workflows that evolve the state over time.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/graph-api.md“LangGraph models agent workflows as graphs. You define the behavior of your agents using three key components: State, Nodes, Edges.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/interrupts.md“Interrupts allow you to pause graph execution at specific points and wait for external input before continuing.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 5 (quality) × 0.6 (partial) = 3.0 of 10 max

• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/persistence.md“Checkpointers persist a thread's graph state as checkpoints. Use them for short-term, thread-scoped memory, including conversation continuity, human-in-the-loop workflows, time travel, and fault tolerance.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/interrupts.md“Checkpointing keeps your place: the checkpointer writes the exact graph state so you can resume later, even when in an error state.”
• [github] https://github.com/langchain-ai/langgraph“Seamlessly incorporate human oversight by inspecting and modifying agent state at any point during execution.”
• [claimed-docs] https://docs.langchain.com/langsmith/cli.md“LangGraph CLI is a command-line tool for building and running the Agent Server locally. The resulting server exposes all API endpoints for runs, threads, assistants, etc., and includes supporting services such as a managed database for checkpointing and storage.”
• [claimed-docs] https://docs.langchain.com/oss/python/langgraph/workflows-agents.md“Trace and compare these workflow patterns with LangSmith... Follow the tracing quickstart to see how data flows through each step.”