Skip to content

How Datalab’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score30/100

Agent-ready 50.0 × 0.30 = 15.00

API quality 12.0 × 0.20 = 2.40

Openness 41.8 × 0.20 = 8.36

Built-in AI 12.0 × 0.15 = 1.80

Automation 18.8 × 0.15 = 2.82

(15.00 + 2.40 + 8.36 + 1.80 + 2.82) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 30.38 ÷ 1.00 = 30.4

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready50.0/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://documentation.datalab.to/llms.txtPROBE llms.txt: HTTP 200 at https://documentation.datalab.to/llms.txt # Datalab Documentation - [Welcome to Datalab](https://documentation.datalab.to/index.md): Datalab provides document in
  • [claimed-docs] https://documentation.datalab.to/platform/webhooks.mdYou can override the default webhook URL for specific API requests by including the `webhook_url` parameter
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/form-filling.mdFill PDF and image forms with structured field data using the Datalab SDK.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/file-management.mdDatalab provides file storage for documents you want to process with pipelines or reuse across multiple API calls.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/api-reference/create-document.mdCreate a DOCX document from markdown with track changes support. Supports <ins>, <del>, and <comment> tags.
  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>
  • [claimed-docs] https://documentation.datalab.to/api-reference/generate-extraction-schemas.mdFor a given file, generate potential extraction schemas.
  • [claimed-docs] https://documentation.datalab.to/api-reference/api-health.mdThis endpoint is used to check the health of the API, given an API key.

Run the product headlessly / in CI for automationweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [probe] https://documentation.datalab.to/docs/welcome/sdk/cliofficial CLI documented at https://documentation.datalab.to/docs/welcome/sdk/cli
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksWebhooks provide real-time notifications when your document processing jobs complete, eliminating the need for continuous polling.
  • [claimed-docs] https://documentation.datalab.to/api-reference/api-health.mdThis endpoint is used to check the health of the API, given an API key.
  • [claimed-docs] https://documentation.datalab.to/api-reference/convert-documentConvert a PDF, image, or document to markdown, HTML, JSON, or chunks.

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)
  • [probe] https://documentation.datalab.to/docs/welcome/sdk/cliofficial CLI documented at https://documentation.datalab.to/docs/welcome/sdk/cli

Connect an agent via an official MCP serverweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [probe] https://documentation.datalab.to/docs/welcome/sdk/cliofficial CLI documented at https://documentation.datalab.to/docs/welcome/sdk/cli

Drive the product through a documented public APIweight 3

3 (weight) × 9 (quality) × 1.0 (full) = 27.0 of 30 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/api-reference/convert-documentConvert a PDF, image, or document to markdown, HTML, JSON, or chunks.
  • [claimed-docs] https://documentation.datalab.to/api-reference/extract-structured-dataExtract structured data from a document using a JSON schema.
  • [claimed-docs] https://documentation.datalab.to/api-reference/segment-documentSegment a document into sections using a schema. Returns page ranges for each identified segment.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksConfigure webhooks to receive real-time notifications when Datalab jobs complete.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [probe] https://documentation.datalab.to/llms.txtPROBE llms.txt: HTTP 200 at https://documentation.datalab.to/llms.txt # Datalab Documentation - [Welcome to Datalab](https://documentation.datalab.to/index.md): Datalab provides document in
  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)
  • [probe] https://documentation.datalab.to/docs/welcome/sdk/cliofficial CLI documented at https://documentation.datalab.to/docs/welcome/sdk/cli

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/file-management.mdDatalab provides file storage for documents you want to process with pipelines or reuse across multiple API calls.
  • [probe] https://documentation.datalab.to/docs/welcome/sdk/cliofficial CLI documented at https://documentation.datalab.to/docs/welcome/sdk/cli
  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)

Subscribe to events via webhooksweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/platform/webhooksWebhooks provide real-time notifications when your document processing jobs complete, eliminating the need for continuous polling.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksYou can override the default webhook URL for specific API requests by including the webhook_url parameter
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksConfigure webhooks to receive real-time notifications when Datalab jobs complete.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooks.mdYou can override the default webhook URL for specific API requests by including the `webhook_url` parameter

Agent-ready = 105.0 ÷ 210 × 100 = 50.0

API quality12.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/api-reference/convert-documentConvert a PDF, image, or document to markdown, HTML, JSON, or chunks.
  • [claimed-docs] https://documentation.datalab.to/api-reference/extract-structured-dataExtract structured data from a document using a JSON schema.
  • [claimed-docs] https://documentation.datalab.to/api-reference/segment-documentSegment a document into sections using a schema. Returns page ranges for each identified segment.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartWant to try before writing code? Upload a document to Forge to see results instantly — no API key required.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartUpload a document to Forge to see results instantly — no API key required.
  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)
  • [probe] https://documentation.datalab.to/llms.txtPROBE llms.txt: HTTP 200 at https://documentation.datalab.to/llms.txt # Datalab Documentation - [Welcome to Datalab](https://documentation.datalab.to/index.md): Datalab provides document in

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 4 (quality) × 0.6 (partial) = 2.4 of 10 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartWant to try before writing code? Upload a document to Forge to see results instantly — no API key required.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartnew accounts include a **free monthly usage allowance** (no credit card required), enough to run a full proof of concept on your own documents
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartUpload a document to Forge to see results instantly — no API key required.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartnew accounts include a **free monthly usage allowance** (no credit card required)
  • [claimed-docs] https://documentation.datalab.to/platform/changelogIn-app playground renamed from “Forge Playground” to **Forge** (`/app/playground`).

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/platform/changelogTrack Changes is now available in the Playground — upload a DOCX, PDF, or image file to preview tracked changes extraction results directly in the UI.
  • [claimed-docs] https://documentation.datalab.to/platform/changelogIn-app playground renamed from “Forge Playground” to **Forge** (`/app/playground`).
  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)

API quality = 8.4 ÷ 70 × 100 = 12.0

Openness41.8/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartWant to try before writing code? Upload a document to Forge to see results instantly — no API key required.
  • [claimed-docs] https://documentation.datalab.to/platform/changelogTrack Changes is now available in the Playground — upload a DOCX, PDF, or image file to preview tracked changes extraction results directly in the UI.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/api-reference/convert-documentConvert a PDF, image, or document to markdown, HTML, JSON, or chunks.
  • [claimed-docs] https://documentation.datalab.to/api-reference/extract-structured-dataExtract structured data from a document using a JSON schema.
  • [claimed-docs] https://documentation.datalab.to/api-reference/segment-documentSegment a document into sections using a schema. Returns page ranges for each identified segment.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/api-reference/create-document.mdCreate a DOCX document from markdown with track changes support. Supports <ins>, <del>, and <comment> tags.
  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>
  • [probe] https://documentation.datalab.to/openapi.jsonPROBE openapi: all candidate paths 404 (https://documentation.datalab.to/openapi.json, https://documentation.datalab.to/swagger.json, https://documentation.datalab.to/api/openapi.json, https://documentation.datalab.to/.well-known/openapi.json)

Export all of my data in open formats and leaveweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartGet started with Datalab to convert PDFs, images, and documents into Markdown, HTML, or JSON in minutes.
  • [claimed-docs] https://documentation.datalab.toParse PDFs, Word docs, and spreadsheets into Markdown, HTML, or JSON
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/quickstartThe SDK provides a simple interface to convert documents to Markdown, HTML, JSON, or chunks.
  • [claimed-docs] https://documentation.datalab.to/api-reference/convert-documentConvert a PDF, image, or document to markdown, HTML, JSON, or chunks.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/file-management.mdDatalab provides file storage for documents you want to process with pipelines or reuse across multiple API calls.
  • [claimed-docs] https://documentation.datalab.to/docs/on-prem/overviewOn-prem overview: "Customers can run our models on infrastructure they control with an Enterprise contract." The paid on-prem options target teams that "Require data privacy/operate in highly-regulated environments", need "Extremely high volume", or "Model training or customization" — while Chandra, Marker, and Surya remain free open source.

Read the product's source under an open licenseweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/on-prem/overviewOn-prem overview: "Customers can run our models on infrastructure they control with an Enterprise contract." The paid on-prem options target teams that "Require data privacy/operate in highly-regulated environments", need "Extremely high volume", or "Model training or customization" — while Chandra, Marker, and Surya remain free open source.

Self-host the core productweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://documentation.datalab.to/docs/on-prem/overviewCustomers can run our models on infrastructure they control with an Enterprise contract.
  • [claimed-docs] https://documentation.datalab.to/docs/on-prem/overviewOn-prem overview: "Customers can run our models on infrastructure they control with an Enterprise contract." The paid on-prem options target teams that "Require data privacy/operate in highly-regulated environments", need "Extremely high volume", or "Model training or customization" — while Chandra, Marker, and Surya remain free open source.
  • [claimed-docs] https://www.datalab.to/pricingPricing page: the Team plan ($400/mo) lists "BAA / DPA" as included, alongside 400 req/min rate limits; Enterprise adds running on your own infrastructure (air-gapped) with SSO.
  • [claimed-docs] https://documentation.datalab.to/docs/on-prem/running-the-containerA Helm chart is available for deploying the container on Kubernetes clusters.
  • [claimed-docs] https://documentation.datalab.to/platform/changelogNew surya-us on-premises container type — a lightweight Chandra-compatible container

Openness = 41.8 ÷ 100 × 100 = 41.8

Built-in AI12.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max

  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>
  • [claimed-docs] https://documentation.datalab.to/api-reference/generate-extraction-schemas.mdFor a given file, generate potential extraction schemas.

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/platform/webhooksWebhooks provide real-time notifications when your document processing jobs complete, eliminating the need for continuous polling.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksYou can override the default webhook URL for specific API requests by including the webhook_url parameter
  • [claimed-docs] https://documentation.datalab.toPipelines — Chain processors into versioned, reusable configurations and deploy to production
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>

Operate the product with natural-language commandsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [probe] https://documentation.datalab.to/docs/welcome/sdk/cliofficial CLI documented at https://documentation.datalab.to/docs/welcome/sdk/cli
  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>

Built-in AI = 10.8 ÷ 90 × 100 = 12.0

Automation18.8/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdkThe Datalab Python SDK provides a simple interface for document conversion, pipelines, structured extraction, form filling, and file management.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/cliUse the Datalab CLI to convert documents from the command line.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksWebhooks provide real-time notifications when your document processing jobs complete, eliminating the need for continuous polling.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/file-management.mdDatalab provides file storage for documents you want to process with pipelines or reuse across multiple API calls.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/api-reference/convert-documentConvert a PDF, image, or document to markdown, HTML, JSON, or chunks.

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max

  • [claimed-docs] https://documentation.datalab.to/platform/webhooksWebhooks provide real-time notifications when your document processing jobs complete, eliminating the need for continuous polling.
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksYou can override the default webhook URL for specific API requests by including the webhook_url parameter
  • [claimed-docs] https://documentation.datalab.to/platform/webhooksConfigure webhooks to receive real-time notifications when Datalab jobs complete.
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.toChain processors into versioned, reusable configurations and deploy to production

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

1 (weight) × 3 (quality) × 0.6 (partial) = 1.8 of 10 max

  • [claimed-docs] https://documentation.datalab.toPipelines — Chain processors into versioned, reusable configurations and deploy to production
  • [claimed-docs] https://documentation.datalab.toChain processors into versioned, reusable configurations and deploy to production
  • [claimed-docs] https://documentation.datalab.to/docs/welcome/sdk/pipelines.mdPipelines chain processors (convert, extract, segment, custom) into reusable, versioned configurations.
  • [claimed-docs] https://documentation.datalab.to/api-reference/run-document-agent.mdRun a published agent processor on a document. Address it with processor=<id>, optionally pinned to a version as <id>@<version>

Automation = 15.0 ÷ 80 × 100 = 18.8