Skip to content
ProductArena

How Formant’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score23/100

Agent-ready 36.2 × 0.30 = 10.86

API quality 0.0 × 0.20 = 0.00

Openness 16.2 × 0.20 = 3.24

Built-in AI 36.7 × 0.15 = 5.50

Automation 21.0 × 0.15 = 3.15

(10.86 + 0.00 + 3.24 + 5.50 + 3.15) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 22.75 ÷ 1.00 = 22.8

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready36.2/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 9 (quality) × 1.0 (full) = 18.0 of 20 max

  • [probe] https://docs.formant.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.formant.io/llms.txt # Formant Documentation > The Formant software platform allows companies to run fleets of robots or advanced connected”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.formant.io/docs/getting-started-install-agent-docker-ros-2.md“This guide will teach you how to install the Formant agent to your device via Docker.”
  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“In addition to these commands, you can create custom commands via the Formant Admin API.”
  • [claimed-docs] https://docs.formant.io/docs/ingest-from-the-python-cloud-sdk.md“The primary way of ingesting arbitrary data that is not via the Formant agent is with the Cloud SDK, a lightweight Python module which can interact with the Formant ingestion API directly.”
  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.formant.io/reference/agent-sdk-installation-and-overview.md“The Agent SDK client contains a suite of methods which allow you to ingest telemetry data, receive and respond to commands, teleoperate your device, and more.”
  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”
  • [github] https://github.com/FormantIO/toolkit“Create your own application that uses Formant's APIs and RealtimeSDK for data”
  • [claimed-docs] https://docs.formant.io/docs/ingest-from-the-python-cloud-sdk.md“The primary way of ingesting arbitrary data that is not via the Formant agent is with the Cloud SDK, a lightweight Python module which can interact with the Formant ingestion API directly.”

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://docs.formant.io/reference/agent-sdk-installation-and-overview.md“The Agent SDK client contains a suite of methods which allow you to ingest telemetry data, receive and respond to commands, teleoperate your device, and more.”
  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“In addition to these commands, you can create custom commands via the Formant Admin API.”
  • [github] https://github.com/FormantIO/toolkit“Create your own application that uses Formant's APIs and RealtimeSDK for data”
  • [claimed-docs] https://docs.formant.io/docs/ingest-from-the-python-cloud-sdk.md“The primary way of ingesting arbitrary data that is not via the Formant agent is with the Cloud SDK, a lightweight Python module which can interact with the Formant ingestion API directly.”
  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”
  • [probe] https://docs.formant.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.formant.io/openapi.json, https://docs.formant.io/swagger.json, https://docs.formant.io/api/openapi.json, https://docs.formant.io/.well-known/openapi.json)”

Issue scoped/least-privilege API credentials for an agentweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.formant.io/reference/agent-sdk-installation-and-overview.md“The Agent SDK client contains a suite of methods which allow you to ingest telemetry data, receive and respond to commands, teleoperate your device, and more.”
  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”
  • [claimed-docs] https://docs.formant.io/reference/agent-sdk-installation-and-overview.md“a suite of methods which allow you to ingest telemetry data, receive and respond to commands, teleoperate your device, and more”
  • [claimed-docs] https://docs.formant.io/docs/ingest-from-the-python-cloud-sdk.md“The primary way of ingesting arbitrary data that is not via the Formant agent is with the Cloud SDK, a lightweight Python module which can interact with the Formant ingestion API directly.”
  • [github] https://github.com/FormantIO/toolkit“Create your own application that uses Formant's APIs and RealtimeSDK for data”
  • [github] https://github.com/FormantIO/toolkit“Create realtime visualizations of your robots”
  • [probe] https://docs.formant.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.formant.io/openapi.json, https://docs.formant.io/swagger.json, https://docs.formant.io/api/openapi.json, https://docs.formant.io/.well-known/openapi.json)”

Subscribe to events via webhooksweight 2

2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max

  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”

Agent-ready = 76.0 ÷ 210 × 100 = 36.2

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.formant.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.formant.io/openapi.json, https://docs.formant.io/swagger.json, https://docs.formant.io/api/openapi.json, https://docs.formant.io/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.formant.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.formant.io/openapi.json, https://docs.formant.io/swagger.json, https://docs.formant.io/api/openapi.json, https://docs.formant.io/.well-known/openapi.json)”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“In addition to these commands, you can create custom commands via the Formant Admin API.”
  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.formant.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.formant.io/openapi.json, https://docs.formant.io/swagger.json, https://docs.formant.io/api/openapi.json, https://docs.formant.io/.well-known/openapi.json)”

API quality = 0.0 ÷ 70 × 100 = 0.0

Openness16.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://docs.formant.io/reference/agent-sdk-installation-and-overview.md“The Agent SDK client contains a suite of methods which allow you to ingest telemetry data, receive and respond to commands, teleoperate your device, and more.”
  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“In addition to these commands, you can create custom commands via the Formant Admin API.”
  • [github] https://github.com/FormantIO/toolkit“Create your own application that uses Formant's APIs and RealtimeSDK for data”
  • [github] https://github.com/FormantIO/toolkit“Embed your own application in Formant”
  • [claimed-docs] https://docs.formant.io/docs/ingest-from-the-python-cloud-sdk.md“The primary way of ingesting arbitrary data that is not via the Formant agent is with the Cloud SDK, a lightweight Python module which can interact with the Formant ingestion API directly.”
  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”
  • [probe] https://docs.formant.io/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.formant.io/openapi.json, https://docs.formant.io/swagger.json, https://docs.formant.io/api/openapi.json, https://docs.formant.io/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.formant.io/docs/data-export-with-the-python-cloud-sdk.md“The primary programmatic way data scientists query for telemetry data is via the Cloud SDK, a lightweight Python module which can interact with the query API.”
  • [claimed-docs] https://docs.formant.io/docs/ingest-from-the-python-cloud-sdk.md“The primary way of ingesting arbitrary data that is not via the Formant agent is with the Cloud SDK, a lightweight Python module which can interact with the Formant ingestion API directly.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“In addition to these commands, you can create custom commands via the Formant Admin API.”

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [github] https://github.com/FormantIO/toolkit“Create your own application that uses Formant's APIs and RealtimeSDK for data”
  • [github] https://github.com/FormantIO/toolkit“UI custom elements to make your application visually look similar to Formant's ecosystem”
  • [github] https://github.com/FormantIO/toolkit“Embed your own application in Formant”

Self-host the core productweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://docs.formant.io/docs/getting-started-install-agent-docker-ros-2.md“This guide will teach you how to install the Formant agent to your device via Docker.”
  • [claimed-docs] https://docs.formant.io/reference/agent-sdk-installation-and-overview.md“The Agent SDK client contains a suite of methods which allow you to ingest telemetry data, receive and respond to commands, teleoperate your device, and more.”
  • [claimed-docs] https://docs.formant.io“configure devices, design custom views and modules, and build a backend for your custom application.”
  • [probe] https://docs.formant.io/llms.txt“PROBE llms.txt: HTTP 200 at https://docs.formant.io/llms.txt # Formant Documentation > The Formant software platform allows companies to run fleets of robots or advanced connected”

Openness = 16.2 ÷ 100 × 100 = 16.2

Built-in AI36.7/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 1.0 (full) = 12.0 of 20 max

  • [claimed-docs] https://docs.formant.io/docs/analytics.md“Using built-in visualizations, custom SQL queries, or our AI assistant, you can build a rich dashboard for your devices.”
  • [claimed-docs] https://docs.formant.io/docs/analytics.md“Formant Analytics allows you to visualize, aggregate, and analyze data from your device over a time range of your choice. Using built-in visualizations, custom SQL queries, or our AI assistant, you can build a rich dashboard for your devices.”
  • [claimed-docs] https://www.formant.ai/products“Ask your fleet what's happening in plain language and get governed, ML-driven task recommendations — with people approving what happens next.”
  • [claimed-docs] https://www.formant.ai/products“Ask your fleet what’s happening in plain language and get governed, ML-driven task recommendations — with people approving what happens next.”
  • [claimed-docs] https://www.formant.ai/fleet-orchestration“Assigns the right job to the right robot — regardless of who built it — using operational history and live data, and dispatches help the moment something looks wrong.”
  • [claimed-docs] https://www.formant.ai/fleet-orchestration“Tracks historical performance per robot, per mission — speed, error rates, how a given unit has handled a given job before — alongside current location and status. Assigns the best-suited robot, or robots.”

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“Commands tell our robot to take a predefined action. For example, we can use commands to trigger data ingestion, run a script, or tell our robot to return to its home position.”
  • [claimed-docs] https://www.formant.ai/operations“Build better human-to-robot ratios by automating incident response and creating workflows for monitoring devices at scale.”
  • [claimed-docs] https://www.formant.ai/fleet-orchestration“Assigns the right job to the right robot — regardless of who built it — using operational history and live data, and dispatches help the moment something looks wrong.”
  • [claimed-docs] https://www.formant.ai/fleet-orchestration“Heterogeneous Fleet Orchestration assigns the right job to the right robot — regardless of who built it — using operational history and live data, and dispatches help the moment something looks wrong.”
  • [claimed-docs] https://www.formant.ai/operations“Get instant visibility into every robot in your fleet. Set up alerts for anomalies, track mission progress, and respond to issues before they become downtime.”

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.formant.io/docs/analytics.md“Using built-in visualizations, custom SQL queries, or our AI assistant, you can build a rich dashboard for your devices.”
  • [claimed-docs] https://docs.formant.io/docs/analytics.md“Formant Analytics allows you to visualize, aggregate, and analyze data from your device over a time range of your choice. Using built-in visualizations, custom SQL queries, or our AI assistant, you can build a rich dashboard for your devices.”
  • [claimed-docs] https://www.formant.ai/products“Ask your fleet what's happening in plain language and get governed, ML-driven task recommendations — with people approving what happens next.”
  • [claimed-docs] https://www.formant.ai/products“Ask your fleet what’s happening in plain language and get governed, ML-driven task recommendations — with people approving what happens next.”

Operate the product with natural-language commandsweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://www.formant.ai/products“Ask your fleet what's happening in plain language and get governed, ML-driven task recommendations — with people approving what happens next.”
  • [claimed-docs] https://www.formant.ai/products“Ask your fleet what’s happening in plain language and get governed, ML-driven task recommendations — with people approving what happens next.”
  • [claimed-docs] https://docs.formant.io/docs/analytics.md“Using built-in visualizations, custom SQL queries, or our AI assistant, you can build a rich dashboard for your devices.”
  • [claimed-docs] https://docs.formant.io/docs/analytics.md“Formant Analytics allows you to visualize, aggregate, and analyze data from your device over a time range of your choice. Using built-in visualizations, custom SQL queries, or our AI assistant, you can build a rich dashboard for your devices.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“Commands tell our robot to take a predefined action. For example, we can use commands to trigger data ingestion, run a script, or tell our robot to return to its home position.”

Built-in AI = 33.0 ÷ 90 × 100 = 36.7

Automation21.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://www.formant.ai/fleet-orchestration“Tracks historical performance per robot, per mission — speed, error rates, how a given unit has handled a given job before — alongside current location and status. Assigns the best-suited robot, or robots.”
  • [claimed-docs] https://www.formant.ai/fleet-orchestration“Assigns the right job to the right robot — regardless of who built it — using operational history and live data, and dispatches help the moment something looks wrong.”
  • [claimed-docs] https://www.formant.ai/fleet-orchestration“One view across every vendor's fleet — AMRs, quadrupeds, humanoids, arms — without a separate dashboard, update cycle, or incident format per manufacturer.”
  • [claimed-docs] https://www.formant.ai/operations“Manage multiple fleets simultaneously from a single operator view”
  • [claimed-docs] https://www.formant.ai/operations“Build better human-to-robot ratios by automating incident response and creating workflows for monitoring devices at scale.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“In addition to these commands, you can create custom commands via the Formant Admin API.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“Commands tell our robot to take a predefined action. For example, we can use commands to trigger data ingestion, run a script, or tell our robot to return to its home position.”

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”
  • [claimed-docs] https://www.formant.ai/operations“Build better human-to-robot ratios by automating incident response and creating workflows for monitoring devices at scale.”
  • [claimed-docs] https://www.formant.ai/operations“Get instant visibility into every robot in your fleet. Set up alerts for anomalies, track mission progress, and respond to issues before they become downtime.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“Commands tell our robot to take a predefined action. For example, we can use commands to trigger data ingestion, run a script, or tell our robot to return to its home position.”

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.formant.io/docs/trigger-webhooks-from-events.md“A webhook allows you to make an API call to any endpoint over HTTP based on a trigger from a Formant event.”
  • [claimed-docs] https://docs.formant.io/docs/getting-started-commands.md“Commands tell our robot to take a predefined action. For example, we can use commands to trigger data ingestion, run a script, or tell our robot to return to its home position.”
  • [claimed-docs] https://www.formant.ai/operations“Build better human-to-robot ratios by automating incident response and creating workflows for monitoring devices at scale.”

Version, review, and roll back my automationsweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 16.8 ÷ 80 × 100 = 21.0