Skip to content
ProductArena

How NVIDIA Isaac’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score23/100

Agent-ready 30.9 × 0.30 = 9.27

API quality 5.1 × 0.20 = 1.02

Openness 43.2 × 0.20 = 8.64

Built-in AI 0.0 × 0.15 = 0.00

Automation 30.0 × 0.15 = 4.50

(9.27 + 1.02 + 8.64 + 0.00 + 4.50) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 23.43 ÷ 1.00 = 23.4

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready30.9/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.isaacsim.omniverse.nvidia.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/llms.txt”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md“PROBE docs-md: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.isaacsim.omniverse.nvidia.com/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/swagger.json, https://docs.isaacsim.omniverse.nvidia.com/api/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/.well-known/openapi.json)”

Run the product headlessly / in CI for automationweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://developer.nvidia.com/isaac/lab“Run fast, large-scale training with GPU-optimized simulation paths built on Warp and NVIDIA® CUDA®-graphable environments, and deploy easily with standalone headless operation, from workstation to data center.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip).”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html“Use ROS 2 services and actions to load worlds, spawn entities, and step simulations.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip)”

Plug MCP servers into this product so it can use their toolsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Use an official CLIweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip).”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip)”

Drive the product through a documented public APIweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html“Use ROS 2 services and actions to load worlds, spawn entities, and step simulations.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip).”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip)”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/llms.txt”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.isaacsim.omniverse.nvidia.com/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/swagger.json, https://docs.isaacsim.omniverse.nvidia.com/api/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/.well-known/openapi.json)”

Issue scoped/least-privilege API credentials for an agentweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip).”
  • [claimed-docs] https://developer.nvidia.com/isaac/lab“Customize workflows with robot training environments, tasks, learning techniques, and the ability to integrate custom libraries (e.g., skrl, RLLib, rl_games, and more).”
  • [claimed-docs] https://developer.nvidia.com/isaac/lab“NVIDIA Isaac™ Lab is an open-source, GPU-accelerated, agent-ready simulation framework for robot learning designed to train robot policies at scale.”
  • [claimed-docs] https://developer.nvidia.com/isaac/ros“It offers ready-to-use packages for common tasks like navigation and perception, uses NVIDIA frameworks for optimal performance, and can be deployed on both workstations and embedded systems like NVIDIA Jetson™.”
  • [claimed-docs] https://developer.nvidia.com/isaac/gr00t“NVIDIA Isaac™ GR00T is an open reference platform for general-purpose humanoid robots that enables developers to more efficiently build, train, test, and deploy AI-powered robots.”
  • [claimed-docs] https://developer.nvidia.com/isaac/sim“Isaac Sim is fully extensible, so developers can build custom OpenUSD-based simulators or integrate framework capabilities into existing testing and validation pipelines.”
  • [github] https://github.com/isaac-sim/IsaacSim“ROS Bridge: Integration with Robot Operating System (ROS).”

Subscribe to events via webhooksweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Agent-ready = 34.0 ÷ 110 × 100 = 30.9

API quality5.1/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.isaacsim.omniverse.nvidia.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/llms.txt”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md“PROBE docs-md: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.isaacsim.omniverse.nvidia.com/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/swagger.json, https://docs.isaacsim.omniverse.nvidia.com/api/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/.well-known/openapi.json)”

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.isaacsim.omniverse.nvidia.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.isaacsim.omniverse.nvidia.com/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/swagger.json, https://docs.isaacsim.omniverse.nvidia.com/api/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/.well-known/openapi.json)”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/llms.txt”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md“PROBE docs-md: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md”

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 6 (quality) × 0.6 (partial) = 3.6 of 10 max

  • [claimed-docs] https://developer.nvidia.com/isaac/sim“developers can train perception and mobility stacks in simulation and evaluate the end-to-end system in Isaac Sim using software-in-the-loop or hardware-in-the-loop testing.”
  • [claimed-docs] https://developer.nvidia.com/isaac/sim“Isaac Sim also supports controllable synthetic data generation, letting developers build custom data pipelines that complement their existing data sources.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html“Simulate with PhysX or Newton, add RTX and physics-based sensors, generate synthetic data, prepare robots for Isaac Lab, and validate robot stacks with ROS 2.”
  • [claimed-docs] https://developer.nvidia.com/isaac/sim“Isaac Sim is fully extensible, so developers can build custom OpenUSD-based simulators or integrate framework capabilities into existing testing and validation pipelines.”

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [probe] https://docs.isaacsim.omniverse.nvidia.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.isaacsim.omniverse.nvidia.com/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/swagger.json, https://docs.isaacsim.omniverse.nvidia.com/api/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/.well-known/openapi.json)”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/llms.txt“PROBE llms.txt: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/llms.txt”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md“PROBE docs-md: HTTP 404 at https://docs.isaacsim.omniverse.nvidia.com/latest/index.html.md”

API quality = 3.6 ÷ 70 × 100 = 5.1

Openness43.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip).”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip)”
  • [claimed-docs] https://developer.nvidia.com/isaac/lab“Run fast, large-scale training with GPU-optimized simulation paths built on Warp and NVIDIA® CUDA®-graphable environments, and deploy easily with standalone headless operation, from workstation to data center.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html“Use ROS 2 services and actions to load worlds, spawn entities, and step simulations.”
  • [claimed-docs] https://developer.nvidia.com/isaac/sim“Isaac Sim is fully extensible, so developers can build custom OpenUSD-based simulators or integrate framework capabilities into existing testing and validation pipelines.”
  • [probe] https://docs.isaacsim.omniverse.nvidia.com/openapi.json“PROBE openapi: all candidate paths 404 (https://docs.isaacsim.omniverse.nvidia.com/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/swagger.json, https://docs.isaacsim.omniverse.nvidia.com/api/openapi.json, https://docs.isaacsim.omniverse.nvidia.com/.well-known/openapi.json)”

Export all of my data in open formats and leaveweight 3

3 (weight) × 5 (quality) × 0.6 (partial) = 9.0 of 30 max

  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html“Import robots and scenes from URDF, MJCF, Onshape CAD, or USD.”
  • [github] https://github.com/isaac-sim/IsaacSim“Asset Import & Export: Importing and exporting robots and environments from and to non-USD format.”
  • [claimed-docs] https://developer.nvidia.com/isaac/sim“Isaac Sim can ingest data from multiple sources—such as computer-aided design (CAD), Unified Robot Description Format (URDF), or real-world captures via NVIDIA Omniverse NuRec and Isaac TeleOp—and convert it into USD.”
  • [community] https://news.ycombinator.com/item?id=43405563“Praised Nvidia for releasing Isaac GR00T N1 under an Apache 2 license, contrasting it with Google Gemini's robotics model which wasn't open-sourced, hoping the move pressures others to open source too.”

Read the product's source under an open licenseweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://developer.nvidia.com/isaac/lab“NVIDIA Isaac™ Lab is an open-source, GPU-accelerated, agent-ready simulation framework for robot learning designed to train robot policies at scale.”
  • [claimed-docs] https://developer.nvidia.com/isaac/sim“Train your robot policy in the Isaac Lab open source unified framework for robot learning.”
  • [community] https://news.ycombinator.com/item?id=43405563“Praised Nvidia for releasing Isaac GR00T N1 under an Apache 2 license, contrasting it with Google Gemini's robotics model which wasn't open-sourced, hoping the move pressures others to open source too.”
  • [github] https://github.com/isaac-sim/IsaacSim“Asset Import & Export: Importing and exporting robots and environments from and to non-USD format.”
  • [github] https://github.com/isaac-sim/IsaacSim“Robot Tuning: Optimize robot for physics accuracy, computation efficiency, or photorealism”
  • [github] https://github.com/isaac-sim/IsaacSim“ROS Bridge: Integration with Robot Operating System (ROS).”

Self-host the core productweight 3

3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max

  • [github] https://github.com/isaac-sim/IsaacSim“Asset Import & Export: Importing and exporting robots and environments from and to non-USD format.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/installation/install_python.html“Isaac Sim provides several Python namespace packages that allow you to compose an Isaac Sim app by parts using a Python package manager (for example: pip).”
  • [claimed-docs] https://developer.nvidia.com/isaac/lab“Run fast, large-scale training with GPU-optimized simulation paths built on Warp and NVIDIA® CUDA®-graphable environments, and deploy easily with standalone headless operation, from workstation to data center.”
  • [community] https://news.ycombinator.com/item?id=43405563“Praised Nvidia for releasing Isaac GR00T N1 under an Apache 2 license, contrasting it with Google Gemini's robotics model which wasn't open-sourced, hoping the move pressures others to open source too.”

Openness = 43.2 ÷ 100 × 100 = 43.2

Built-in AI0.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Set up automations that run autonomously in the backgroundweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Delegate tasks to a built-in AI assistant inside the productweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Operate the product with natural-language commandsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Built-in AI = 0.0 ÷ 20 × 100 = 0.0

Automation30.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max

  • [claimed-docs] https://developer.nvidia.com/isaac/lab“Run fast, large-scale training with GPU-optimized simulation paths built on Warp and NVIDIA® CUDA®-graphable environments, and deploy easily with standalone headless operation, from workstation to data center.”
  • [claimed-docs] https://docs.isaacsim.omniverse.nvidia.com/latest/index.html“Generate labeled training data from Isaac Sim scenes with Replicator.”
  • [claimed-docs] https://developer.nvidia.com/isaac/lab“Customize workflows with robot training environments, tasks, learning techniques, and the ability to integrate custom libraries (e.g., skrl, RLLib, rl_games, and more).”

Define rules that trigger actions automatically on eventsweight 3

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 6.0 ÷ 20 × 100 = 30.0