Rank #6 of 8 in GPUs & AI Accelerators
Try itExperimental
See what an agent can do with NVIDIA H200 (SXM) before you ever sign up. Pick a story: recorded sessions replay real probe-harness transcripts; sandboxed self-drive sessions are designed and gated (docs/TRY-IT.md).
$curl -sL 'https://www.nvidia.com/en-us/data-center/h200/' | grep -o 'H200' | head -1 # vendor spec page, live and keylessrecorded session — replayed, not liveVerified integrations
No integration evidence found in our corpus for this product yet — that means none was found, never that it doesn’t integrate.
By theme — the product's score on each story themeBy theme
Agenticness — how well agents can access and operate the productAgenticnessevidence →
How well agents can access and operate the product
Ai compute — stories about ai compute in this arenaAi computeevidence →
Stories about ai compute in this arena
Automation depth — how much of the product can run unattendedAutomation depthevidence →
How much of the product can run unattended
Creator media — stories about creator media in this arenaCreator mediaevidence →
Stories about creator media in this arena
Datacenter scale — stories about datacenter scale in this arenaDatacenter scaleevidence →
Stories about datacenter scale in this arena
Driver openness — stories about driver openness in this arenaDriver opennessevidence →
Stories about driver openness in this arena
Gaming performance — stories about gaming performance in this arenaGaming performanceevidence →
Stories about gaming performance in this arena
Memory vram — stories about memory vram in this arenaMemory vramevidence →
Stories about memory vram in this arena
Openness — open source, data portability, and self-hosting storiesOpennessevidence →
Open source, data portability, and self-hosting stories
Power cooling — stories about power cooling in this arenaPower coolingevidence →
Stories about power cooling in this arena
Privacy posture — data-handling and privacy storiesPrivacy postureevidence →
Data-handling and privacy stories
Software toolchain — stories about software toolchain in this arenaSoftware toolchainevidence →
Stories about software toolchain in this arena
Story verdicts — every judged story with its evidenceStory verdicts
Follow the green: where the map greys out is where NVIDIA H200 (SXM) stops today. ✓ full · ~ partial · ! disputed · — none · n/a not applicable.
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
API surface
Drive the product through a documented public API
—0/10
Subscribe to events via webhooks
n/an/a
Build against official SDKs
~5/10
Issue scoped/least-privilege API credentials for an agent
n/an/a
Connect an agent via an official MCP server
n/an/a
Download a machine-readable API spec (OpenAPI or equivalent)
—0/10
Rely on versioned APIs with a documented deprecation policy
n/an/a
Test against a sandbox environment without touching production data
n/an/a
Explore an interactive API reference with runnable examples
n/an/a
Docs for agents
Point an agent at llms.txt or agent-oriented docs
~5/10
Agentic features
Delegate tasks to a built-in AI assistant inside the product
—–
Operate the product with natural-language commands
—–
Plug MCP servers into this product so it can use their tools
n/an/a
Get AI-generated insights and suggestions from my data inside the product
—–
Set up automations that run autonomously in the background
n/an/a
Ai compute — stories about ai compute in this arenaAi compute
Stories about ai compute in this arena
This GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this part
~4/10
Size training and inference from published tensor throughput — TFLOPS or TOPS with precision and sparsity stated, not a bare marketing number
~4/10
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
Creator media — stories about creator media in this arenaCreator media
Stories about creator media in this arena
Datacenter scale — stories about datacenter scale in this arenaDatacenter scale
Stories about datacenter scale in this arena
Driver openness — stories about driver openness in this arenaDriver openness
Stories about driver openness in this arena
Gaming performance — stories about gaming performance in this arenaGaming performance
Stories about gaming performance in this arena
Memory vram — stories about memory vram in this arenaMemory vram
Stories about memory vram in this arena
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
Power cooling — stories about power cooling in this arenaPower cooling
Stories about power cooling in this arena
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
Software toolchain — stories about software toolchain in this arenaSoftware toolchain
Stories about software toolchain in this arena
Sorted by importance (agentic first) (high → low) · 43/43 stories · click a row’s chevron for the rationale and evidence
Drive the product through a documented public API G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 3 | none | 0/10 | ||
Connect an agent via an official MCP server G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 3 | n/a | untested | none yet | |
Delegate tasks to a built-in AI assistant inside the product G Agentic features | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 3 | none | untested | none yet | |
Plug MCP servers into this product so it can use their tools G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 3 | n/a | untested | none yet | |
Build against official SDKs G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | partial | 5/10 | Tprobed | |
Point an agent at llms.txt or agent-oriented docs G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | partial | 5/10 | Tprobed | |
Download a machine-readable API spec (OpenAPI or equivalent) G Api quality | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | none | 0/10 | ||
Explore an interactive API reference with runnable examples G Api quality | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | n/a | untested | none yet | |
Get AI-generated insights and suggestions from my data inside the product G Agentic features | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | none | untested | none yet | |
Issue scoped/least-privilege API credentials for an agent G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | n/a | untested | none yet | |
Operate the product with natural-language commands G Agentic features | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | none | untested | none yet | |
Rely on versioned APIs with a documented deprecation policy G Api quality | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | n/a | untested | none yet | |
Run the product headlessly / in CI for automation G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | none | untested | none yet | |
Set up automations that run autonomously in the background G Agentic features | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | n/a | untested | none yet | |
Subscribe to events via webhooks G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | n/a | untested | none yet | |
Use an official CLI G Agent access | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 2 | none | untested | none yet | |
Test against a sandbox environment without touching production data G Api quality | ai-native user | Agenticness — how well agents can access and operate the productAgenticness | 1 | n/a | untested | none yet | |
Run a 70B-class quantized LLM on this GPU — published VRAM capacity and memory bandwidth that make local or single-node inference practical C Llm memory | ai-native user | Memory vram — stories about memory vram in this arenaMemory vram | 3 | full | 9/10 | Tprobed | |
Ship GPU-compute workloads on the vendor's toolchain — CUDA or ROCm/HIP documentation lists this part as a supported target C Compute stack | developer | Software toolchain — stories about software toolchain in this arenaSoftware toolchain | 3 | full | 8/10 | Tprobed | |
Self-host the core product G | ai-native user | Openness — open source, data portability, and self-hosting storiesOpenness | 3 | full | 7/10 | Xcommunity | |
Train and serve at datacenter scale on this part — documented high-bandwidth interconnect (NVLink, Infinity Fabric), multi-GPU systems, and rack-scale deployment C Scale out | ml engineer | Datacenter scale — stories about datacenter scale in this arenaDatacenter scale | 3 | partial | 6/10 | Xcommunity | |
Size training and inference from published tensor throughput — TFLOPS or TOPS with precision and sparsity stated, not a bare marketing number C Tensor specs | ml engineer | Ai compute — stories about ai compute in this arenaAi compute | 3 | partial | 4/10 | Tprobed | |
This GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this part C Inference stack | ai-native user | Ai compute — stories about ai compute in this arenaAi compute | 3 | partial | 4/10 | Tprobed | |
Define rules that trigger actions automatically on events G | ai-native user | Automation depth — how much of the product can run unattendedAutomation depth | 3 | n/a | untested | none yet | |
Export all of my data in open formats and leave G | ai-native user | Openness — open source, data portability, and self-hosting storiesOpenness | 3 | n/a | untested | none yet | |
Prevent my data from being used to train AI models G | ai-native user | Privacy posture — data-handling and privacy storiesPrivacy posture | 3 | none | untested | none yet | |
This card drives high-refresh 4K gaming — vendor performance claims corroborated by independent game benchmarks C 4k gaming | gamer | Gaming performance — stories about gaming performance in this arenaGaming performance | 3 | none | untested | none yet | |
Memory specs are published in full for this exact part — capacity, memory type, bus width, and bandwidth C Memory spec | ml engineer | Memory vram — stories about memory vram in this arenaMemory vram | 2 | partial | 6/10 | Tprobed | |
PyTorch and mainstream ML frameworks run on this GPU through officially documented builds and support matrices C Frameworks | ml engineer | Software toolchain — stories about software toolchain in this arenaSoftware toolchain | 2 | partial | 6/10 | Xcommunity | |
Sustained workloads are power-efficient on this part — documented power envelopes with independent performance-per-watt testing C Efficiency | ml engineer | Power cooling — stories about power cooling in this arenaPower cooling | 2 | partial | 3/10 | Xcommunity | |
Run this GPU on an open driver — open-source kernel modules or upstream Linux support documented by the vendor C Open drivers | developer | Driver openness — stories about driver openness in this arenaDriver openness | 2 | none | 0/10 | ||
AI upscaling and frame generation are supported on this card — the DLSS or FSR generation is documented for this part, with broad game support C Upscaling | gamer | Gaming performance — stories about gaming performance in this arenaGaming performance | 2 | none | untested | none yet | |
Choose where my data is stored (region/residency) G | ai-native user | Privacy posture — data-handling and privacy storiesPrivacy posture | 2 | n/a | untested | none yet | |
Control data retention and deletion G | ai-native user | Privacy posture — data-handling and privacy storiesPrivacy posture | 2 | n/a | untested | none yet | |
Do everything through the API that I can do in the UI G | ai-native user | Openness — open source, data portability, and self-hosting storiesOpenness | 2 | n/a | untested | none yet | |
Hardware media engines and creator-app acceleration are documented — AV1/HEVC encoders, and professional or ISV-certified driver support where the vendor claims it C Media engines | creator | Creator media — stories about creator media in this arenaCreator media | 2 | none | untested | none yet | |
Linux is a first-class citizen for this GPU — documented Linux driver releases and independent Linux testing of this part C Linux support | developer | Driver openness — stories about driver openness in this arenaDriver openness | 2 | none | untested | none yet | |
Opt out of telemetry and usage tracking G | ai-native user | Privacy posture — data-handling and privacy storiesPrivacy posture | 2 | n/a | untested | none yet | |
Perform bulk operations across many items at once G | ai-native user | Automation depth — how much of the product can run unattendedAutomation depth | 2 | none | untested | none yet | |
Read the product's source under an open license G | ai-native user | Openness — open source, data portability, and self-hosting storiesOpenness | 2 | none | untested | none yet | |
Schedule recurring jobs or workflows G | ai-native user | Automation depth — how much of the product can run unattendedAutomation depth | 2 | none | untested | none yet | |
Spec a build around published board power — TDP/TGP, connector requirements, and cooling guidance for this exact card C Psu planning | gamer | Power cooling — stories about power cooling in this arenaPower cooling | 2 | none | untested | none yet | |
Version, review, and roll back my automations G | ai-native user | Automation depth — how much of the product can run unattendedAutomation depth | 1 | n/a | untested | none yet |
Opportunities — the stories that would move this product's scores, from its own judged verdictsOpportunitiestop 8 of 25 stories with headroom
What would move NVIDIA H200 (SXM)’s scores — derived from its own judged verdicts, biggest headroom first. Each line quotes what the judge found missing; shipping it (or evidencing it publicly) is the fix.
Agenticness — how well agents can access and operate the productDelegate tasks to a built-in AI assistant inside the product
nonemoves Built-in AIimpact 45
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Agenticness — how well agents can access and operate the productDrive the product through a documented public API
nonemoves agent-readyimpact 45
The H200 is a hardware accelerator; while CUDA Toolkit and Nsight tools provide programming interfaces, there is no evidence of a documented public REST/agentic API for driving the product, and explicit probes for OpenAPI/swagger specs all returned 404s.
Gaming performance — stories about gaming performance in this arenaThis card drives high-refresh 4K gaming — vendor performance claims corroborated by independent game benchmarks
nonemoves PA Scoreimpact 30
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Privacy posture — data-handling and privacy storiesPrevent my data from being used to train AI models
nonemoves PA Scoreimpact 30
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Agenticness — how well agents can access and operate the productGet AI-generated insights and suggestions from my data inside the product
nonemoves Built-in AIimpact 30
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Agenticness — how well agents can access and operate the productRun the product headlessly / in CI for automation
nonemoves agent-readyimpact 30
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Agenticness — how well agents can access and operate the productOperate the product with natural-language commands
nonemoves Built-in AIimpact 30
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Agenticness — how well agents can access and operate the productUse an official CLI
nonemoves agent-readyimpact 30
The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".
Showing the top 8 of 25 — every none/partial verdict in the story verdicts table is headroom.
Think a verdict is wrong? Every verdicts-table row has a Flag link — see the methodology.
Coverage map — which docs area, API section, or community source covers which judged storiesCoverage map5 surfaces · 11 covered stories
Where the cited evidence behind each covered verdict came from — the same citations the verdicts table shows, no extra judging.
En us docs9 stories
- Build against official SDKs
- This GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this part
- Size training and inference from published tensor throughput — TFLOPS or TOPS with precision and sparsity stated, not a bare marketing number
- Train and serve at datacenter scale on this part — documented high-bandwidth interconnect (NVLink, Infinity Fabric), multi-GPU systems, and rack-scale deployment
- Run a 70B-class quantized LLM on this GPU — published VRAM capacity and memory bandwidth that make local or single-node inference practical
- Memory specs are published in full for this exact part — capacity, memory type, bus width, and bandwidth
- Self-host the core product
- Sustained workloads are power-efficient on this part — documented power envelopes with independent performance-per-watt testing
- Ship GPU-compute workloads on the vendor's toolchain — CUDA or ROCm/HIP documentation lists this part as a supported target
Hacker News9 stories
- This GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this part
- Size training and inference from published tensor throughput — TFLOPS or TOPS with precision and sparsity stated, not a bare marketing number
- Train and serve at datacenter scale on this part — documented high-bandwidth interconnect (NVLink, Infinity Fabric), multi-GPU systems, and rack-scale deployment
- Run a 70B-class quantized LLM on this GPU — published VRAM capacity and memory bandwidth that make local or single-node inference practical
- Memory specs are published in full for this exact part — capacity, memory type, bus width, and bandwidth
- Self-host the core product
- Sustained workloads are power-efficient on this part — documented power envelopes with independent performance-per-watt testing
- Ship GPU-compute workloads on the vendor's toolchain — CUDA or ROCm/HIP documentation lists this part as a supported target
- PyTorch and mainstream ML frameworks run on this GPU through officially documented builds and support matrices
Cuda toolkit docs6 stories
- Point an agent at llms.txt or agent-oriented docs
- Build against official SDKs
- Train and serve at datacenter scale on this part — documented high-bandwidth interconnect (NVLink, Infinity Fabric), multi-GPU systems, and rack-scale deployment
- Self-host the core product
- Ship GPU-compute workloads on the vendor's toolchain — CUDA or ROCm/HIP documentation lists this part as a supported target
- PyTorch and mainstream ML frameworks run on this GPU through officially documented builds and support matrices
Probe proofs — replayable recordings from the probe harnessProbe proofs
Replayable recordings from our probe harness — see the Prove-It protocol to submit one.
$curl -sL 'https://www.nvidia.com/en-us/data-center/h200/' | grep -o 'H200' | head -1 # vendor spec page, live and keylessreproduced$ curl -sL 'https://www.nvidia.com/en-us/data-center/h200/' | grep -o 'H200' | head -1 # vendor spec page, live and [redacted]less H200
Claims vs evidence — vendor claims reconciled against independent verdictsClaims vs evidence
6 of 6 testable claims verified · 0 contradicted → integrity 100/100
11 distinct capability claims found in NVIDIA H200 (SXM)’s own claimed-docs/GitHub materials, reconciled against our judge’s independent verdicts.
6
Verified
0
Unverified
0
Contradicted
5
Undersold
Verified (7)
“Delivers up to 2X faster LLM inference (e.g., Llama2) compared to H100 GPUs”
This GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this partpartialproof ↗
“First GPU with 141GB of HBM3e memory at 4.8TB/s bandwidth”
Memory specs are published in full for this exact part — capacity, memory type, bus width, and bandwidthpartialproof ↗
“First GPU with 141GB of HBM3e memory at 4.8TB/s bandwidth”
Run a 70B-class quantized LLM on this GPU — published VRAM capacity and memory bandwidth that make local or single-node inference practicalfullproof ↗
“Delivers this performance within the same power envelope as H100”
Sustained workloads are power-efficient on this part — documented power envelopes with independent performance-per-watt testingpartialproof ↗
“H200 NVL variant designed for lower-power, air-cooled enterprise rack deployments with flexible configurations”
Train and serve at datacenter scale on this part — documented high-bandwidth interconnect (NVLink, Infinity Fabric), multi-GPU systems, and rack-scale deploymentpartialproof ↗
“Includes NVIDIA NIM microservices to accelerate enterprise generative AI deployment”
This GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this partpartialproof ↗
“Nsight Compute and Nsight Systems tools help developers profile and optimize application performance”
Ship GPU-compute workloads on the vendor's toolchain — CUDA or ROCm/HIP documentation lists this part as a supported targetfullproof ↗
Undersold (5)
Point an agent at llms.txt or agent-oriented docspartialproof ↗
Size training and inference from published tensor throughput — TFLOPS or TOPS with precision and sparsity stated, not a bare marketing numberpartialproof ↗
PyTorch and mainstream ML frameworks run on this GPU through officially documented builds and support matricespartialproof ↗
Claims outside our story set (5)
Real capability claims found in NVIDIA H200 (SXM)’s own materials, but no story in this arena’s taxonomy covers them yet — that’s feedback on the taxonomy, not a mark against the product.
“Provides up to 110X faster time-to-results versus CPUs”
source ↗“Supports Multi-Instance GPU partitioning into up to 7 instances at 18GB each”
source ↗“Supports confidential computing for secure workload execution”
source ↗“H200 NVL bundled with a five-year NVIDIA AI Enterprise software subscription”
source ↗“Supports application development and deployment across embedded systems, workstations, data centers, cloud, and supercomputers”
source ↗
Business model
Datacenter GPU sold via OEM systems and cloud providers — no public list price; rented by the hour on GPU clouds.
pricing ↗Score trend
How this product’s scores have moved as evidence and verdicts are re-derived — a point per change, not per day.
Try Experimental
Run it in the microterminal →Recorded agent sessions — and a live MCP handshake where the vendor ships one.
Flag
⚑ Flag a verdictThink a verdict is wrong? Opens a prefilled GitHub issue — or use the ⚑ next to any verdict above.
For agents
