NVIDIA H200 (SXM) vs AMD Instinct MI355X
oem-channel
·oem-channel
AMD Instinct MI355X wins · 4–12 (12 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round to AMD Instinct MI355XA probe confirms developer.nvidia.com/llms.txt returns HTTP 200 with a real summary, showing NVIDIA does expose an agent-readable entry point for its developer docs, but this is a generic portal file, not specific to H200 GPU documentation, and other agent-friendly formats (docs.md, OpenAPI) return 404s. Missing for 10: H200-specific machine-readable docs, working docs.md/OpenAPI endpoints, and confirmation an agent can navigate beyond the root llms.txt.
- [probe] “PROBE llms.txt: HTTP 200 at https://developer.nvidia.com/llms.txt # NVIDIA Developer > Comprehensive developer portal for NVIDIA accelerate…”
- [probe] “PROBE docs-md: HTTP 404 at https://developer.nvidia.com/cuda-toolkit.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://developer.nvidia.com/openapi.json, https://developer.nvidia.com/swagger.json, https://develo…”
A live llms.txt file was confirmed at rocm.docs.amd.com/llms.txt with a 200 response, providing an agent-readable entry point into ROCm documentation, and the runtime probe confirms the docs surface is crawlable without a browser. Missing for 10: no evidence of per-page markdown/.md variants (404 on that probe), no OpenAPI/agent tool spec, and no confirmation that agent-oriented docs cover the MI355X product pages themselves rather than just ROCm software.
- [probe] “PROBE llms.txt: HTTP 200 at https://rocm.docs.amd.com/llms.txt # ROCm documentation > Note: ROCm documentation is split across multiple pro…”
- [probe] “PROBE runtime (recorded 2026-09-15): the ROCm documentation at rocm.docs.amd.com answered a keyless curl naming ROCm — the MI355X's entire d…”
- [probe] “PROBE docs-md: HTTP 404 at https://rocm.docs.amd.com/en/latest/.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://rocm.docs.amd.com/openapi.json, https://rocm.docs.amd.com/swagger.json, https://rocm.docs.am…”
ai-native userRun the product headlessly / in CI for automation
weight 2 · round to AMD Instinct MI355XNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
ROCm/Instinct docs show clear headless-automation building blocks — AMD Container Toolkit for Docker, GPU Operator for Kubernetes, Spur job scheduler (Slurm-compatible), and Cluster/ROCm Validation Suites for automated testing — all of which support running GPU workloads without a UI in CI/cluster pipelines. Missing for 10: no first-party CI pipeline example (e.g., GitHub Actions/GitLab runner config) or independent hands-on report confirming headless CI use in practice.
- [claimed-docs] “GPU Operator Deploy and manage Instinct GPUs in Kubernetes clusters.”
- [claimed-docs] “Spur AI-native job scheduler, drop-in compatible with Slurm, with GPU-first scheduling and Raft-based state.”
- [claimed-docs] “Cluster Validation Suite Test scripts that validate AMD AI clusters end to end.”
- [claimed-docs] “AMD Container Toolkit Integrate Instinct GPUs with Docker and container runtimes.”
- [claimed-docs] “ROCm Validation Suite System validation and hardware diagnostics.”
ai-native userUse an official CLI
weight 2 · round to AMD Instinct MI355XNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
AMD ships official CLI tooling in its ecosystem — AMD SMI for GPU management and Spur, explicitly described as an 'AI-native job scheduler' with Slurm-compatible CLI — but these are infrastructure/ops CLIs rather than a CLI aimed at AI-native development or agentic workflows. Missing for 10: evidence of a CLI specifically designed for AI-agent/dev workflows (e.g., code generation, model interaction, agent orchestration) and independent hands-on confirmation of these CLIs' AI-native usability.
- [claimed-docs] “AMD SMI Unified user-space tool to manage and monitor GPUs and drivers.”
- [claimed-docs] “Spur AI-native job scheduler, drop-in compatible with Slurm, with GPU-first scheduling and Raft-based state.”
- [claimed-docs] “AMD Container Toolkit Integrate Instinct GPUs with Docker and container runtimes.”
ai-native userDrive the product through a documented public API
weight 3 · round to AMD Instinct MI355XNVIDIA H200 (SXM)none0/10The H200 is a hardware accelerator; while CUDA Toolkit and Nsight tools provide programming interfaces, there is no evidence of a documented public REST/agentic API for driving the product, and explicit probes for OpenAPI/swagger specs all returned 404s.
AMD documents extensive low-level APIs for driving the GPU (HIP runtime, ROCm libraries, AMD SMI, metrics exporter) and even exposes an llms.txt for machine consumption, but there is no unified, documented public API (e.g., OpenAPI/REST spec) that an AI-native agent could call to drive the product — probes for openapi.json/swagger.json all 404. missing for 10: a formal public API spec/SDK reference for agentic automation, evidence of programmatic/agent-driven control beyond developer-level HIP/ROCm libraries, independent confirmation of agent usage.
- [claimed-docs] “HIP C++ Learn the HIP programming model.”
- [claimed-docs] “AMD SMI Unified user-space tool to manage and monitor GPUs and drivers.”
- [claimed-docs] “Device Metrics Exporter Prometheus-format GPU metrics for HPC and AI environments.”
- [probe] “PROBE llms.txt: HTTP 200 at https://rocm.docs.amd.com/llms.txt # ROCm documentation > Note: ROCm documentation is split across multiple pro…”
- [probe] “PROBE openapi: all candidate paths 404 (https://rocm.docs.amd.com/openapi.json, https://rocm.docs.amd.com/swagger.json, https://rocm.docs.am…”
ai-native userBuild against official SDKs
weight 2 · round to AMD Instinct MI355XNVIDIA provides official SDKs to build against (CUDA Toolkit, Nsight developer tools, and NIM microservices bundled via NVIDIA AI Enterprise) that target the H200 hardware, and a developer portal exists with an llms.txt discovery file. However, probes show no machine-readable docs (404 on .md) and no OpenAPI/swagger spec, and there's no H200-specific agentic SDK evidence beyond generic CUDA/NIM tooling. missing for 10: agent-specific SDK examples, machine-readable API docs (docs-md returned 404), OpenAPI spec availability, independent developer corroboration of SDK usability for AI-native/agentic workflows.
- [claimed-docs] “NVIDIA AI Enterprise includes NVIDIA NIM™, a set of easy-to-use microservices designed to speed up enterprise generative AI deployment.”
- [claimed-docs] “With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data …”
- [claimed-docs] “NVIDIA Nsight Compute and Nsight System suite of tools designed to help developers optimize and increase performance of their applications.”
- [probe] “PROBE llms.txt: HTTP 200 at https://developer.nvidia.com/llms.txt # NVIDIA Developer > Comprehensive developer portal for NVIDIA accelerate…”
- [probe] “PROBE docs-md: HTTP 404 at https://developer.nvidia.com/cuda-toolkit.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://developer.nvidia.com/openapi.json, https://developer.nvidia.com/swagger.json, https://develo…”
AMD ships extensive official ROCm SDK documentation covering HIP runtime, OpenMP, math/communication libraries, container toolkit, framework integrations (vLLM, SGLang), and cluster/scheduling tools, with docs confirmed live and crawlable. This is a strong official SDK ecosystem AI-native developers can build against, though it lacks an OpenAPI/programmatic API spec and independent third-party validation of SDK quality beyond skepticism about software support. Missing for 10: machine-readable API spec (openapi probe 404s), independent hands-on developer corroboration of SDK usability.
- [claimed-docs] “The foundational libraries, runtimes, and tools for GPU computing on AMD hardware — math and compute libraries, communication primitives, HI…”
- [claimed-docs] “Full-stack documentation and recipes to deploy AI workloads on AMD GPUs using popular ROCm-enabled frameworks.”
- [claimed-docs] “Inference * [vLLM](https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/inference/vllm.html) * [SGLang](https://rocm.docs.amd.com/…”
- [claimed-docs] “HIP C++ Learn the HIP programming model.”
- [claimed-docs] “OpenMP Explore the OpenMP programming model.”
- [claimed-docs] “AMD Container Toolkit Integrate Instinct GPUs with Docker and container runtimes.”
- [probe] “PROBE llms.txt: HTTP 200 at https://rocm.docs.amd.com/llms.txt # ROCm documentation > Note: ROCm documentation is split across multiple pro…”
- [probe] “PROBE runtime (recorded 2026-09-15): the ROCm documentation at rocm.docs.amd.com answered a keyless curl naming ROCm — the MI355X's entire d…”
Agentic features
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
ai-native userOperate the product with natural-language commands
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
Api quality
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The H200 is a hardware GPU; NVIDIA's developer portal was probed for machine-readable API specs (openapi.json, swagger.json, etc.) and all returned 404, showing no discoverable OpenAPI spec is published.
AMD Instinct MI355Xnone0/10The evidence pack includes a direct probe showing all standard OpenAPI/Swagger endpoints return 404 on AMD's ROCm docs site, and no other citation mentions a machine-readable API spec for MI355X's software stack or management tools.
Ai compute — stories about ai compute in this arenaAi compute
Stories about ai compute in this arena
Inference stack
ai-native userThis GPU has a documented LLM inference story — low-precision formats (FP8/FP4) and supported serving stacks (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this part
weight 3 · round to AMD Instinct MI355XNVIDIA docs and runtime probes confirm H200's HBM3e specs and FP8 tensor performance figures, and community evidence shows real-world LLM inference (Llama2, Llama 405B) throughput gains, but no evidence names FP4 support or specific serving-stack integration (TensorRT-LLM, vLLM, ROCm, llama.cpp) for this part. missing for 10: explicit FP4 precision docs, named serving-stack support (TensorRT-LLM/vLLM/ROCm/llama.cpp) tied to H200.
- [claimed-docs] “The H200 boosts inference speed by up to 2X compared to H100 GPUs when handling LLMs like Llama2.”
- [claimed-docs] “the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s)”
- [community] “Llama 405B up to 142 tok/s on Nvidia H200 SXM — launched a production grade API endpoint at $3 per million tokens, made possible by H200 SXM…”
- [probe] “PROBE runtime (recorded 2026-09-15): NVIDIA's H200 datacenter page answered a keyless curl and names the part — the spec table (141GB HBM3e,…”
Docs confirm ROCm-based inference stack support for vLLM and SGLang, plus explicit MXFP6/MXFP4 low-precision datatype support and large HBM3E memory for LLM inference. However, the story also asks about TensorRT-LLM and llama.cpp support, and explicit FP8 support, none of which appear in the evidence pack. missing for 10: TensorRT-LLM support evidence, llama.cpp support evidence, explicit FP8 precision documentation, independent benchmarks validating inference throughput on these stacks.
- [claimed-docs] “Inference * [vLLM](https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/inference/vllm.html) * [SGLang](https://rocm.docs.amd.com/…”
- [claimed-docs] “AMD Instinct™ MI355X GPUs deliver leadership AI and HPC performance enabling high density infrastructures with 288GB HBM3E memory, 8TB/s ban…”
- [claimed-docs] “The foundational libraries, runtimes, and tools for GPU computing on AMD hardware — math and compute libraries, communication primitives, HI…”
- [claimed-docs] “Full-stack documentation and recipes to deploy AI workloads on AMD GPUs using popular ROCm-enabled frameworks.”
Tensor specs
ml engineerSize training and inference from published tensor throughput — TFLOPS or TOPS with precision and sparsity stated, not a bare marketing number
weight 3 · round to NVIDIA H200 (SXM)NVIDIA's H200 page is confirmed live and does contain a spec table with FP8 tensor figures and bandwidth/capacity numbers (per probe-rt-1), but the evidence pack itself surfaces mostly bare marketing multipliers ('2X faster than H100', '110X faster than CPU') rather than the actual precision-tagged TFLOPS/TOPS figures with sparsity conditions spelled out. Community commentary also notes the H200 reuses H100 silicon, adding skepticism to headline comparisons rather than to the raw spec numbers themselves. Missing for 10: explicit quoted TFLOPS/TOPS values per precision (FP8/FP16/INT8) with dense vs. sparse figures, and independent benchmark corroboration of those specific numbers.
- [claimed-docs] “The H200 boosts inference speed by up to 2X compared to H100 GPUs when handling LLMs like Llama2.”
- [claimed-docs] “the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s)”
- [probe] “PROBE runtime (recorded 2026-09-15): NVIDIA's H200 datacenter page answered a keyless curl and names the part — the spec table (141GB HBM3e,…”
- [community] “The H200 GPU die is the same as the H100, but it's using a full set of faster 24GB memory stacks... This is an H100 141GB, not new silicon l…”
AMD Instinct MI355Xnone0/10The evidence includes only bare marketing multipliers (e.g., 'Up to 2.2X AI performance') and mentions of supported datatypes (MXFP6/MXFP4) without any published absolute TFLOPS/TOPS figures broken out by precision (FP8/FP6/FP4/BF16) or with/without sparsity — exactly the kind of unqualified claim the story asks to avoid. Community sources discuss architectural comparisons qualitatively but never cite AMD's actual per-precision throughput spec table.
- [claimed-docs] “Up to 2.2X the AI performance vs. competitive accelerators1”
- [claimed-docs] “AMD Instinct™ MI355X GPUs deliver leadership AI and HPC performance enabling high density infrastructures with 288GB HBM3E memory, 8TB/s ban…”
- [community] “Compared to Nvidia's B200 SMs, CDNA 4 CUs have half the per-clock throughput across many 16-bit/8-bit data types; AMD still relies on a bigg…”
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round to AMD Instinct MI355XNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
The ROCm/Instinct docs point to inference frameworks (vLLM, SGLang) that natively support batched/continuous-batch inference, implying MI355X can process many requests or items in bulk, and GPU partitioning/cluster tooling suggest large-scale parallel job handling. However, there is no direct documentation of a bulk-operation API, batch job submission interface, or AI-native bulk-processing workflow specific to MI355X itself — it's inferred through third-party software rather than demonstrated first-party capability. Missing for 10: explicit bulk/batch API documentation, benchmarked throughput for batch workloads, and independent verification of batch processing at scale.
- [claimed-docs] “Inference * [vLLM](https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/inference/vllm.html) * [SGLang](https://rocm.docs.amd.com/…”
- [claimed-docs] “Full-stack documentation and recipes to deploy AI workloads on AMD GPUs using popular ROCm-enabled frameworks.”
- [claimed-docs] “GPU Partitioning Split compute units and memory to partition a single GPU.”
ai-native userSchedule recurring jobs or workflows
weight 2 · round to AMD Instinct MI355XNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
AMD ships 'Spur', described as an AI-native, Slurm-compatible job scheduler with GPU-first scheduling for Instinct clusters, which implies workflow/job scheduling capability, but the evidence never explicitly confirms recurring/cron-style job scheduling or automation-depth features. Missing for 10: documentation on recurring/cron scheduling semantics, workflow orchestration examples, and independent/hands-on validation of Spur's scheduling capabilities.
- [claimed-docs] “Spur AI-native job scheduler, drop-in compatible with Slurm, with GPU-first scheduling and Raft-based state.”
Creator media — stories about creator media in this arenaCreator media
Stories about creator media in this arena
Media engines
creatorHardware media engines and creator-app acceleration are documented — AV1/HEVC encoders, and professional or ISV-certified driver support where the vendor claims it
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
Datacenter scale — stories about datacenter scale in this arenaDatacenter scale
Stories about datacenter scale in this arena
Scale out
ml engineerTrain and serve at datacenter scale on this part — documented high-bandwidth interconnect (NVLink, Infinity Fabric), multi-GPU systems, and rack-scale deployment
weight 3 · round to NVIDIA H200 (SXM)Evidence confirms the SXM form factor, MIG partitioning, CUDA toolkit for datacenter deployment, and community proof of real multi-GPU serving (Llama 405B at 142 tok/s across H200 SXMs) validating datacenter-scale operation, but the pack never cites NVLink/NVSwitch bandwidth figures, Infinity Fabric, or DGX/HGX rack-scale system specs that the story explicitly asks for. missing for 10: explicit NVLink/NVSwitch bandwidth numbers, DGX/HGX rack-scale system documentation, independent rack-scale benchmark corroboration.
- [claimed-docs] “the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s)”
- [claimed-docs] “Multi-Instance GPUs Up to 7 MIGs @18GB each”
- [community] “Llama 405B up to 142 tok/s on Nvidia H200 SXM — launched a production grade API endpoint at $3 per million tokens, made possible by H200 SXM…”
- [claimed-docs] “With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data …”
Evidence documents rack-scale deployment tooling (Kubernetes GPU Operator, Container Toolkit, Cluster Validation Suite, Spur scheduler, SR-IOV, AMD SMI) and high memory bandwidth (8TB/s HBM3E), supporting datacenter-scale operations, but no citation explicitly documents the GPU-to-GPU interconnect fabric (e.g., Infinity Fabric link topology or scale-up fabric analogous to NVLink) that the story specifically calls out. Community sources focus on compute/memory comparisons, not interconnect topology, so this axis is only partially evidenced. Missing for 10: explicit Infinity Fabric/interconnect bandwidth specs and multi-GPU topology documentation, independent multi-node training benchmarks confirming interconnect scaling.
- [claimed-docs] “GPU Operator Deploy and manage Instinct GPUs in Kubernetes clusters.”
- [claimed-docs] “Spur AI-native job scheduler, drop-in compatible with Slurm, with GPU-first scheduling and Raft-based state.”
- [claimed-docs] “Cluster Validation Suite Test scripts that validate AMD AI clusters end to end.”
- [claimed-docs] “AMD Container Toolkit Integrate Instinct GPUs with Docker and container runtimes.”
- [claimed-docs] “SR-IOV Yes”
- [claimed-docs] “AMD Instinct™ MI355X GPUs deliver leadership AI and HPC performance enabling high density infrastructures with 288GB HBM3E memory, 8TB/s ban…”
- [community] “MI355X's HBM3E subsystem gives it 288GB capacity at 8 TB/s vs Nvidia B200's 180GB at 7.7 TB/s, maintaining AMD's memory capacity/bandwidth l…”
Driver openness — stories about driver openness in this arenaDriver openness
Stories about driver openness in this arena
Linux support
developerLinux is a first-class citizen for this GPU — documented Linux driver releases and independent Linux testing of this part
weight 2 · round to AMD Instinct MI355XNVIDIA H200 (SXM)none0/10Evidence pack lacks any explicit mention of Linux driver releases, release notes, or independent Linux benchmarking/testing of the H200; CUDA toolkit blurb only vaguely references 'data centers' and 'supercomputers' without naming Linux, and community links focus on inference throughput or die comparisons, not OS-specific testing.
ROCm's entire documented stack (HIP, container toolkit, Kubernetes GPU operator, AMD SMI, cluster validation) is Linux-native and independent hands-on benchmarking (chipsandcheese architecture deep-dive, HN wafer.ai comparisons) treats MI355X as a real, testable part. However, no evidence cites explicit Linux kernel driver release notes/versioning or independent Linux-specific driver validation reports. Missing for 10: explicit Linux driver release notes/changelog, independent third-party Linux driver-level testing (not just architecture/benchmark commentary), confirmation that cited benchmarks ran on Linux.
- [claimed-docs] “The foundational libraries, runtimes, and tools for GPU computing on AMD hardware — math and compute libraries, communication primitives, HI…”
- [claimed-docs] “HIP C++ Learn the HIP programming model.”
- [claimed-docs] “AMD Container Toolkit Integrate Instinct GPUs with Docker and container runtimes.”
- [claimed-docs] “GPU Operator Deploy and manage Instinct GPUs in Kubernetes clusters.”
- [community] “Compared to Nvidia's B200 SMs, CDNA 4 CUs have half the per-clock throughput across many 16-bit/8-bit data types; AMD still relies on a bigg…”
- [community] “On every row the B300 beat the MI355X in a wafer.ai comparison; critics say the price comparison (MI355X at $2.5/hr) is unrealistic since no…”
Open drivers
developerRun this GPU on an open driver — open-source kernel modules or upstream Linux support documented by the vendor
weight 2 · round drawnNVIDIA H200 (SXM)none0/10Evidence shows only proprietary CUDA toolkit and NVIDIA AI Enterprise stack; nothing about open-source kernel modules (nvidia-open) or upstream Linux driver support is documented in the pack. Missing for 10: any mention of NVIDIA's open GPU kernel modules, upstream mainline Linux driver support, or open-source driver documentation for the H200.
- [claimed-docs] “With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data …”
- [claimed-docs] “NVIDIA Nsight Compute and Nsight System suite of tools designed to help developers optimize and increase performance of their applications.”
AMD Instinct MI355Xnone0/10The evidence pack extensively documents ROCm's open-source user-space stack (libraries, runtimes, tools, monitoring, Kubernetes operator) but never mentions the amdgpu kernel driver, its open-source licensing, or upstream Linux kernel inclusion — the specific claim this story asks about is absent. Missing for 10: any vendor documentation of open-source kernel modules, upstream kernel driver support, or distro-inclusion status for the MI355X.
Gaming performance — stories about gaming performance in this arenaGaming performance
Stories about gaming performance in this arena
4k gaming
gamerThis card drives high-refresh 4K gaming — vendor performance claims corroborated by independent game benchmarks
weight 3 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
Upscaling
gamerAI upscaling and frame generation are supported on this card — the DLSS or FSR generation is documented for this part, with broad game support
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
Memory vram — stories about memory vram in this arenaMemory vram
Stories about memory vram in this arena
Llm memory
ai-native userRun a 70B-class quantized LLM on this GPU — published VRAM capacity and memory bandwidth that make local or single-node inference practical
weight 3 · round to NVIDIA H200 (SXM)NVIDIA docs confirm 141GB HBM3e at 4.8TB/s, comfortably fitting a 70B-class quantized model with large batch/context headroom, and this is corroborated by an independent runtime probe and community benchmarks showing real-world inference (e.g., Llama 405B at 142 tok/s) on H200 SXM. Missing for 10: independent hands-on benchmark specifically for a 70B-class quantized model rather than larger models.
- [claimed-docs] “the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s)”
- [community] “Llama 405B up to 142 tok/s on Nvidia H200 SXM — launched a production grade API endpoint at $3 per million tokens, made possible by H200 SXM…”
- [probe] “PROBE runtime (recorded 2026-09-15): NVIDIA's H200 datacenter page answered a keyless curl and names the part — the spec table (141GB HBM3e,…”
AMD publishes 288GB HBM3E capacity and 8TB/s bandwidth for MI355X, far exceeding what's needed for 70B-class quantized inference, and documents vLLM/SGLang inference stacks for deployment; independent analysis corroborates the memory capacity/bandwidth lead over competing accelerators. Missing for 10: no direct hands-on benchmark or published throughput numbers specifically for a 70B model at a given quantization on this GPU.
- [claimed-docs] “AMD Instinct™ MI355X GPUs deliver leadership AI and HPC performance enabling high density infrastructures with 288GB HBM3E memory, 8TB/s ban…”
- [claimed-docs] “Inference * [vLLM](https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/inference/vllm.html) * [SGLang](https://rocm.docs.amd.com/…”
- [community] “MI355X's HBM3E subsystem gives it 288GB capacity at 8 TB/s vs Nvidia B200's 180GB at 7.7 TB/s, maintaining AMD's memory capacity/bandwidth l…”
Memory spec
ml engineerMemory specs are published in full for this exact part — capacity, memory type, bus width, and bandwidth
weight 2 · round drawnNVIDIA's official H200 page publishes capacity (141GB), memory type (HBM3e), and bandwidth (4.8TB/s), and a runtime probe confirms this spec table is live and fetchable; independent commentary also confirms it's HBM3e stacks on the H100 die. However, memory bus width is never stated anywhere in the evidence pack. Missing for 10: explicit memory bus-width figure, and any independent/third-party spec-sheet corroboration beyond NVIDIA's own page.
- [claimed-docs] “the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s)”
- [probe] “PROBE runtime (recorded 2026-09-15): NVIDIA's H200 datacenter page answered a keyless curl and names the part — the spec table (141GB HBM3e,…”
- [community] “The H200 GPU die is the same as the H100, but it's using a full set of faster 24GB memory stacks... This is an H100 141GB, not new silicon l…”
AMD's official product page confirms capacity (288GB), memory type (HBM3E), and bandwidth (8TB/s) for the MI355X, corroborated independently by chipsandcheese's comparison data. However, no evidence anywhere states the memory bus width. missing for 10: published bus width (bits) for the HBM3E memory subsystem.
- [claimed-docs] “AMD Instinct™ MI355X GPUs deliver leadership AI and HPC performance enabling high density infrastructures with 288GB HBM3E memory, 8TB/s ban…”
- [community] “MI355X's HBM3E subsystem gives it 288GB capacity at 8 TB/s vs Nvidia B200's 180GB at 7.7 TB/s, maintaining AMD's memory capacity/bandwidth l…”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userRead the product's source under an open license
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
ai-native userSelf-host the core product
weight 3 · round to AMD Instinct MI355XThe H200 is physical hardware you purchase/own and deploy in your own datacenter or colo, making self-hosting the core product inherently possible (unlike SaaS AI products), and NVIDIA's stack (CUDA toolkit, drivers, Nsight tools) supports fully on-prem deployment across data centers and workstations. missing for 10: no direct documentation of an on-prem purchase/procurement path or hands-on self-hosting case study, and no independent report confirming ease of self-managed deployment outside of cloud providers.
- [claimed-docs] “With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data …”
- [claimed-docs] “NVIDIA Nsight Compute and Nsight System suite of tools designed to help developers optimize and increase performance of their applications.”
- [claimed-docs] “the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s)”
- [community] “Llama 405B up to 142 tok/s on Nvidia H200 SXM — launched a production grade API endpoint at $3 per million tokens, made possible by H200 SXM…”
The MI355X is sold as on-prem hardware, and AMD provides a full deployment stack for self-hosting: ROCm runtime/libraries, GPU Operator for Kubernetes, AMD Container Toolkit for Docker, Cluster Validation Suite, Device Metrics Exporter, and the Spur scheduler, all documented for running the GPU in a customer-owned datacenter. Community commentary corroborates real-world self-hosted comparisons (e.g., wafer.ai benchmarks) confirming the hardware is deployed and operated independently by third parties. Missing for 10: independent hands-on report specifically walking through a full self-host bring-up (rather than benchmark-only) confirming ease of deployment.
- [claimed-docs] “GPU Operator Deploy and manage Instinct GPUs in Kubernetes clusters.”
- [claimed-docs] “AMD Container Toolkit Integrate Instinct GPUs with Docker and container runtimes.”
- [claimed-docs] “Cluster Validation Suite Test scripts that validate AMD AI clusters end to end.”
- [claimed-docs] “Device Metrics Exporter Prometheus-format GPU metrics for HPC and AI environments.”
- [claimed-docs] “Spur AI-native job scheduler, drop-in compatible with Slurm, with GPU-first scheduling and Raft-based state.”
- [community] “On every row the B300 beat the MI355X in a wafer.ai comparison; critics say the price comparison (MI355X at $2.5/hr) is unrealistic since no…”
Power cooling — stories about power cooling in this arenaPower cooling
Stories about power cooling in this arena
Efficiency
ml engineerSustained workloads are power-efficient on this part — documented power envelopes with independent performance-per-watt testing
weight 2 · round to NVIDIA H200 (SXM)NVIDIA's own docs state the H200 operates 'within the same power profile as the H100' (nvidia-h200-sxm-docs-4), but this is a vendor claim only — no independent performance-per-watt benchmarks or third-party power-envelope testing are present in the evidence pack. Community notes (nvidia-h200-sxm-comm-2) even highlight that H200 shares H100 silicon, which is consistent but not an efficiency benchmark. Missing for 10: independent/hands-on power-draw measurements under sustained load, third-party perf/watt comparisons, and detailed thermal/power documentation beyond the single marketing sentence.
- [claimed-docs] “This cutting-edge technology offers unparalleled performance, all within the same power profile as the H100.”
- [community] “The H200 GPU die is the same as the H100, but it's using a full set of faster 24GB memory stacks... This is an H100 141GB, not new silicon l…”
AMD Instinct MI355Xnone0/10The evidence pack lacks any documented TDP/power envelope specs or independent performance-per-watt benchmarking for the MI355X; community sources focus on raw throughput and memory bandwidth comparisons (chipsandcheese, wafer.ai) but never normalize for power draw. Missing for 10: official power envelope/TDP documentation, independent perf-per-watt benchmarks, sustained-workload thermal/power test data.
- [community] “Compared to Nvidia's B200 SMs, CDNA 4 CUs have half the per-clock throughput across many 16-bit/8-bit data types; AMD still relies on a bigg…”
- [community] “MI355X's HBM3E subsystem gives it 288GB capacity at 8 TB/s vs Nvidia B200's 180GB at 7.7 TB/s, maintaining AMD's memory capacity/bandwidth l…”
- [community] “On every row the B300 beat the MI355X in a wafer.ai comparison; critics say the price comparison (MI355X at $2.5/hr) is unrealistic since no…”
Psu planning
gamerSpec a build around published board power — TDP/TGP, connector requirements, and cooling guidance for this exact card
weight 2 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userPrevent my data from being used to train AI models
weight 3 · round drawnNVIDIA H200 (SXM)none0/10The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)
Software toolchain — stories about software toolchain in this arenaSoftware toolchain
Stories about software toolchain in this arena
Compute stack
developerShip GPU-compute workloads on the vendor's toolchain — CUDA or ROCm/HIP documentation lists this part as a supported target
weight 3 · round to AMD Instinct MI355XCUDA Toolkit is NVIDIA's standard GPU-compute toolchain, explicitly documented as supporting deployment across data centers and supercomputers, and H200 is the current flagship data-center GPU in this same product family/lineage; community evidence (production LLM inference deployments on H200 SXM) confirms real-world CUDA-based workloads running on this part. Missing for 10: no explicit CUDA compute-capability/architecture list page directly naming 'H200' as a supported gpu-architecture target string, and no ROCm angle (not applicable to NVIDIA anyway).
- [claimed-docs] “With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data …”
- [claimed-docs] “NVIDIA Nsight Compute and Nsight System suite of tools designed to help developers optimize and increase performance of their applications.”
- [community] “Llama 405B up to 142 tok/s on Nvidia H200 SXM — launched a production grade API endpoint at $3 per million tokens, made possible by H200 SXM…”
- [probe] “PROBE runtime (recorded 2026-09-15): NVIDIA's H200 datacenter page answered a keyless curl and names the part — the spec table (141GB HBM3e,…”
ROCm documentation explicitly covers HIP runtime, libraries, frameworks, and inference stacks (vLLM, SGLang) targeting Instinct GPUs, and Instinct-specific docs list HIP C++, OpenMP, and other toolchain components for the MI355X line, confirming it as a supported ROCm/HIP target. missing for 10: no explicit MI355X-named code sample or compatibility matrix entry pinpointing this exact SKU rather than the Instinct family generally.
- [claimed-docs] “The foundational libraries, runtimes, and tools for GPU computing on AMD hardware — math and compute libraries, communication primitives, HI…”
- [claimed-docs] “Inference * [vLLM](https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/inference/vllm.html) * [SGLang](https://rocm.docs.amd.com/…”
- [claimed-docs] “HIP C++ Learn the HIP programming model.”
- [claimed-docs] “OpenMP Explore the OpenMP programming model.”
- [probe] “PROBE runtime (recorded 2026-09-15): the ROCm documentation at rocm.docs.amd.com answered a keyless curl naming ROCm — the MI355X's entire d…”
Frameworks
ml engineerPyTorch and mainstream ML frameworks run on this GPU through officially documented builds and support matrices
weight 2 · round to AMD Instinct MI355XNVIDIA documents CUDA Toolkit support for developing/deploying GPU-accelerated applications and community evidence (HN inference benchmark) shows PyTorch-based LLM workloads (Llama 405B) running in production on H200 SXM, implying framework compatibility via CUDA. However, there is no direct citation of an official PyTorch/TensorFlow support matrix or explicit framework-version compatibility documentation for H200 specifically. Missing for 10: explicit PyTorch/TensorFlow official support matrix naming H200, CUDA/cuDNN version compatibility table, first-party framework installation guide referencing H200.
- [claimed-docs] “With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data …”
- [claimed-docs] “NVIDIA Nsight Compute and Nsight System suite of tools designed to help developers optimize and increase performance of their applications.”
- [community] “Llama 405B up to 142 tok/s on Nvidia H200 SXM — launched a production grade API endpoint at $3 per million tokens, made possible by H200 SXM…”
AMD documents ROCm-enabled framework support with specific recipes for PyTorch-adjacent ML stacks and inference frameworks (vLLM, SGLang) tied to Instinct GPUs, backed by a live, crawlable documentation surface. Missing for 10: an explicit official PyTorch build/support-matrix page or version-compatibility table directly citing PyTorch, and independent hands-on confirmation of PyTorch working smoothly on MI355X specifically (only general software-support skepticism exists in community commentary).
- [claimed-docs] “Full-stack documentation and recipes to deploy AI workloads on AMD GPUs using popular ROCm-enabled frameworks.”
- [claimed-docs] “Inference * [vLLM](https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/inference/vllm.html) * [SGLang](https://rocm.docs.amd.com/…”
- [claimed-docs] “The foundational libraries, runtimes, and tools for GPU computing on AMD hardware — math and compute libraries, communication primitives, HI…”
- [probe] “PROBE runtime (recorded 2026-09-15): the ROCm documentation at rocm.docs.amd.com answered a keyless curl naming ROCm — the MI355X's entire d…”
- [community] “On the MI355X (288GB HBM3E) and MI325X announcement, a commenter noted AMD's pricing looks good vs Nvidia H100/B100 at around $15k, but expr…”
Not comparable on these axes
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU accelerator, not an AI agent or assistant capable of plugging in MCP servers to use their tools; this axis is a category error for a physical compute product.
AMD Instinct MI355Xn/aMI355X is a hardware accelerator (GPU) with a software/driver stack (ROCm); MCP server plug-in for tool use is an AI-agent/application-layer concept that doesn't apply to a hardware product's own capabilities. This is a category error—no GPU hardware ships MCP server support directly.
ai-native userConnect an agent via an official MCP server
weight 3 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU product, not an agent or software platform that could expose an MCP server; connecting agents via MCP is a wrong axis for a datacenter accelerator.
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · not comparableNVIDIA H200 (SXM)n/aH200 is a hardware GPU product, not an API/service platform issuing credentials for agents; scoped API credential issuance is a wrong axis for a hardware accelerator.
ai-native userSubscribe to events via webhooks
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU product; webhooks/event subscriptions are a software/platform API concept that does not apply to a physical accelerator SKU.
ai-native userSet up automations that run autonomously in the background
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU accelerator, not an automation/orchestration platform; setting up autonomous background automations is an application-layer/software capability entirely outside the scope of a data-center GPU product.
AMD Instinct MI355Xn/aMI355X is a hardware GPU accelerator; 'setting up autonomous background automations' is an application/agent-orchestration capability, not a fair axis for a hardware accelerator product category. The evidence covers job scheduling (Spur) and cluster management tools, but these are infrastructure/ops tools, not user-facing autonomous automation setups.
ai-native userExplore an interactive API reference with runnable examples
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU product, not an API/SaaS service; an interactive API reference with runnable examples is not a fair axis for a physical accelerator (this differs from CUDA toolkit docs, which are a separate developer tool, not the GPU itself).
AMD Instinct MI355Xnone0/10This is a hardware accelerator with ROCm software docs but no evidence of an interactive API reference with runnable examples — the OpenAPI probe returned 404s on all candidate paths and no interactive playground/notebook reference is mentioned.
ai-native userTest against a sandbox environment without touching production data
weight 1 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU product; sandbox-vs-production data testing is an application/software-layer concern, not a fair axis for a GPU accelerator itself.
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU product, not a software service with a versioned API; no such API/deprecation-policy axis applies to a physical accelerator card.
AMD Instinct MI355Xnone0/10Evidence covers ROCm/Instinct software stack (HIP, libraries, tools) but nowhere documents API versioning semantics or a deprecation policy; probes explicitly show no OpenAPI/spec discoverable. Axis is plausible for the ROCm developer stack but unevidenced.
- [claimed-docs] “The foundational libraries, runtimes, and tools for GPU computing on AMD hardware — math and compute libraries, communication primitives, HI…”
- [probe] “PROBE openapi: all candidate paths 404 (https://rocm.docs.amd.com/openapi.json, https://rocm.docs.amd.com/swagger.json, https://rocm.docs.am…”
- [probe] “PROBE llms.txt: HTTP 200 at https://rocm.docs.amd.com/llms.txt # ROCm documentation > Note: ROCm documentation is split across multiple pro…”
ai-native userDefine rules that trigger actions automatically on events
weight 3 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU/accelerator; rule-based event-triggered automation is a software/application-layer feature entirely outside the scope of a physical GPU product's capabilities.
AMD Instinct MI355Xn/aMI355X is a hardware GPU accelerator; event-driven rule automation is an application/orchestration-layer concern, not a fair axis for a GPU product itself. Nothing in the evidence (monitoring, metrics exporter, scheduler) constitutes user-defined event-trigger rules, so this is a category mismatch rather than a gap.
ai-native userVersion, review, and roll back my automations
weight 1 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU product; versioning, reviewing, and rolling back automations is a software/workflow-orchestration concern entirely outside a hardware accelerator's scope.
ai-native userDo everything through the API that I can do in the UI
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a physical GPU/hardware product with no user-facing UI or API of its own — it's accessed via drivers, CUDA, and third-party platforms. The 'API vs UI parity' story is a category error for a hardware accelerator.
ai-native userExport all of my data in open formats and leave
weight 3 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU accelerator, not a data platform or SaaS application that stores user data subject to export/lock-in concerns; data portability/exit is not an applicable axis for a compute chip.
ai-native userChoose where my data is stored (region/residency)
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU/chip, not a hosted data storage or cloud service; data residency/region selection is a deployment-layer concern determined by whoever operates the data center, not a property of the GPU itself. This axis is a category error for a hardware product.
AMD Instinct MI355Xn/aMI355X is a hardware GPU accelerator sold to data centers/cloud providers; data residency/region selection is a deployment/cloud-service concern controlled by whoever operates the infrastructure, not a capability of the chip or its software stack itself. This is a category error for a hardware product axis.
ai-native userControl data retention and deletion
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU accelerator, not a data service or platform that stores/retains user data; data retention/deletion controls are a SaaS/application-layer concern handled by whatever software stack runs on top of the GPU, not by the chip itself.
AMD Instinct MI355Xn/aMI355X is a hardware accelerator/chip product, not a data-handling SaaS or service with user data retention policies; data retention/deletion controls are a category error for a GPU hardware product's own axis (though the operator running workloads on it would manage such policies).
ai-native userOpt out of telemetry and usage tracking
weight 2 · not comparableNVIDIA H200 (SXM)n/aThe H200 is a hardware GPU accelerator, not a software service or agent that collects usage telemetry from end users; telemetry opt-out is not a meaningful axis for a physical chip product.