H100 NVL 94 GB

Key Metrics

Launch Date
2023-03-21
CUDA Cores
16,896
Memory
94 GB HBM3
Memory Bandwidth
3,940 GB/s
TDP/TBP
400 W
Interface
PCIe 5.0 x16
Add to comparison

Save this GPU, then open another GPU page to compare them side by side.

Why It Mattered

H100 NVL 94 GB belongs to the Hopper data-center generation, where transformer acceleration, HBM capacity, interconnect, and server form factor matter more than display features. It is tracked separately so accelerator buyers can distinguish PCIe, SXM, and OEM configurations.

Sources

Primary / manufacturer sources

  1. NVIDIA H100 NVL GPU product briefOfficial H100 NVL memory, power, and connector specificationsOpen source
  2. NVIDIA Launches Inference Platforms for Large Language Models and Generative AI WorkloadsOfficial March 21, 2023 launch explicitly naming both the NVIDIA L4 and H100 NVL GPUsOpen source

Independent reference sources

  1. TechPowerUp GPU SpecsModel-level specification reference for this GPU entryOpen source

Reference databases

  1. RightNow GPU DatabaseOpen GPU database used to cross-check specifications A reference database: good for cross-checking specifications, but not proof of the original release details on its own.Open source