GPU Wiki

Compare GPUs

Pick up to four GPUs and compare their specs row by row. Specs that mean different things across generations are kept apart.

Add a third or fourth GPU
Spec H100 NVL 94 GB
Overview
Product name NVIDIA H100 NVL 94 GB
Architecture Hopper
Generation / family NVIDIA H-Series
GPU codename GH100
Launch date 2023-03-21
Market segment Data Center in NVIDIA H-Series
Board type / entry type Data Center GPU
GPU
Process node TSMC 5 nm
Die size 814 mm²
Transistor count 80 billion
GPU chip GH100
SM / multiprocessor count 132
CUDA Cores 16896
Tensor Cores 528
ROPs 24
TMUs 528
Clocks
Base / Core clock 1,080 MHz
Boost clock 1,785 MHz
Memory clock 1,310 MHz
Memory
Memory size 94 GB
Memory type HBM3
Memory bus width 6,016-bit
Memory bandwidth 3,940 GB/s
Bus / Interface
Bus interface PCIe 5.0 x16
AGP / PCI / PCIe distinction PCIe
Power
TDP / TBP / board power 400 W
Recommended PSU 800 W
Power connectors 1x PCIe CEM5 16-pin
Slot width Dual-slot, 267 mm length
Features
CUDA support 9.0
Performance / Benchmarks
FP32 throughput 60.32 TFLOPS
FP16 throughput 241.3 TFLOPS
Muted cells indicate unavailable, not applicable, or not directly comparable specifications.

DLAA counts as native resolution; DLSS, FSR and XeSS upscaling never do. A ray tracing setting without a readable on or off value is read as on.