H100 SXM5 96 GB

Hopper NVIDIA H-Series Data Center Server HBM3 2023 NVIDIA

Key Metrics

Launch Date: 2023-03-21
CUDA Cores: 16,896
Memory: 96 GB HBM3
Memory Bandwidth: 3,360 GB/s
TDP/TBP: 700 W
Interface: PCIe 5.0 x16

Save this GPU, then open another GPU page to compare them side by side.

GPU Specs

Identity
Entry Type	Data Center GPU
Official Name	NVIDIA H100 SXM5 96 GB
GPU Codename	GH100
Architecture	Hopper
Launch Date	2023-03-21
Market Segment Notes	Data Center in NVIDIA H-Series
Core Specs
GPU Die	GH100
Process Node	TSMC 5 nm
Transistor Count	80 billion
Die Size	814 mm²
CUDA Cores	16896
SM Count	132
TMUs	528
ROPs	24
AI Units / Tensor Cores	528
Base Clock	1,350 MHz
Boost Clock	1,980 MHz
Pixel Fillrate	47.52 GP/s
Texture Fillrate	1045.4 GT/s
FP32 Throughput	66.91 TFLOPS
FP16 Throughput	267.6 TFLOPS
FP64 Throughput	33.45 TFLOPS
Memory
Memory Size	96 GB
Memory Type	HBM3
Memory Bus Width	5,120-bit
Memory Clock	1,313 MHz
Memory Bandwidth	3,360 GB/s
L2 Cache	50 MB
L1 Cache	250 KB
Board and Display
TDP / TBP	700 W
Recommended PSU	1,100 W
Power Connectors	8-pin EPS
Interface	PCIe 5.0 x16
Slot Width	SXM Module
Board Partner Model	Reference or OEM specification
Reference Design	NVIDIA reference design
Software
CUDA Compute Capability	9.0
OpenCL Support	OpenCL 3.0

Why It Mattered

H100 SXM5 96 GB belongs to the Hopper data-center generation, where transformer acceleration, HBM capacity, interconnect, and server form factor matter more than display features. It is tracked separately so accelerator buyers can distinguish PCIe, SXM, and OEM configurations.

Sources

Independent reference sources

TechPowerUp GPU SpecsModel-level specification reference for this GPU entryOpen source

Reference databases

RightNow GPU DatabaseOpen GPU database used to cross-check specifications A reference database: good for cross-checking specifications, but not proof of the original release details on its own.Open source

Why It Mattered

H100 CNX

H100 NVL 94 GB

H100 PCIe 80 GB

H100 PCIe 96 GB

Independent reference sources

Reference databases