NVIDIA H100 PCIe 80 GB vs NVIDIA H200 SXM 141 GB

GPU Specs Compare

G

NVIDIA H100 PCIe 80 GB

NVIDIA 2022-10
G

NVIDIA H200 SXM 141 GB

NVIDIA 2024-11

Graphics Card

Release Date
Oct 2022
Nov 2024
Generation
Server Hopper
Server Hopper
Type
AI GPU
AI GPU
Bus Interface
PCIe 5.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1095 MHz
1500 MHz
Boost Clock
1755 MHz
1980 MHz
Memory Clock
1593 MHz
1593 MHz

Memory

Memory Size
80GB
141GB
Memory Type
HBM2e
HBM3e
Memory Bus
5120bit
6144bit
Bandwidth
2.04TB/s
4.89TB/s

Render Config

SM Count
114
132
Shading Units
14592
16896
TMUs
456
528
ROPs
24
24
Tensor Cores
456
528
L1 Cache
256 KB (per SM)
256 KB (per SM)
L2 Cache
50 MB
50 MB

Theoretical Performance

Pixel Rate
42.12 GPixel/s
47.52 GPixel/s
Texture Rate
800.3 GTexel/s
1045.4 GTexel/s
FP16 (half)
204.9 TFLOPS
267.6 TFLOPS
FP32 (float)
51.22 TFLOPS
66.91 TFLOPS
FP64 (double)
25.61 TFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
GH100
GH100
Architecture
Hopper
Hopper
Foundry
TSMC
TSMC
Process Size
5 nm
5 nm
Transistors
80 billion
80 billion
Die Size
814 mm²
814 mm²

Board Design

TDP
350W
700W
Suggested PSU
750 W
1100 W
Outputs
No outputs
No outputs
Power Connectors
1x 16-pin
8-pin EPS

Graphics Features

DirectX
N/A
N/A
OpenGL
N/A
N/A
OpenCL
3.0
3.0
Vulkan
N/A
N/A
CUDA
9.0
9.0
Shader Model
N/A
N/A