NVIDIA RTX 5000 Ada Generation vs NVIDIA H200 NVL

GPU Specs Compare

G

NVIDIA H200 NVL

NVIDIA 2024-11

Graphics Card

Release Date
Aug 2023
Nov 2024
Generation
Quadro Ada
Server Hopper
Type
Desktop
AI GPU
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1155 MHz
1365 MHz
Boost Clock
2550 MHz
1785 MHz
Memory Clock
2250 MHz
1593 MHz

Memory

Memory Size
32GB
141GB
Memory Type
GDDR6
HBM3e
Memory Bus
256bit
6144bit
Bandwidth
576.0GB/s
4.89TB/s

Render Config

SM Count
100
132
Shading Units
12800
16896
TMUs
400
528
ROPs
176
24
Tensor Cores
400
528
RT Cores
100
-
L1 Cache
128 KB (per SM)
256 KB (per SM)
L2 Cache
72 MB
50 MB

Theoretical Performance

Pixel Rate
448.8 GPixel/s
42.84 GPixel/s
Texture Rate
1020 GTexel/s
942.5 GTexel/s
FP16 (half)
65.28 TFLOPS
241.3 TFLOPS
FP32 (float)
65.28 TFLOPS
60.32 TFLOPS
FP64 (double)
1020 GFLOPS
30.16 TFLOPS

Graphics Processor

GPU Name
AD102
GH100
GPU Variant
AD102
-
Architecture
Ada Lovelace
Hopper
Foundry
TSMC
TSMC
Process Size
5 nm
5 nm
Transistors
76.3 billion
80 billion
Die Size
609 mm²
814 mm²

Board Design

TDP
250W
600W
Suggested PSU
600 W
1000 W
Outputs
4x DisplayPort 1.4a
No outputs
Power Connectors
1x 16-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.9
9.0
Shader Model
6.7
N/A

📊 Benchmark

3DMark Time Spy
14,170
-
3DMark Time Spy Extreme
12,700
-
OctaneBench
816
-
3DMark Speed Way
6,473
-
Blender
6,013
-