NVIDIA GeForce RTX 3070 Ti vs NVIDIA H200 NVL

GPU Specs Compare

G

NVIDIA H200 NVL

NVIDIA 2024-11

Graphics Card

Release Date
May 2021
Nov 2024
Generation
GeForce 30
Server Hopper
Type
Desktop
AI GPU
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1575 MHz
1365 MHz
Boost Clock
1770 MHz
1785 MHz
Memory Clock
1188 MHz
1593 MHz

Memory

Memory Size
8GB
141GB
Memory Type
GDDR6X
HBM3e
Memory Bus
256bit
6144bit
Bandwidth
608.3GB/s
4.89TB/s

Render Config

SM Count
48
132
Shading Units
6144
16896
TMUs
192
528
ROPs
96
24
Tensor Cores
192
528
RT Cores
48
-
L1 Cache
128 KB (per SM)
256 KB (per SM)
L2 Cache
4 MB
50 MB

Theoretical Performance

Pixel Rate
169.9 GPixel/s
42.84 GPixel/s
Texture Rate
339.8 GTexel/s
942.5 GTexel/s
FP16 (half)
21.75 TFLOPS
241.3 TFLOPS
FP32 (float)
21.75 TFLOPS
60.32 TFLOPS
FP64 (double)
339.8 GFLOPS
30.16 TFLOPS

Graphics Processor

GPU Name
GA104
GH100
GPU Variant
GA104-400-A1
-
Architecture
Ampere
Hopper
Foundry
Samsung
TSMC
Process Size
8 nm
5 nm
Transistors
17.4 billion
80 billion
Die Size
392 mm²
814 mm²

Board Design

TDP
290W
600W
Suggested PSU
600 W
1000 W
Outputs
1x HDMI 2.13x DisplayPort 1.4a
No outputs
Power Connectors
1x 12-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.6
9.0
Shader Model
6.6
N/A

📊 Benchmark

3DMark Time Spy
14,872
-
3DMark Time Spy Extreme
7,416
-
3DMark Speed Way
3,761
-