NVIDIA H200 NVL vs NVIDIA GeForce RTX 2080 Ti

GPU Specs Compare

G

NVIDIA H200 NVL

NVIDIA 2024-11

Graphics Card

Release Date
Nov 2024
Sep 2018
Generation
Server Hopper
GeForce 20
Type
AI GPU
Desktop
Bus Interface
PCIe 5.0 x16
PCIe 3.0 x16

Clock Speeds

Base Clock
1365 MHz
1350 MHz
Boost Clock
1785 MHz
1545 MHz
Memory Clock
1593 MHz
1750 MHz

Memory

Memory Size
141GB
11GB
Memory Type
HBM3e
GDDR6
Memory Bus
6144bit
352bit
Bandwidth
4.89TB/s
616.0GB/s

Render Config

SM Count
132
68
Shading Units
16896
4352
TMUs
528
272
ROPs
24
88
Tensor Cores
528
544
L1 Cache
256 KB (per SM)
64 KB (per SM)
L2 Cache
50 MB
0 MB
RT Cores
-
68

Theoretical Performance

Pixel Rate
42.84 GPixel/s
136.0 GPixel/s
Texture Rate
942.5 GTexel/s
420.2 GTexel/s
FP16 (half)
241.3 TFLOPS
26.90 TFLOPS
FP32 (float)
60.32 TFLOPS
13.45 TFLOPS
FP64 (double)
30.16 TFLOPS
420.2 GFLOPS

Graphics Processor

GPU Name
GH100
TU102
Architecture
Hopper
Turing
Foundry
TSMC
TSMC
Process Size
5 nm
12 nm
Transistors
80 billion
18.6 billion
Die Size
814 mm²
754 mm²
GPU Variant
-
TU102-300A-K1-A1

Board Design

TDP
600W
250W
Suggested PSU
1000 W
600 W
Outputs
No outputs
1x HDMI 2.03x DisplayPort 1.4a1x USB Type-C
Power Connectors
8-pin EPS
2x 8-pin

Graphics Features

DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.4
CUDA
9.0
7.5
Shader Model
N/A
6.8