NVIDIA GeForce RTX 3090 Ti vs H200 SXM

GPU Specs Compare

G

H200 SXM

2023-11

Graphics Card

Release Date
Jan 2022
Nov 2023
Generation
GeForce 30
Hopper
Type
Desktop
AI GPU
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1560 MHz
1590 MHz
Boost Clock
1860 MHz
1980 MHz
Memory Clock
1313 MHz
1313 MHz

Memory

Memory Size
24GB
141GB
Memory Type
GDDR6X
HBM3e
Memory Bus
384bit
5120bit
Bandwidth
1.01TB/s
4800GB/s

Render Config

SM Count
84
132
Shading Units
10752
16896
TMUs
336
528
ROPs
112
24
Tensor Cores
336
528
RT Cores
84
-
L1 Cache
128 KB (per SM)
256 KB (per SM)
L2 Cache
6 MB
50 MB

Theoretical Performance

Pixel Rate
208.3 GPixel/s
47.52 GPixel/s
Texture Rate
625.0 GTexel/s
1045 GTexel/s
FP16 (half)
40.00 TFLOPS
1979 TFLOPS
FP32 (float)
40.00 TFLOPS
67 TFLOPS
FP64 (double)
625.0 GFLOPS
34 TFLOPS

Graphics Processor

GPU Name
GA102
GH200
GPU Variant
GA102-350-A1
-
Architecture
Ampere
Hopper
Foundry
Samsung
TSMC
Process Size
8 nm
4 nm
Transistors
28.3 billion
80 billion
Die Size
628 mm²
814 mm²

Board Design

TDP
450W
700W
Suggested PSU
850 W
1100 W
Outputs
1x HDMI 2.13x DisplayPort 1.4a
No outputs
Power Connectors
1x 16-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.4
N/A
CUDA
8.6
9.0
Shader Model
6.8
N/A

📊 Benchmark

3DMark Time Spy
21,832
-
3DMark Time Spy Extreme
11,318
-
3DMark Speed Way
5,903
-
Blender
6,217
-