NVIDIA GeForce RTX 3080 12 GB vs NVIDIA H100 CNX

GPU Specs Compare

G

NVIDIA H100 CNX

NVIDIA 2023-03

Graphics Card

Release Date
Jan 2022
Mar 2023
Generation
GeForce 30
Tesla Hopper
Type
Desktop
AI GPU
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1260 MHz
690 MHz
Boost Clock
1710 MHz
1845 MHz
Memory Clock
1188 MHz
1593 MHz

Memory

Memory Size
12GB
80GB
Memory Type
GDDR6X
HBM2e
Memory Bus
384bit
5120bit
Bandwidth
912.4GB/s
2039GB/s

Render Config

SM Count
70
114
Shading Units
8960
14592
TMUs
280
456
ROPs
96
24
Tensor Cores
280
456
RT Cores
70
-
L1 Cache
128 KB (per SM)
256 KB (per SM)
L2 Cache
6 MB
50 MB

Theoretical Performance

Pixel Rate
164.2 GPixel/s
44.28 GPixel/s
Texture Rate
478.8 GTexel/s
841.3 GTexel/s
FP16 (half)
30.64 TFLOPS
215.4 TFLOPS
FP32 (float)
30.64 TFLOPS
53.84 TFLOPS
FP64 (double)
478.8 GFLOPS
26.92 TFLOPS

Graphics Processor

GPU Name
GA102
GH100
GPU Variant
GA102-220-A1
-
Architecture
Ampere
Hopper
Foundry
Samsung
TSMC
Process Size
8 nm
4 nm
Transistors
28.3 billion
80 billion
Die Size
628 mm²
814 mm²

Board Design

TDP
350W
350W
Suggested PSU
750 W
750 W
Outputs
1x HDMI 2.13x DisplayPort 1.4a
No outputs
Power Connectors
1x 12-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.6
9.0
Shader Model
6.8
N/A