NVIDIA H100 PCIe 80 GB vs NVIDIA GeForce RTX 3060 Max Q
GPU Specs Compare
Graphics Card
Release Date
Oct 2022
Jan 2021
Generation
Server Hopper
GeForce 30 Mobile
Type
AI GPU
Mobile
Bus Interface
PCIe 5.0 x16
PCIe 4.0 x16
Clock Speeds
Base Clock
1095 MHz
817 MHz
Boost Clock
1755 MHz
1282 MHz
Memory Clock
1593 MHz
1500 MHz
Memory
Memory Size
80GB
6GB
Memory Type
HBM2e
GDDR6
Memory Bus
5120bit
192bit
Bandwidth
2.04TB/s
288.0GB/s
Render Config
SM Count
114
30
Shading Units
14592
3840
TMUs
456
120
ROPs
24
48
Tensor Cores
456
120
L1 Cache
256 KB (per SM)
128 KB (per SM)
L2 Cache
50 MB
3 MB
RT Cores
-
30
Theoretical Performance
Pixel Rate
42.12 GPixel/s
61.54 GPixel/s
Texture Rate
800.3 GTexel/s
153.8 GTexel/s
FP16 (half)
204.9 TFLOPS
9.846 TFLOPS
FP32 (float)
51.22 TFLOPS
9.846 TFLOPS
FP64 (double)
25.61 TFLOPS
153.8 GFLOPS
Graphics Processor
GPU Name
GH100
GA106
Architecture
Hopper
Ampere
Foundry
TSMC
Samsung
Process Size
5 nm
8 nm
Transistors
80 billion
12 billion
Die Size
814 mm²
276 mm²
Board Design
TDP
350W
60W
Suggested PSU
750 W
-
Outputs
No outputs
No outputs
Power Connectors
1x 16-pin
None
Graphics Features
DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.3
CUDA
9.0
8.6
Shader Model
N/A
6.6