NVIDIA GeForce RTX 3060 Ti GDDR6X vs NVIDIA H100 SXM5 94 GB

GPU Specs Compare

Graphics Card

Release Date
Oct 2022
Mar 2023
Generation
GeForce 30
Server Hopper
Type
Desktop
AI GPU
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1410 MHz
1350 MHz
Boost Clock
1665 MHz
1980 MHz
Memory Clock
1188 MHz
1313 MHz

Memory

Memory Size
8GB
94GB
Memory Type
GDDR6X
HBM3
Memory Bus
256bit
5120bit
Bandwidth
608.3GB/s
3.36TB/s

Render Config

SM Count
38
132
Shading Units
4864
16896
TMUs
152
528
ROPs
80
24
Tensor Cores
152
528
RT Cores
38
-
L1 Cache
128 KB (per SM)
256 KB (per SM)
L2 Cache
4 MB
50 MB

Theoretical Performance

Pixel Rate
133.2 GPixel/s
47.52 GPixel/s
Texture Rate
253.1 GTexel/s
1045.4 GTexel/s
FP16 (half)
16.20 TFLOPS
267.6 TFLOPS
FP32 (float)
16.20 TFLOPS
66.91 TFLOPS
FP64 (double)
253.1 GFLOPS
33.45 TFLOPS

Graphics Processor

GPU Name
GA104
GH100
GPU Variant
GA104-202-A1
-
Architecture
Ampere
Hopper
Foundry
Samsung
TSMC
Process Size
8 nm
5 nm
Transistors
17.4 billion
80 billion
Die Size
392 mm²
814 mm²

Board Design

TDP
225W
700W
Suggested PSU
550 W
1100 W
Outputs
1x HDMI 2.13x DisplayPort 1.4a
No outputs
Power Connectors
1x 12-pin
8-pin EPS

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.6
9.0
Shader Model
6.7
N/A

📊 Benchmark

3DMark Time Spy
12,223
-
3DMark Time Spy Extreme
5,941
-
3DMark Speed Way
3,097
-