NVIDIA A100 PCIe 80 GB vs NVIDIA GeForce RTX 4090

GPU Specs Compare

G

NVIDIA A100 PCIe 80 GB

NVIDIA 2021-06
G

NVIDIA GeForce RTX 4090

NVIDIA 2022-09

Graphics Card

Release Date
Jun 2021
Sep 2022
Generation
Tesla Ampere(Axx)
GeForce 40
Type
Professional
Desktop
Bus Interface
PCIe 4.0 x16
PCIe 4.0 x16

Clock Speeds

Base Clock
1065 MHz
2235 MHz
Boost Clock
1410 MHz
2520 MHz
Memory Clock
1512 MHz
1313 MHz

Memory

Memory Size
80GB
24GB
Memory Type
HBM2e
GDDR6X
Memory Bus
5120bit
384bit
Bandwidth
1.94TB/s
1.01TB/s

Render Config

SM Count
108
128
Shading Units
6912
16384
TMUs
432
512
ROPs
160
176
Tensor Cores
432
512
L1 Cache
192 KB (per SM)
128 KB (per SM)
L2 Cache
80 MB
72 MB
RT Cores
-
128

Theoretical Performance

Pixel Rate
225.6 GPixel/s
443.5 GPixel/s
Texture Rate
609.1 GTexel/s
1290.2 GTexel/s
FP16 (half)
77.97 TFLOPS
82.58 TFLOPS
FP32 (float)
19.49 TFLOPS
82.58 TFLOPS
FP64 (double)
9.746 TFLOPS
1290.2 GFLOPS

Graphics Processor

GPU Name
GA100
AD102
Architecture
Ampere
Ada Lovelace
Foundry
TSMC
TSMC
Process Size
7 nm
5 nm
Transistors
54.2 billion
76.3 billion
Die Size
826 mm²
609 mm²
GPU Variant
-
AD102-300-A1

Board Design

TDP
300W
450W
Suggested PSU
700 W
850 W
Outputs
No outputs
1x HDMI 2.13x DisplayPort 1.4a
Power Connectors
8-pin EPS
1x 16-pin

Graphics Features

DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.4
CUDA
8.0
8.9
Shader Model
N/A
6.8

📊 Benchmark

OctaneBench
310
-
Blender
3,722
-