NVIDIA A100 SXM4 80 GB vs AMD Radeon Instinct MI350X

GPU Specs Compare

Graphics Card

Release Date
Nov 2020
Jun 2025
Generation
Tesla Ampere
Radeon Instinct
Type
AI GPU
Professional
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
1275 MHz
1000 MHz
Boost Clock
1410 MHz
2200 MHz
Memory Clock
1593 MHz
2000 MHz

Memory

Memory Size
80GB
288GB
Memory Type
HBM2e
HBM3e
Memory Bus
5120bit
8192bit
Bandwidth
2039GB/s
8.19TB/s

Render Config

SM Count
108
-
Shading Units
6912
16384
TMUs
432
1024
ROPs
160
0
Tensor Cores
432
1024
L1 Cache
192 KB (per SM)
16 KB (per CU)
L2 Cache
40 MB
16 MB
Compute Units
-
256
L3 Cache
-
256 MB

Theoretical Performance

Pixel Rate
225.6 GPixel/s
0 MPixel/s
Texture Rate
609.1 GTexel/s
2252.8 GTexel/s
FP16 (half)
77.97 TFLOPS
72.09 TFLOPS
FP32 (float)
19.49 TFLOPS
72.09 TFLOPS
FP64 (double)
9.746 TFLOPS
36.04 TFLOPS

Graphics Processor

GPU Name
GA100
MI350 256CU
Architecture
Ampere
CDNA 4.0
Foundry
TSMC
TSMC
Process Size
7 nm
3 nm
Transistors
54.2 billion
185 billion
Die Size
826 mm²
Unknown

Board Design

TDP
400W
1000W
Suggested PSU
800 W
1400 W
Outputs
No outputs
No outputs
Power Connectors
None
None

Graphics Features

DirectX
N/A
N/A
OpenGL
N/A
N/A
OpenCL
3.0
3.0
Vulkan
N/A
N/A
CUDA
8.0
-
Shader Model
N/A
N/A