NVIDIA A10M vs AMD Instinct MI300A

GPU Specs Compare

G

NVIDIA A10M

NVIDIA 2022-02
G

AMD Instinct MI300A

AMD 2023-12

Graphics Card

Release Date
Feb 2022
Dec 2023
Generation
Server Ampere
Radeon Instinct
Type
Professional
Professional
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16

Clock Speeds

Base Clock
975 MHz
1000 MHz
Boost Clock
1635 MHz
2100 MHz
Memory Clock
1563 MHz
1300 MHz

Memory

Memory Size
20GB
128GB
Memory Type
GDDR6
HBM3
Memory Bus
320bit
8192bit
Bandwidth
500.2GB/s
5.32TB/s

Render Config

SM Count
56
-
Shading Units
7168
14592
TMUs
224
912
ROPs
80
0
Tensor Cores
224
-
RT Cores
56
-
L1 Cache
128 KB (per SM)
16 KB (per CU)
L2 Cache
6 MB
16 MB
Compute Units
-
228
L3 Cache
-
256 MB

Theoretical Performance

Pixel Rate
130.8 GPixel/s
0 MPixel/s
Texture Rate
366.2 GTexel/s
1915.2 GTexel/s
FP16 (half)
23.44 TFLOPS
653.7 TFLOPS
FP32 (float)
23.44 TFLOPS
61.29 TFLOPS
FP64 (double)
732.5 GFLOPS
30.64 TFLOPS

Graphics Processor

GPU Name
GA102
Aqua Vanjaram
Architecture
Ampere
CDNA 3.0
Foundry
Samsung
TSMC
Process Size
8 nm
5 nm
Transistors
28.3 billion
153 billion
Die Size
628 mm²
1017 mm²

Board Design

TDP
150W
750W
Suggested PSU
450 W
1150 W
Outputs
No outputs
No outputs
Power Connectors
8-pin EPS
None

Graphics Features

DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.3
N/A
CUDA
8.6
-
Shader Model
6.8
N/A