AMD Radeon Instinct MI25 vs NVIDIA H100 SXM5 96 GB
GPU Specs Compare
Graphics Card
Release Date
Jun 2017
Mar 2023
Generation
Radeon Instinct
Server Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 5.0 x16
Clock Speeds
Base Clock
1400 MHz
1350 MHz
Boost Clock
1500 MHz
1980 MHz
Memory Clock
852 MHz
1313 MHz
Memory
Memory Size
16GB
96GB
Memory Type
HBM2
HBM3
Memory Bus
2048bit
5120bit
Bandwidth
436.2GB/s
3.36TB/s
Render Config
Compute Units
64
-
Shading Units
4096
16896
TMUs
256
528
ROPs
64
24
L1 Cache
16 KB (per CU)
256 KB (per SM)
L2 Cache
4 MB
50 MB
SM Count
-
132
Tensor Cores
-
528
Theoretical Performance
Pixel Rate
96.00 GPixel/s
47.52 GPixel/s
Texture Rate
384.0 GTexel/s
1045 GTexel/s
FP16 (half)
24.58 TFLOPS
267.6 TFLOPS
FP32 (float)
12.29 TFLOPS
66.91 TFLOPS
FP64 (double)
768.0 GFLOPS
33.45 TFLOPS
Graphics Processor
GPU Name
Vega 10
GH100
GPU Variant
Vega 10 XT GL(215-0894124)
-
Architecture
GCN 5.0
Hopper
Foundry
GlobalFoundries
TSMC
Process Size
14 nm
5 nm
Transistors
12.5 billion
80 billion
Die Size
495 mm²
814 mm²
Board Design
TDP
300W
700W
Suggested PSU
700 W
1100 W
Outputs
No outputs
No outputs
Power Connectors
2x 8-pin
8-pin EPS
Graphics Features
DirectX
12 (12_1)
N/A
OpenGL
4.6
N/A
OpenCL
2.1
3.0
Vulkan
1.2
N/A
Shader Model
6.4
N/A
CUDA
-
9.0