NVIDIA H100 PCIe 96 GB vs AMD Radeon Pro 560

GPU Specs Compare

G

NVIDIA H100 PCIe 96 GB

NVIDIA 2023-03
G

AMD Radeon Pro 560

AMD 2017-04

Graphics Card

Release Date
Mar 2023
Apr 2017
Generation
Tesla Hopper
Radeon Pro Mac
Type
AI GPU
Mobile
Bus Interface
PCIe 5.0 x16
PCIe 3.0 x8

Clock Speeds

Base Clock
1665 MHz
-
Boost Clock
1837 MHz
-
Memory Clock
1313 MHz
1270 MHz

Memory

Memory Size
96GB
4GB
Memory Type
HBM3
GDDR5
Memory Bus
5120bit
128bit
Bandwidth
1681GB/s
81.28GB/s

Render Config

SM Count
132
-
Shading Units
16896
1024
TMUs
528
64
ROPs
24
16
Tensor Cores
528
-
L1 Cache
256 KB (per SM)
16 KB (per CU)
L2 Cache
50 MB
1024 KB
Compute Units
-
16

Theoretical Performance

Pixel Rate
44.09 GPixel/s
14.51 GPixel/s
Texture Rate
969.9 GTexel/s
58.05 GTexel/s
FP16 (half)
248.3 TFLOPS
1.858 TFLOPS
FP32 (float)
62.08 TFLOPS
1.858 TFLOPS
FP64 (double)
31.04 TFLOPS
116.1 GFLOPS

Graphics Processor

GPU Name
GH100
Polaris 21
Architecture
Hopper
GCN 4.0
Foundry
TSMC
GlobalFoundries
Process Size
4 nm
14 nm
Transistors
80 billion
3 billion
Die Size
814 mm²
123 mm²
GPU Variant
-
Polaris 21 XT(215-0908004)

Board Design

TDP
700W
75W
Suggested PSU
1100 W
-
Outputs
No outputs
No outputs
Power Connectors
8-pin EPS
None

Graphics Features

DirectX
N/A
12 (12_0)
OpenGL
N/A
4.6
OpenCL
3.0
2.1
Vulkan
N/A
1.2
CUDA
9.0
-
Shader Model
N/A
6.4