NVIDIA Tesla K40d vs NVIDIA A100 PCIe
GPU Specs Compare
Graphics Card
Release Date
Nov 2013
Jun 2020
Generation
Tesla Kepler
Tesla
Type
Professional
AI GPU
Bus Interface
PCIe 3.0 x16
PCIe 4.0 x16
Clock Speeds
Base Clock
745 MHz
765 MHz
Boost Clock
876 MHz
1410 MHz
Memory Clock
1502 MHz
1215 MHz
Memory
Memory Size
12GB
40GB
Memory Type
GDDR5
HBM2e
Memory Bus
384bit
5120bit
Bandwidth
288.4GB/s
1555GB/s
Render Config
Shading Units
2880
6912
TMUs
240
432
ROPs
48
160
L1 Cache
16 KB (per SMX)
192 KB (per SM)
L2 Cache
1536 KB
40 MB
SM Count
-
108
Tensor Cores
-
432
Theoretical Performance
Pixel Rate
52.56 GPixel/s
225.6 GPixel/s
Texture Rate
210.2 GTexel/s
609.1 GTexel/s
FP32 (float)
5.046 TFLOPS
19.49 TFLOPS
FP64 (double)
1.682 TFLOPS
9.746 TFLOPS
FP16 (half)
-
77.97 TFLOPS
Graphics Processor
GPU Name
GK110B
GA100
Architecture
Kepler
Ampere
Foundry
TSMC
TSMC
Process Size
28 nm
7 nm
Transistors
7.08 billion
54.2 billion
Die Size
561 mm²
826 mm²
Board Design
TDP
245W
250W
Suggested PSU
550 W
600 W
Outputs
No outputs
No outputs
Power Connectors
-
8-pin EPS
Graphics Features
DirectX
12 (11_1)
N/A
OpenGL
4.6
N/A
OpenCL
3.0
3.0
Vulkan
1.2.175
N/A
CUDA
3.5
8.0
Shader Model
6.5 (5.1)
N/A