Home GPU Comparison NVIDIA H100 PCIe vs NVIDIA A100 PCIe

NVIDIA H100 PCIe vs NVIDIA A100 PCIe

AI GPUAI GPU We compared two GPUs: 80GB VRAM H100 PCIe and 40GB VRAM A100 PCIe to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA H100 PCIe 's Advantages
Released 1 years and 9 months late
Boost Clock has increased by 24% (1755MHz vs 1410MHz)
More VRAM (80GB vs 40GB)
Larger VRAM bandwidth (2039GB/s vs 1555GB/s)
7680 additional rendering cores
NVIDIA A100 PCIe 's Advantages
Lower TDP (250W vs 350W)

Score

Benchmark

FP32 (float)
H100 PCIe +162%
51.22 TFLOPS
A100 PCIe
19.49 TFLOPS
VS

Graphics Card

Mar 2022
Release Date
Jun 2020
Tesla Hopper
Generation
Tesla
AI GPU
Type
AI GPU
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16

Clock Speeds

1095 MHz
Base Clock
765 MHz
1755 MHz
Boost Clock
1410 MHz
1593 MHz
Memory Clock
1215 MHz

Memory

80GB
Memory Size
40GB
HBM2e
Memory Type
HBM2e
5120bit
Memory Bus
5120bit
2039GB/s
Bandwidth
1555GB/s

Render Config

114
SM Count
108
-
Compute Units
-
14592
Shading Units
6912
456
TMUs
432
24
ROPs
160
456
Tensor Cores
432
-
RT Cores
-
256 KB (per SM)
L1 Cache
192 KB (per SM)
50 MB
L2 Cache
40 MB

Theoretical Performance

42.12 GPixel/s
Pixel Rate
225.6 GPixel/s
800.3 GTexel/s
Texture Rate
609.1 GTexel/s
204.9 TFLOPS
FP16 (half)
77.97 TFLOPS
51.22 TFLOPS
FP32 (float)
19.49 TFLOPS
25.61 TFLOPS
FP64 (double)
9.746 TFLOPS

Graphics Processor

GH100
GPU Name
GA100
-
GPU Variant
-
Hopper
Architecture
Ampere
TSMC
Foundry
TSMC
4 nm
Process Size
7 nm
80 billion
Transistors
54.2 billion
814 mm²
Die Size
826 mm²

Board Design

350W
TDP
250W
750 W
Suggested PSU
600 W
No outputs
Outputs
No outputs
1x 16-pin
Power Connectors
8-pin EPS

Graphics Features

N/A
DirectX
N/A
N/A
OpenGL
N/A
3.0
OpenCL
3.0
N/A
Vulkan
N/A
9.0
CUDA
8.0
N/A
Shader Model
N/A

Related GPU Comparisons

© 2024 - TopCPU.net   Contact Us Privacy Policy