NVIDIA A2 vs NVIDIA H200 NVL
We compared two Desktop platform GPUs: 16GB VRAM A2 and 141GB VRAM H200 NVL to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA A2 's Advantages
Lower TDP (60W vs 600W)
NVIDIA H200 NVL 's Advantages
Released 3 years late
Boost Clock has increased by 1% (1785MHz vs 1770MHz)
More VRAM (141GB vs 16GB)
Larger VRAM bandwidth (4.89TB/s vs 200.1GB/s)
15616 additional rendering cores
Score
Benchmark
FP32 (float)
A2
4.531 TFLOPS
H200 NVL
+1231%
60.32 TFLOPS
Graphics Card
Nov 2021
Release Date
Nov 2024
Quadro
Generation
Server Hopper
Desktop
Type
Desktop
PCIe 4.0 x8
Bus Interface
PCIe 5.0 x16
Clock Speeds
1440 MHz
Base Clock
1365 MHz
1770 MHz
Boost Clock
1785 MHz
1563 MHz
Memory Clock
1593 MHz
Memory
16GB
Memory Size
141GB
GDDR6
Memory Type
HBM3e
128bit
Memory Bus
6144bit
200.1GB/s
Bandwidth
4.89TB/s
Render Config
-
-
-
10
SM Count
132
1280
Shading Units
16896
40
TMUs
528
32
ROPs
24
40
Tensor Cores
528
10
RT Cores
-
128 KB (per SM)
L1 Cache
256 KB (per SM)
2 MB
L2 Cache
50 MB
-
-
-
Theoretical Performance
56.64 GPixel/s
Pixel Rate
42.84 GPixel/s
70.80 GTexel/s
Texture Rate
942.5 GTexel/s
4.531 TFLOPS
FP16 (half)
241.3 TFLOPS
4.531 TFLOPS
FP32 (float)
60.32 TFLOPS
70.80 GFLOPS
FP64 (double)
30.16 TFLOPS
Board Design
60W
TDP
600W
250 W
Suggested PSU
1000 W
No outputs
Outputs
No outputs
None
Power Connectors
8-pin EPS
Graphics Processor
GA107
GPU Name
GH100
-
-
-
Ampere
Architecture
Hopper
Samsung
Foundry
TSMC
8 nm
Process Size
5 nm
Unknown
Transistors
80 billion
Unknown
Die Size
814 mm²
Graphics Features
12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.6
CUDA
9.0
6.6
Shader Model
N/A
