NVIDIA H200 NVL vs NVIDIA A2
We compared two Desktop platform GPUs: 141GB VRAM H200 NVL and 16GB VRAM A2 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA H200 NVL 's Advantages
Released 3 years late
Boost Clock has increased by 1% (1785MHz vs 1770MHz)
More VRAM (141GB vs 16GB)
Larger VRAM bandwidth (4.89TB/s vs 200.1GB/s)
15616 additional rendering cores
NVIDIA A2 's Advantages
Lower TDP (60W vs 600W)
Score
Benchmark
FP32 (float)
H200 NVL
+1231%
60.32 TFLOPS
A2
4.531 TFLOPS
Graphics Card
Nov 2024
Release Date
Nov 2021
Server Hopper
Generation
Quadro
Desktop
Type
Desktop
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x8
Clock Speeds
1365 MHz
Base Clock
1440 MHz
1785 MHz
Boost Clock
1770 MHz
1593 MHz
Memory Clock
1563 MHz
Memory
141GB
Memory Size
16GB
HBM3e
Memory Type
GDDR6
6144bit
Memory Bus
128bit
4.89TB/s
Bandwidth
200.1GB/s
Render Config
-
-
-
132
SM Count
10
16896
Shading Units
1280
528
TMUs
40
24
ROPs
32
528
Tensor Cores
40
-
RT Cores
10
256 KB (per SM)
L1 Cache
128 KB (per SM)
50 MB
L2 Cache
2 MB
-
-
-
Theoretical Performance
42.84 GPixel/s
Pixel Rate
56.64 GPixel/s
942.5 GTexel/s
Texture Rate
70.80 GTexel/s
241.3 TFLOPS
FP16 (half)
4.531 TFLOPS
60.32 TFLOPS
FP32 (float)
4.531 TFLOPS
30.16 TFLOPS
FP64 (double)
70.80 GFLOPS
Board Design
600W
TDP
60W
1000 W
Suggested PSU
250 W
No outputs
Outputs
No outputs
8-pin EPS
Power Connectors
None
Graphics Processor
GH100
GPU Name
GA107
-
-
-
Hopper
Architecture
Ampere
TSMC
Foundry
Samsung
5 nm
Process Size
8 nm
80 billion
Transistors
Unknown
814 mm²
Die Size
Unknown
Graphics Features
N/A
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
3.0
OpenCL
3.0
N/A
Vulkan
1.3
9.0
CUDA
8.6
N/A
Shader Model
6.6
