NVIDIA H200 NVL vs NVIDIA RTX 3500 Embedded Ada Generation
We compared two Desktop platform GPUs: 141GB VRAM H200 NVL and 12GB VRAM RTX 3500 Embedded Ada Generation to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA H200 NVL 's Advantages
Released 1 years and 8 months late
More VRAM (141GB vs 12GB)
Larger VRAM bandwidth (4.89TB/s vs 432.0GB/s)
11776 additional rendering cores
NVIDIA RTX 3500 Embedded Ada Generation 's Advantages
Boost Clock has increased by 26% (2250MHz vs 1785MHz)
Lower TDP (100W vs 600W)
Score
Benchmark
FP32 (float)
H200 NVL
+161%
60.32 TFLOPS
RTX 3500 Embedded Ada Generation
23.04 TFLOPS
Graphics Card
Nov 2024
Release Date
Mar 2023
Server Hopper
Generation
Quadro Ada-M
Desktop
Type
Desktop
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16
Clock Speeds
1365 MHz
Base Clock
1725 MHz
1785 MHz
Boost Clock
2250 MHz
1593 MHz
Memory Clock
2250 MHz
Memory
141GB
Memory Size
12GB
HBM3e
Memory Type
GDDR6
6144bit
Memory Bus
192bit
4.89TB/s
Bandwidth
432.0GB/s
Render Config
-
-
-
132
SM Count
40
16896
Shading Units
5120
528
TMUs
160
24
ROPs
64
528
Tensor Cores
160
-
RT Cores
40
256 KB (per SM)
L1 Cache
128 KB (per SM)
50 MB
L2 Cache
48 MB
-
-
-
Theoretical Performance
42.84 GPixel/s
Pixel Rate
144.0 GPixel/s
942.5 GTexel/s
Texture Rate
360.0 GTexel/s
241.3 TFLOPS
FP16 (half)
23.04 TFLOPS
60.32 TFLOPS
FP32 (float)
23.04 TFLOPS
30.16 TFLOPS
FP64 (double)
360.0 GFLOPS
Board Design
600W
TDP
100W
1000 W
Suggested PSU
300 W
No outputs
Outputs
No outputs
8-pin EPS
Power Connectors
None
Graphics Processor
GH100
GPU Name
AD104
-
-
-
Hopper
Architecture
Ada Lovelace
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
80 billion
Transistors
35.8 billion
814 mm²
Die Size
294 mm²
Graphics Features
N/A
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
3.0
OpenCL
3.0
N/A
Vulkan
1.3
9.0
CUDA
8.9
N/A
Shader Model
6.7
