GeForce RTX 4060 Ti vs H200 NVL
We compared two Desktop platform GPUs: 8GB VRAM GeForce RTX 4060 Ti and 141GB VRAM H200 NVL to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
GeForce RTX 4060 Ti 's Advantages
Boost Clock has increased by 42% (2535MHz vs 1785MHz)
Lower TDP (160W vs 600W)
H200 NVL 's Advantages
Released 1 years and 6 months late
More VRAM (141GB vs 8GB)
Larger VRAM bandwidth (4.89TB/s vs 288.0GB/s)
12544 additional rendering cores
Score
Benchmark
FP32 (float)
GeForce RTX 4060 Ti
22060
H200 NVL
+173%
60320
Graphics Card
May 2023
Release Date
Nov 2024
GeForce 40
Generation
Server Hopper
Desktop
Type
Desktop
PCIe 4.0 x8
Bus Interface
PCIe 5.0 x16
Clock Speeds
2310 MHz
Base Clock
1365 MHz
2535 MHz
Boost Clock
1785 MHz
2250 MHz
Memory Clock
1593 MHz
Memory
8GB
Memory Size
141GB
GDDR6
Memory Type
HBM3e
128bit
Memory Bus
6144bit
288.0GB/s
Bandwidth
4.89TB/s
Render Config
32
SM Count
132
4352
Shading Units
16896
128
TMUs
528
48
ROPs
24
128
Tensor Cores
528
32
RT Cores
-
128 KB (per SM)
L1 Cache
256 KB (per SM)
32 MB
L2 Cache
50 MB
Theoretical Performance
121.7 GPixel/s
Pixel Rate
42.84 GPixel/s
324.5 GTexel/s
Texture Rate
942.5 GTexel/s
22.06 TFLOPS
FP16 (half)
241.3 TFLOPS
22.06 TFLOPS
FP32 (float)
60.32 TFLOPS
344.8 GFLOPS
FP64 (double)
30.16 TFLOPS
Board Design
160W
TDP
600W
450 W
Suggested PSU
1000 W
1x HDMI 2.1
3x DisplayPort 1.4a
Outputs
No outputs
1x 12-pin
Power Connectors
8-pin EPS
Graphics Processor
AD106
GPU Name
GH100
AD106-350-A1
GPU Variant
-
Ada Lovelace
Architecture
Hopper
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
Unknown
Transistors
80 billion
190 mm²
Die Size
814 mm²
Graphics Features
12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.9
CUDA
9.0
6.7
Shader Model
N/A
