NVIDIA H100 CNX vs NVIDIA Quadro RTX 4000

VS

AI GPU We compared a GPU: 80GB VRAM H100 CNX and a Professional market GPU: 8GB VRAM Quadro RTX 4000 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA H100 CNX 's Advantages

Released 4 years and 4 months late

Boost Clock has increased by 19% (1845MHz vs 1545MHz)

More VRAM (80GB vs 8GB)

Larger VRAM bandwidth (2039GB/s vs 416.0GB/s)

12288 additional rendering cores

NVIDIA Quadro RTX 4000 's Advantages

Lower TDP (160W vs 350W)

Score

Benchmark

FP32 (float)

H100 CNX +656%

53.84 TFLOPS

Quadro RTX 4000

7.119 TFLOPS

H100 CNX

VS

Quadro RTX 4000

Graphics Card

Mar 2023

Release Date

Nov 2018

Tesla Hopper

Generation

Quadro

AI GPU

Type

Professional

PCIe 5.0 x16

Bus Interface

PCIe 3.0 x16

Clock Speeds

690 MHz

Base Clock

1005 MHz

1845 MHz

Boost Clock

1545 MHz

1593 MHz

Memory Clock

1625 MHz

Memory

80GB

Memory Size

8GB

HBM2e

Memory Type

GDDR6

5120bit

Memory Bus

256bit

2039GB/s

Bandwidth

416.0GB/s

Render Config

114

SM Count

36

-

Compute Units

-

14592

Shading Units

2304

456

TMUs

144

24

ROPs

64

456

Tensor Cores

288

-

RT Cores

36

256 KB (per SM)

L1 Cache

64 KB (per SM)

50 MB

L2 Cache

4 MB

Theoretical Performance

44.28 GPixel/s

Pixel Rate

98.88 GPixel/s

841.3 GTexel/s

Texture Rate

222.5 GTexel/s

215.4 TFLOPS

FP16 (half)

14.24 TFLOPS

53.84 TFLOPS

FP32 (float)

7.119 TFLOPS

26.92 TFLOPS

FP64 (double)

222.5 GFLOPS

Graphics Processor

GH100

GPU Name

TU104

-

GPU Variant

TU104-850-A1

Hopper

Architecture

Turing

TSMC

Foundry

TSMC

4 nm

Process Size

12 nm

80 billion

Transistors

13.6 billion

814 mm²

Die Size

545 mm²

Board Design

350W

TDP

160W

750 W

Suggested PSU

450 W

No outputs

Outputs

3x DisplayPort 1.4a 1x USB Type-C

8-pin EPS

Power Connectors

1x 8-pin

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

9.0

CUDA

7.5

N/A

Shader Model

6.6

Related GPU Comparisons

1

NVIDIA H100 CNX vs NVIDIA Tesla V100 PCIe 32 GB

2

NVIDIA H100 CNX vs AMD Radeon Instinct MI250

3

NVIDIA H100 CNX vs NVIDIA A100 PCIe

4

NVIDIA H100 CNX vs NVIDIA RTX A6000

5

NVIDIA H100 SXM5 vs NVIDIA H100 CNX

6

NVIDIA Tesla C2070 vs NVIDIA H100 CNX

7

NVIDIA Quadro RTX 4000 vs NVIDIA RTX A4000

8

NVIDIA H100 CNX vs NVIDIA A100 PCIe

9

NVIDIA H100 CNX vs NVIDIA H800 SXM5

10

NVIDIA H100 CNX vs NVIDIA H100 SXM5 80 GB