NVIDIA GeForce RTX 4080 vs NVIDIA H100 SXM5

VS

NVIDIA GeForce RTX 4080 NVIDIA H100 SXM5

AI GPU We compared a Desktop platform GPU: 16GB VRAM GeForce RTX 4080 and a GPU: 80GB VRAM H100 SXM5 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GeForce RTX 4080 's Advantages

Released 6 months late

Boost Clock has increased by 27% (2505MHz vs 1980MHz)

Lower TDP (320W vs 700W)

NVIDIA H100 SXM5 's Advantages

More VRAM (80GB vs 16GB)

Larger VRAM bandwidth (3350GB/s vs 716.8GB/s)

7168 additional rendering cores

Score

Benchmark

FP32 (float)

GeForce RTX 4080

48.74 TFLOPS

H100 SXM5 +37%

66.91 TFLOPS

GeForce RTX 4080

VS

H100 SXM5

Graphics Card

Sep 2022

Release Date

Mar 2022

GeForce 40

Generation

Tesla Hopper

Desktop

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

2205 MHz

Base Clock

1590 MHz

2505 MHz

Boost Clock

1980 MHz

1400 MHz

Memory Clock

1313 MHz

Memory

16GB

Memory Size

80GB

GDDR6X

Memory Type

HBM3

256bit

Memory Bus

5120bit

716.8GB/s

Bandwidth

3350GB/s

Render Config

76

SM Count

132

-

Compute Units

-

9728

Shading Units

16896

304

TMUs

528

112

ROPs

24

304

Tensor Cores

528

76

RT Cores

-

128 KB (per SM)

L1 Cache

256 KB (per SM)

64 MB

L2 Cache

50 MB

Theoretical Performance

280.6 GPixel/s

Pixel Rate

47.52 GPixel/s

761.5 GTexel/s

Texture Rate

1045 GTexel/s

48.74 TFLOPS

FP16 (half)

267.6 TFLOPS

48.74 TFLOPS

FP32 (float)

66.91 TFLOPS

761.5 GFLOPS

FP64 (double)

33.45 TFLOPS

Graphics Processor

AD103

GPU Name

GH100

AD103-300-A1

GPU Variant

-

Ada Lovelace

Architecture

Hopper

TSMC

Foundry

TSMC

5 nm

Process Size

4 nm

45.9 billion

Transistors

80 billion

379 mm²

Die Size

814 mm²

Board Design

320W

TDP

700W

700 W

Suggested PSU

1100 W

1x HDMI 2.1 3x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

9.0

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 4080 vs NVIDIA GeForce RTX 4070 Ti SUPER

2

NVIDIA GeForce RTX 3090 vs NVIDIA GeForce RTX 4080

3

NVIDIA GeForce RTX 4080 vs NVIDIA GeForce RTX 4080 Ti

4

NVIDIA GeForce RTX 4080 vs NVIDIA GeForce RTX 3080 Ti

5

NVIDIA RTX A4000 Mobile vs NVIDIA GeForce RTX 4080

6

NVIDIA GeForce RTX 4080 vs NVIDIA GeForce RTX 4060

7

NVIDIA A100 PCIe 80 GB vs NVIDIA GeForce RTX 4080

8

NVIDIA GeForce RTX 4080 vs NVIDIA T400 4 GB

9

NVIDIA GeForce RTX 4080 vs AMD Radeon HD 7950 Monica BIOS 2

10

NVIDIA GeForce RTX 4080 vs AMD Radeon Pro Vega II Duo