NVIDIA GeForce RTX 3090 Ti vs NVIDIA H100 PCIe

VS

NVIDIA GeForce RTX 3090 Ti NVIDIA H100 PCIe

AI GPU We compared a Desktop platform GPU: 24GB VRAM GeForce RTX 3090 Ti and a GPU: 80GB VRAM H100 PCIe to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GeForce RTX 3090 Ti 's Advantages

Boost Clock has increased by 6% (1860MHz vs 1755MHz)

NVIDIA H100 PCIe 's Advantages

More VRAM (80GB vs 24GB)

Larger VRAM bandwidth (2039GB/s vs 1008GB/s)

3840 additional rendering cores

Lower TDP (350W vs 450W)

Score

Benchmark

FP32 (float)

GeForce RTX 3090 Ti

40 TFLOPS

H100 PCIe +28%

51.22 TFLOPS

Blender

GeForce RTX 3090 Ti +33%

6459

H100 PCIe

4845

GeForce RTX 3090 Ti

VS

H100 PCIe

Graphics Card

Jan 2022

Release Date

Mar 2022

GeForce 30

Generation

Tesla Hopper

Desktop

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1560 MHz

Base Clock

1095 MHz

1860 MHz

Boost Clock

1755 MHz

1313 MHz

Memory Clock

1593 MHz

Memory

24GB

Memory Size

80GB

GDDR6X

Memory Type

HBM2e

384bit

Memory Bus

5120bit

1008GB/s

Bandwidth

2039GB/s

Render Config

84

SM Count

114

-

Compute Units

-

10752

Shading Units

14592

336

TMUs

456

112

ROPs

24

336

Tensor Cores

456

84

RT Cores

-

128 KB (per SM)

L1 Cache

256 KB (per SM)

6 MB

L2 Cache

50 MB

Theoretical Performance

208.3 GPixel/s

Pixel Rate

42.12 GPixel/s

625.0 GTexel/s

Texture Rate

800.3 GTexel/s

40.00 TFLOPS

FP16 (half)

204.9 TFLOPS

40.00 TFLOPS

FP32 (float)

51.22 TFLOPS

625.0 GFLOPS

FP64 (double)

25.61 TFLOPS

Graphics Processor

GA102

GPU Name

GH100

GA102-350-A1

GPU Variant

-

Ampere

Architecture

Hopper

Samsung

Foundry

TSMC

8 nm

Process Size

4 nm

28.3 billion

Transistors

80 billion

628 mm²

Die Size

814 mm²

Board Design

450W

TDP

350W

850 W

Suggested PSU

750 W

1x HDMI 2.1 3x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

1x 16-pin

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.6

CUDA

9.0

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 3090 Ti vs NVIDIA A10 PCIe

2

NVIDIA GeForce RTX 3090 Ti vs NVIDIA Tesla P100 PCIe 16 GB

3

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4070

4

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4080

5

NVIDIA GeForce RTX 4070 SUPER vs NVIDIA GeForce RTX 3090 Ti

6

NVIDIA GeForce RTX 3090 Ti vs NVIDIA A100 PCIe

7

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4080 SUPER

8

NVIDIA GeForce RTX 3090 Ti vs NVIDIA RTX A4000H

9

NVIDIA GeForce RTX 3090 Ti vs ATI Radeon HD 3570

10

NVIDIA GeForce RTX 3090 Ti vs AMD Radeon RX 580 OEM