NVIDIA GeForce RTX 4090 vs NVIDIA A100 PCIe 80 GB

VS

NVIDIA GeForce RTX 4090 NVIDIA A100 PCIe 80 GB

We compared a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 and a Professional market GPU: 80GB VRAM A100 PCIe 80 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GeForce RTX 4090's Advantages

Released 1 years and 3 months late

Boost Clock has increased by 79% (2520MHz vs 1410MHz)

9472 additional rendering cores

NVIDIA A100 PCIe 80 GB's Advantages

More VRAM (80GB vs 24GB)

Larger VRAM bandwidth (1935GB/s vs 1008GB/s)

Lower TDP (300W vs 450W)

Score

Benchmark

FP32 (float)

GeForce RTX 4090 +323%

82.58 TFLOPS

A100 PCIe 80 GB

19.49 TFLOPS

Blender

GeForce RTX 4090 +237%

12921

A100 PCIe 80 GB

3823

OctaneBench

GeForce RTX 4090 +312%

1278

A100 PCIe 80 GB

310

GeForce RTX 4090

VS

A100 PCIe 80 GB

Graphics Card

Sep 2022

Release Date

Jun 2021

GeForce 40

Generation

Tesla Ampere

Desktop

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

2235MHz

Base Clock

1065MHz

2520MHz

Boost Clock

1410MHz

1313MHz

Memory Clock

1512MHz

Memory

24GB

Memory Size

80GB

GDDR6X

Memory Type

HBM2e

384bit

Memory Bus

5120bit

1008 GB/s

Bandwidth

1935 GB/s

Render Config

128

SM Count

108

-

Compute Units

-

16384

Shading Units

6912

512

TMUs

432

176

ROPs

160

512

Tensor Cores

432

128

RT Cores

-

128 KB (per SM)

L1 Cache

192 KB (per SM)

72MB

L2 Cache

80MB

Theoretical Performance

443.5 GPixel/s

Pixel Rate

225.6 GPixel/s

1290 GTexel/s

Texture Rate

609.1 GTexel/s

82.58 TFLOPS

FP16 (half)

77.97 TFLOPS

82.58 TFLOPS

FP32 (float)

19.49 TFLOPS

1290 GFLOPS

FP64 (double)

9.746 TFLOPS

Graphics Processor

AD102

GPU Name

GA100

AD102-300-A1

GPU Variant

-

Ada Lovelace

Architecture

Ampere

TSMC

Foundry

TSMC

5 nm

Process Size

7 nm

76,300 million

Transistors

54,200 million

609mm²

Die Size

826mm²

Board Design

450W

TDP

300W

850W

Suggested PSU

700W

1x HDMI 2.1 3x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

8.0

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 4090 vs NVIDIA Tesla V100 PCIe 32 GB

2

NVIDIA GeForce RTX 4080 SUPER vs NVIDIA GeForce RTX 4090

3

NVIDIA GeForce RTX 4090 vs NVIDIA RTX A6000

4

NVIDIA GeForce RTX 4090 vs NVIDIA H100 SXM5

5

NVIDIA GeForce RTX 4090 vs NVIDIA RTX 6000 Ada

6

NVIDIA GeForce RTX 4090 vs NVIDIA L40S

7

NVIDIA RTX A6000 vs NVIDIA A100 PCIe 80 GB

8

NVIDIA GeForce RTX 4090 vs ATI Radeon HD 4670 X2

9

NVIDIA GeForce RTX 4090 vs AMD Radeon R5 230 OEM

10

NVIDIA GeForce RTX 4090 vs ATI FirePro V3900