NVIDIA GeForce RTX 3090 Ti vs NVIDIA A100 PCIe

VS

NVIDIA GeForce RTX 3090 Ti NVIDIA A100 PCIe

AI GPU We compared a Desktop platform GPU: 24GB VRAM GeForce RTX 3090 Ti and a GPU: 40GB VRAM A100 PCIe to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GeForce RTX 3090 Ti 's Advantages

Released 1 years and 7 months late

Boost Clock has increased by 32% (1860MHz vs 1410MHz)

3840 additional rendering cores

NVIDIA A100 PCIe 's Advantages

More VRAM (40GB vs 24GB)

Larger VRAM bandwidth (1555GB/s vs 1008GB/s)

Lower TDP (250W vs 450W)

Score

Benchmark

FP32 (float)

GeForce RTX 3090 Ti +105%

40 TFLOPS

A100 PCIe

19.49 TFLOPS

GeForce RTX 3090 Ti

VS

A100 PCIe

Graphics Card

Jan 2022

Release Date

Jun 2020

GeForce 30

Generation

Tesla

Desktop

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1560 MHz

Base Clock

765 MHz

1860 MHz

Boost Clock

1410 MHz

1313 MHz

Memory Clock

1215 MHz

Memory

24GB

Memory Size

40GB

GDDR6X

Memory Type

HBM2e

384bit

Memory Bus

5120bit

1008GB/s

Bandwidth

1555GB/s

Render Config

84

SM Count

108

-

Compute Units

-

10752

Shading Units

6912

336

TMUs

432

112

ROPs

160

336

Tensor Cores

432

84

RT Cores

-

128 KB (per SM)

L1 Cache

192 KB (per SM)

6 MB

L2 Cache

40 MB

Theoretical Performance

208.3 GPixel/s

Pixel Rate

225.6 GPixel/s

625.0 GTexel/s

Texture Rate

609.1 GTexel/s

40.00 TFLOPS

FP16 (half)

77.97 TFLOPS

40.00 TFLOPS

FP32 (float)

19.49 TFLOPS

625.0 GFLOPS

FP64 (double)

9.746 TFLOPS

Graphics Processor

GA102

GPU Name

GA100

GA102-350-A1

GPU Variant

-

Ampere

Architecture

Ampere

Samsung

Foundry

TSMC

8 nm

Process Size

7 nm

28.3 billion

Transistors

54.2 billion

628 mm²

Die Size

826 mm²

Board Design

450W

TDP

250W

850 W

Suggested PSU

600 W

1x HDMI 2.1 3x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.6

CUDA

8.0

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 3090 Ti vs NVIDIA A10 PCIe

2

NVIDIA GeForce RTX 3090 Ti vs NVIDIA Tesla P100 PCIe 16 GB

3

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4070

4

NVIDIA GeForce RTX 3090 Ti vs NVIDIA Tesla P100 PCIe 12 GB

5

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4060 Ti

6

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4080

7

NVIDIA L4 vs NVIDIA A100 PCIe

8

NVIDIA GeForce RTX 3090 Ti vs NVIDIA NVS 300

9

NVIDIA GeForce RTX 3090 Ti vs ATI FirePro V8750

10

NVIDIA GeForce RTX 3090 Ti vs ATI Radeon HD 3450 AGP