NVIDIA TITAN RTX vs NVIDIA A100 SXM4 80 GB

VS

AI GPU We compared a Desktop platform GPU: 24GB VRAM TITAN RTX and a GPU: 80GB VRAM A100 SXM4 80 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA TITAN RTX 's Advantages

Boost Clock has increased by 26% (1770MHz vs 1410MHz)

Lower TDP (280W vs 400W)

NVIDIA A100 SXM4 80 GB 's Advantages

Released 1 years and 11 months late

More VRAM (80GB vs 24GB)

Larger VRAM bandwidth (2039GB/s vs 672.0GB/s)

2304 additional rendering cores

Score

Benchmark

FP32 (float)

TITAN RTX

16.31 TFLOPS

A100 SXM4 80 GB +19%

19.49 TFLOPS

OctaneBench

TITAN RTX

363

A100 SXM4 80 GB +42%

516

TITAN RTX

VS

A100 SXM4 80 GB

Graphics Card

Dec 2018

Release Date

Nov 2020

GeForce 20

Generation

Tesla Ampere

Desktop

Type

AI GPU

PCIe 3.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1350 MHz

Base Clock

1275 MHz

1770 MHz

Boost Clock

1410 MHz

1750 MHz

Memory Clock

1593 MHz

Memory

24GB

Memory Size

80GB

GDDR6

Memory Type

HBM2e

384bit

Memory Bus

5120bit

672.0GB/s

Bandwidth

2039GB/s

Render Config

72

SM Count

108

-

Compute Units

-

4608

Shading Units

6912

288

TMUs

432

96

ROPs

160

576

Tensor Cores

432

72

RT Cores

-

64 KB (per SM)

L1 Cache

192 KB (per SM)

6 MB

L2 Cache

40 MB

Theoretical Performance

169.9 GPixel/s

Pixel Rate

225.6 GPixel/s

509.8 GTexel/s

Texture Rate

609.1 GTexel/s

32.62 TFLOPS

FP16 (half)

77.97 TFLOPS

16.31 TFLOPS

FP32 (float)

19.49 TFLOPS

509.8 GFLOPS

FP64 (double)

9.746 TFLOPS

Graphics Processor

TU102

GPU Name

GA100

TU102-400-A1

GPU Variant

-

Turing

Architecture

Ampere

TSMC

Foundry

TSMC

12 nm

Process Size

7 nm

18.6 billion

Transistors

54.2 billion

754 mm²

Die Size

826 mm²

Board Design

280W

TDP

400W

600 W

Suggested PSU

800 W

1x HDMI 2.0 3x DisplayPort 1.4a 1x USB Type-C

Outputs

No outputs

2x 8-pin

Power Connectors

None

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

7.5

CUDA

8.0

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 4090 vs NVIDIA TITAN RTX

2

NVIDIA GeForce RTX 3090 vs NVIDIA TITAN RTX

3

NVIDIA TITAN V vs NVIDIA TITAN RTX

4

NVIDIA GeForce RTX 4070 Ti vs NVIDIA TITAN RTX

5

NVIDIA TITAN RTX vs NVIDIA Tesla V100 DGXS 32 GB

6

NVIDIA TITAN RTX vs NVIDIA GeForce RTX 4080

7

NVIDIA TITAN RTX vs NVIDIA RTX TITAN Ada

8

NVIDIA TITAN RTX vs NVIDIA GeForce GTX 560 Ti OEM

9

NVIDIA TITAN RTX vs NVIDIA GeForce GTX 1660 SUPER

10

NVIDIA TITAN RTX vs ATI Radeon HD 4730 OEM