NVIDIA GeForce RTX 3090 Ti vs NVIDIA L40 CNX

VS

NVIDIA GeForce RTX 3090 Ti NVIDIA L40 CNX

We compared a Desktop platform GPU: 24GB VRAM GeForce RTX 3090 Ti and a Professional market GPU: 24GB VRAM L40 CNX to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GeForce RTX 3090 Ti 's Advantages

Larger VRAM bandwidth (1008GB/s vs 864.0GB/s)

NVIDIA L40 CNX 's Advantages

Released 9 months late

Boost Clock has increased by 33% (2475MHz vs 1860MHz)

7424 additional rendering cores

Lower TDP (300W vs 450W)

Score

Benchmark

FP32 (float)

GeForce RTX 3090 Ti

40 TFLOPS

L40 CNX +124%

89.97 TFLOPS

GeForce RTX 3090 Ti

VS

L40 CNX

Graphics Card

Jan 2022

Release Date

Oct 2022

GeForce 30

Generation

Tesla Ada

Desktop

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1560 MHz

Base Clock

1005 MHz

1860 MHz

Boost Clock

2475 MHz

1313 MHz

Memory Clock

2250 MHz

Memory

24GB

Memory Size

24GB

GDDR6X

Memory Type

GDDR6

384bit

Memory Bus

384bit

1008GB/s

Bandwidth

864.0GB/s

Render Config

84

SM Count

142

-

Compute Units

-

10752

Shading Units

18176

336

TMUs

568

112

ROPs

192

336

Tensor Cores

568

84

RT Cores

142

128 KB (per SM)

L1 Cache

128 KB (per SM)

6 MB

L2 Cache

48 MB

Theoretical Performance

208.3 GPixel/s

Pixel Rate

475.2 GPixel/s

625.0 GTexel/s

Texture Rate

1406 GTexel/s

40.00 TFLOPS

FP16 (half)

89.97 TFLOPS

40.00 TFLOPS

FP32 (float)

89.97 TFLOPS

625.0 GFLOPS

FP64 (double)

1406 GFLOPS

Graphics Processor

GA102

GPU Name

AD102

GA102-350-A1

GPU Variant

AD102-???-A1

Ampere

Architecture

Ada Lovelace

Samsung

Foundry

TSMC

8 nm

Process Size

4 nm

28.3 billion

Transistors

76.3 billion

628 mm²

Die Size

608 mm²

Board Design

450W

TDP

300W

850 W

Suggested PSU

700 W

1x HDMI 2.1 3x DisplayPort 1.4a

Outputs

1x HDMI 2.1 3x DisplayPort 1.4a

1x 16-pin

Power Connectors

1x 16-pin

Graphics Features

12 Ultimate (12_2)

DirectX

12 Ultimate (12_2)

4.6

OpenGL

4.6

3.0

OpenCL

3.0

1.3

Vulkan

1.3

8.6

CUDA

8.9

6.6

Shader Model

6.6

Related GPU Comparisons

1

NVIDIA GeForce RTX 3090 Ti vs NVIDIA A10 PCIe

2

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4060 Ti

3

NVIDIA GeForce RTX 3090 Ti vs NVIDIA Tesla P100 PCIe 16 GB

4

NVIDIA GeForce RTX 3090 Ti vs NVIDIA Tesla P100 PCIe 12 GB

5

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4080

6

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce RTX 4070

7

NVIDIA GeForce RTX 3090 Ti vs NVIDIA H100 PCIe

8

NVIDIA GeForce RTX 3090 Ti vs AMD Radeon HD 8570 OEM Rebrand

9

NVIDIA GeForce RTX 3090 Ti vs AMD Radeon RX 7800 XT

10

NVIDIA GeForce RTX 3090 Ti vs NVIDIA GeForce GTX 660 Ti