NVIDIA L4 vs NVIDIA A100 PCIe

VS

NVIDIA L4 NVIDIA A100 PCIe

We compared a Professional market GPU: 24GB VRAM L4 and a GPU: 40GB VRAM A100 PCIe to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA L4's Advantages

Released 2 years and 9 months late

Boost Clock has increased by 45% (2040MHz vs 1410MHz)

512 additional rendering cores

Lower TDP (72W vs 250W)

NVIDIA A100 PCIe's Advantages

More VRAM (40GB vs 24GB)

Larger VRAM bandwidth (1555GB/s vs 300.1GB/s)

Score

Benchmark

FP32 (float)

L4 +55%

30.29 TFLOPS

A100 PCIe

19.49 TFLOPS

L4

VS

A100 PCIe

Graphics Card

Mar 2023

Release Date

Jun 2020

Tesla Ada

Generation

Tesla

Professional

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

795MHz

Base Clock

765MHz

2040MHz

Boost Clock

1410MHz

1563MHz

Memory Clock

1215MHz

Memory

24GB

Memory Size

40GB

GDDR6

Memory Type

HBM2e

192bit

Memory Bus

5120bit

300.1 GB/s

Bandwidth

1555 GB/s

Render Config

60

SM Count

108

-

Compute Units

-

7424

Shading Units

6912

240

TMUs

432

80

ROPs

160

240

Tensor Cores

432

60

RT Cores

-

128 KB (per SM)

L1 Cache

192 KB (per SM)

48MB

L2 Cache

40MB

Theoretical Performance

163.2 GPixel/s

Pixel Rate

225.6 GPixel/s

489.6 GTexel/s

Texture Rate

609.1 GTexel/s

30.29 TFLOPS

FP16 (half)

77.97 TFLOPS

30.29 TFLOPS

FP32 (float)

19.49 TFLOPS

473.3 GFLOPS

FP64 (double)

9.746 TFLOPS

Graphics Processor

AD104

GPU Name

GA100

AD104-???-A1

GPU Variant

-

Ada Lovelace

Architecture

Ampere

TSMC

Foundry

TSMC

5 nm

Process Size

7 nm

35,800 million

Transistors

54,200 million

294mm²

Die Size

826mm²

Board Design

72W

TDP

250W

Suggested PSU

600W

No outputs

Outputs

No outputs

1x 16-pin

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

8.0

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA Tesla T4 vs NVIDIA L4

2

NVIDIA L4 vs NVIDIA Tesla V100 PCIe 32 GB

3

NVIDIA A10 PCIe vs NVIDIA L4

4

NVIDIA GeForce RTX 4090 D vs NVIDIA L4

5

NVIDIA L4 vs NVIDIA A100 PCIe 80 GB

6

NVIDIA RTX A6000 vs NVIDIA L4

7

NVIDIA Tesla T4 vs NVIDIA A100 PCIe

8

NVIDIA L4 vs NVIDIA Quadro K2100M

9

NVIDIA L4 vs NVIDIA RTX A2000 Mobile

10

NVIDIA L4 vs NVIDIA Quadro FX 2800M