NVIDIA L40 vs AMD Radeon Instinct MI300

VS

We compared two Professional market GPUs: 48GB VRAM L40 and 128GB VRAM Radeon Instinct MI300 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA L40 's Advantages

Boost Clock has increased by 46% (2490MHz vs 1700MHz)

4096 additional rendering cores

Lower TDP (300W vs 600W)

AMD Radeon Instinct MI300 's Advantages

More VRAM (128GB vs 48GB)

Larger VRAM bandwidth (3277GB/s vs 864.0GB/s)

Score

Benchmark

FP32 (float)

L40 +89%

90.52 TFLOPS

Radeon Instinct MI300

47.87 TFLOPS

L40

VS

Radeon Instinct MI300

Graphics Card

Oct 2022

Release Date

Jan 2023

Tesla Ada

Generation

Radeon Instinct

Professional

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

735 MHz

Base Clock

1000 MHz

2490 MHz

Boost Clock

1700 MHz

2250 MHz

Memory Clock

1600 MHz

Memory

48GB

Memory Size

128GB

GDDR6

Memory Type

HBM3

384bit

Memory Bus

8192bit

864.0GB/s

Bandwidth

3277GB/s

Render Config

142

SM Count

-

Compute Units

220

18176

Shading Units

14080

568

TMUs

880

192

ROPs

0

568

Tensor Cores

880

142

RT Cores

-

128 KB (per SM)

L1 Cache

16 KB (per CU)

96 MB

L2 Cache

16 MB

Theoretical Performance

478.1 GPixel/s

Pixel Rate

0 MPixel/s

1414 GTexel/s

Texture Rate

1496 GTexel/s

90.52 TFLOPS

FP16 (half)

383.0 TFLOPS

90.52 TFLOPS

FP32 (float)

47.87 TFLOPS

1414 GFLOPS

FP64 (double)

47.87 TFLOPS

Graphics Processor

AD102

GPU Name

Aqua Vanjaram

AD102-895-A1

GPU Variant

-

Ada Lovelace

Architecture

CDNA 3.0

TSMC

Foundry

TSMC

4 nm

Process Size

5 nm

76.3 billion

Transistors

153 billion

608 mm²

Die Size

1017 mm²

Board Design

300W

TDP

600W

700 W

Suggested PSU

1000 W

4x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

2x 8-pin

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

-

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA L40 vs NVIDIA L40S

2

NVIDIA RTX A6000 vs NVIDIA L40

3

NVIDIA A100 PCIe vs NVIDIA L40

4

NVIDIA L4 vs NVIDIA L40

5

NVIDIA L40 vs NVIDIA GeForce RTX 4090

6

NVIDIA L40 vs NVIDIA A30 PCIe

7

NVIDIA A40 PCIe vs NVIDIA L40

8

NVIDIA L40 vs NVIDIA Quadro M2000M

9

NVIDIA L40 vs NVIDIA Quadro 4100

10

NVIDIA L40 vs NVIDIA Jetson Orin NX 16 GB