NVIDIA Tesla P40 vs AMD Instinct MI300X

VS

We compared two Professional market GPUs: 24GB VRAM Tesla P40 and 192GB VRAM AMD Instinct MI300X to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA Tesla P40 's Advantages

Lower TDP (250W vs 750W)

AMD Instinct MI300X 's Advantages

Released 7 years and 3 months late

Boost Clock has increased by 37% (2100MHz vs 1531MHz)

More VRAM (192GB vs 24GB)

Larger VRAM bandwidth (5300GB/s vs 347.1GB/s)

15616 additional rendering cores

Score

Benchmark

FP32 (float)

Tesla P40

11.76 TFLOPS

AMD Instinct MI300X +1289%

163.4 TFLOPS

Tesla P40

VS

AMD Instinct MI300X

Graphics Card

Sep 2016

Release Date

Dec 2023

Tesla Pascal

Generation

Instinct

Professional

Type

Professional

PCIe 3.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1303 MHz

Base Clock

1000 MHz

1531 MHz

Boost Clock

2100 MHz

1808 MHz

Memory Clock

5200 MHz

Memory

24GB

Memory Size

192GB

GDDR5

Memory Type

HBM3

384bit

Memory Bus

8192bit

347.1GB/s

Bandwidth

5300GB/s

Render Config

30

SM Count

-

Compute Units

304

3840

Shading Units

19456

240

TMUs

880

96

ROPs

0

-

Tensor Cores

-

RT Cores

-

48 KB (per SM)

L1 Cache

16 KB (per CU)

3 MB

L2 Cache

16 MB

Theoretical Performance

147.0 GPixel/s

Pixel Rate

0 MPixel/s

367.4 GTexel/s

Texture Rate

1496 GTexel/s

183.7 GFLOPS

FP16 (half)

1300 TFLOPS

11.76 TFLOPS

FP32 (float)

163.4 TFLOPS

367.4 GFLOPS

FP64 (double)

81.7 TFLOPS

Graphics Processor

GP102

GPU Name

MI300

-

GPU Variant

-

Pascal

Architecture

CDNA 3.0

TSMC

Foundry

TSMC

16 nm

Process Size

5 nm

11.8 billion

Transistors

146 billion

471 mm²

Die Size

1017 mm²

Board Design

250W

TDP

750W

600 W

Suggested PSU

1000 W

No outputs

Outputs

No outputs

8-pin EPS

Power Connectors

None

Graphics Features

12 (12_1)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

6.1

CUDA

-

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA Tesla P40 vs NVIDIA Tesla M40

2

NVIDIA Tesla K80 vs NVIDIA Tesla P40

3

NVIDIA Tesla P40 vs NVIDIA Tesla M10

4

NVIDIA Tesla P40 vs NVIDIA Tesla P100 DGXS

5

NVIDIA Tesla T4 vs NVIDIA Tesla P40

6

NVIDIA Tesla P40 vs NVIDIA A100 PCIe

7

NVIDIA Tesla P100 SXM2 vs NVIDIA Tesla P40

8

NVIDIA Tesla P40 vs NVIDIA Quadro M5000M

9

NVIDIA Tesla P40 vs AMD Radeon Instinct MI8

10

NVIDIA Tesla P40 vs NVIDIA RTX A1000 Mobile 6 GB