AMD Instinct MI300X vs NVIDIA Jetson Orin NX 16 GB

VS

AMD Instinct MI300X NVIDIA Jetson Orin NX 16 GB

We compared two Professional market GPUs: 192GB VRAM AMD Instinct MI300X and 16GB VRAM Jetson Orin NX 16 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Instinct MI300X 's Advantages

Released 10 months late

Boost Clock2100MHz

More VRAM (192GB vs 16GB)

Larger VRAM bandwidth (5300GB/s vs 102.4GB/s)

18432 additional rendering cores

NVIDIA Jetson Orin NX 16 GB 's Advantages

Lower TDP (25W vs 750W)

Score

Benchmark

FP32 (float)

AMD Instinct MI300X +8591%

163.4 TFLOPS

Jetson Orin NX 16 GB

1.88 TFLOPS

AMD Instinct MI300X

VS

Jetson Orin NX 16 GB

Graphics Card

Dec 2023

Release Date

Feb 2023

Instinct

Generation

Tegra

Professional

Type

Professional

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x4

Clock Speeds

1000 MHz

Base Clock

-

2100 MHz

Boost Clock

-

5200 MHz

Memory Clock

1600 MHz

Memory

192GB

Memory Size

16GB

HBM3

Memory Type

LPDDR5

8192bit

Memory Bus

128bit

5300GB/s

Bandwidth

102.4GB/s

Render Config

-

SM Count

8

304

Compute Units

-

19456

Shading Units

1024

880

TMUs

32

0

ROPs

16

-

Tensor Cores

32

-

RT Cores

-

16 KB (per CU)

L1 Cache

128 KB (per SM)

16 MB

L2 Cache

256 KB

Theoretical Performance

0 MPixel/s

Pixel Rate

14.69 GPixel/s

1496 GTexel/s

Texture Rate

29.38 GTexel/s

1300 TFLOPS

FP16 (half)

3.760 TFLOPS

163.4 TFLOPS

FP32 (float)

1.880 TFLOPS

81.7 TFLOPS

FP64 (double)

940.0 GFLOPS

Graphics Processor

MI300

GPU Name

GA10B

-

GPU Variant

TE980M-A1

CDNA 3.0

Architecture

Ampere

TSMC

Foundry

Samsung

5 nm

Process Size

8 nm

146 billion

Transistors

Unknown

1017 mm²

Die Size

Unknown

Board Design

750W

TDP

25W

1000 W

Suggested PSU

-

No outputs

Outputs

Portable Device Dependent

None

Power Connectors

-

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

-

CUDA

8.6

N/A

Shader Model

6.7

Related GPU Comparisons

1

H200 SXM vs AMD Instinct MI300X

2

AMD Instinct MI300A vs AMD Instinct MI300X

3

AMD Instinct MI300X vs NVIDIA H100 SXM5 80 GB

4

AMD Instinct MI300X vs NVIDIA H100 PCIe 80 GB

5

AMD Instinct MI300X vs NVIDIA GeForce RTX 4090

6

AMD Instinct MI300X vs NVIDIA GeForce RTX 4090 D

7

AMD Instinct MI300X vs NVIDIA GeForce GTX 1060 6 GB

8

AMD Instinct MI300X vs NVIDIA Tesla X2090

9

AMD Instinct MI300X vs NVIDIA A10 PCIe

10

AMD Instinct MI300X vs NVIDIA RTX A5500 Mobile