AMD Radeon Instinct MI300 vs NVIDIA Jetson AGX Orin 32 GB

VS

AMD Radeon Instinct MI300 NVIDIA Jetson AGX Orin 32 GB

We compared two Professional market GPUs: 128GB VRAM Radeon Instinct MI300 and 32GB VRAM Jetson AGX Orin 32 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Radeon Instinct MI300 's Advantages

Boost Clock1700MHz

More VRAM (128GB vs 32GB)

Larger VRAM bandwidth (3277GB/s vs 204.8GB/s)

12288 additional rendering cores

NVIDIA Jetson AGX Orin 32 GB 's Advantages

Lower TDP (40W vs 600W)

Score

Benchmark

FP32 (float)

Radeon Instinct MI300 +1336%

47.87 TFLOPS

Jetson AGX Orin 32 GB

3.333 TFLOPS

Radeon Instinct MI300

VS

Jetson AGX Orin 32 GB

Graphics Card

Jan 2023

Release Date

Feb 2023

Radeon Instinct

Generation

Tegra

Professional

Type

Professional

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x4

Clock Speeds

1000 MHz

Base Clock

-

1700 MHz

Boost Clock

-

1600 MHz

Memory Clock

1600 MHz

Memory

128GB

Memory Size

32GB

HBM3

Memory Type

LPDDR5

8192bit

Memory Bus

256bit

3277GB/s

Bandwidth

204.8GB/s

Render Config

-

SM Count

14

220

Compute Units

-

14080

Shading Units

1792

880

TMUs

56

0

ROPs

24

880

Tensor Cores

56

-

RT Cores

-

16 KB (per CU)

L1 Cache

128 KB (per SM)

16 MB

L2 Cache

256 KB

Theoretical Performance

0 MPixel/s

Pixel Rate

22.32 GPixel/s

1496 GTexel/s

Texture Rate

52.08 GTexel/s

383.0 TFLOPS

FP16 (half)

6.666 TFLOPS

47.87 TFLOPS

FP32 (float)

3.333 TFLOPS

47.87 TFLOPS

FP64 (double)

1.667 TFLOPS

Graphics Processor

Aqua Vanjaram

GPU Name

GA10B

-

GPU Variant

-

CDNA 3.0

Architecture

Ampere

TSMC

Foundry

Samsung

5 nm

Process Size

8 nm

153 billion

Transistors

Unknown

1017 mm²

Die Size

Unknown

Board Design

600W

TDP

40W

1000 W

Suggested PSU

-

No outputs

Outputs

Portable Device Dependent

2x 8-pin

Power Connectors

-

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

-

CUDA

8.6

N/A

Shader Model

6.7

Related GPU Comparisons

1

AMD Radeon Instinct MI300 vs NVIDIA H100 PCIe

2

AMD Radeon Instinct MI300 vs H200 SXM

3

AMD Radeon Instinct MI300 vs NVIDIA A100 PCIe

4

AMD Radeon Instinct MI300 vs AMD Radeon Instinct MI250

5

AMD Radeon Instinct MI300 vs AMD Radeon Instinct MI250X

6

AMD Radeon Instinct MI300 vs Intel Data Center GPU Max 1550

7

AMD Radeon Instinct MI300 vs AMD Radeon Instinct MI210

8

AMD Radeon Instinct MI300 vs NVIDIA RTX A5500 Max-Q

9

AMD Radeon Instinct MI300 vs NVIDIA Tesla M2070

10

AMD Radeon Instinct MI300 vs NVIDIA Quadro NVS 320M