NVIDIA Jetson AGX Orin 32 GB vs AMD Instinct MI300A

VS

NVIDIA Jetson AGX Orin 32 GB AMD Instinct MI300A

We compared two Professional market GPUs: 32GB VRAM Jetson AGX Orin 32 GB and 128GB VRAM AMD Instinct MI300A to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA Jetson AGX Orin 32 GB 's Advantages

Lower TDP (40W vs 760W)

AMD Instinct MI300A 's Advantages

Released 10 months late

Boost Clock2100MHz

More VRAM (128GB vs 32GB)

Larger VRAM bandwidth (5300GB/s vs 204.8GB/s)

12800 additional rendering cores

Score

Benchmark

FP32 (float)

Jetson AGX Orin 32 GB

3.333 TFLOPS

AMD Instinct MI300A +3578%

122.6 TFLOPS

Jetson AGX Orin 32 GB

VS

AMD Instinct MI300A

Graphics Card

Feb 2023

Release Date

Dec 2023

Tegra

Generation

Instinct

Professional

Type

Professional

PCIe 4.0 x4

Bus Interface

PCIe 5.0 x16

Clock Speeds

-

Base Clock

1000 MHz

-

Boost Clock

2100 MHz

1600 MHz

Memory Clock

5200 MHz

Memory

32GB

Memory Size

128GB

LPDDR5

Memory Type

HBM3

256bit

Memory Bus

8192bit

204.8GB/s

Bandwidth

5300GB/s

Render Config

14

SM Count

-

Compute Units

228

1792

Shading Units

14592

56

TMUs

880

24

ROPs

0

56

Tensor Cores

-

RT Cores

-

128 KB (per SM)

L1 Cache

16 KB (per CU)

256 KB

L2 Cache

16 MB

Theoretical Performance

22.32 GPixel/s

Pixel Rate

0 MPixel/s

52.08 GTexel/s

Texture Rate

1496 GTexel/s

6.666 TFLOPS

FP16 (half)

980.6 TFLOPS

3.333 TFLOPS

FP32 (float)

122.6 TFLOPS

1.667 TFLOPS

FP64 (double)

61.3 TFLOPS

Graphics Processor

GA10B

GPU Name

MI300

-

GPU Variant

-

Ampere

Architecture

CDNA 3.0

Samsung

Foundry

TSMC

8 nm

Process Size

5 nm

Unknown

Transistors

146 billion

Unknown

Die Size

1017 mm²

Board Design

40W

TDP

760W

-

Suggested PSU

1000 W

Portable Device Dependent

Outputs

No outputs

-

Power Connectors

None

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.6

CUDA

-

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 3090 vs NVIDIA Jetson AGX Orin 32 GB

2

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA GeForce RTX 4090

3

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Jetson AGX Xavier GPU

4

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA GeForce RTX 4080 16 GB

5

NVIDIA GeForce RTX 4070 Mobile vs NVIDIA Jetson AGX Orin 32 GB

6

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Tesla M2070 Q

7

NVIDIA RTX A2000 vs NVIDIA Jetson AGX Orin 32 GB

8

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Tesla P40

9

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Quadro K5000

10

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Quadro K2000