AMD Instinct MI300A vs NVIDIA Jetson AGX Orin 32 GB

VS

AMD Instinct MI300A NVIDIA Jetson AGX Orin 32 GB

We compared two Professional market GPUs: 128GB VRAM AMD Instinct MI300A and 32GB VRAM Jetson AGX Orin 32 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Instinct MI300A 's Advantages

Released 10 months late

Boost Clock2100MHz

More VRAM (128GB vs 32GB)

Larger VRAM bandwidth (5300GB/s vs 204.8GB/s)

12800 additional rendering cores

NVIDIA Jetson AGX Orin 32 GB 's Advantages

Lower TDP (40W vs 760W)

Score

Benchmark

FP32 (float)

AMD Instinct MI300A +3578%

122.6 TFLOPS

Jetson AGX Orin 32 GB

3.333 TFLOPS

AMD Instinct MI300A

VS

Jetson AGX Orin 32 GB

Graphics Card

Dec 2023

Release Date

Feb 2023

Instinct

Generation

Tegra

Professional

Type

Professional

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x4

Clock Speeds

1000 MHz

Base Clock

-

2100 MHz

Boost Clock

-

5200 MHz

Memory Clock

1600 MHz

Memory

128GB

Memory Size

32GB

HBM3

Memory Type

LPDDR5

8192bit

Memory Bus

256bit

5300GB/s

Bandwidth

204.8GB/s

Render Config

-

SM Count

14

228

Compute Units

-

14592

Shading Units

1792

880

TMUs

56

0

ROPs

24

-

Tensor Cores

56

-

RT Cores

-

16 KB (per CU)

L1 Cache

128 KB (per SM)

16 MB

L2 Cache

256 KB

Theoretical Performance

0 MPixel/s

Pixel Rate

22.32 GPixel/s

1496 GTexel/s

Texture Rate

52.08 GTexel/s

980.6 TFLOPS

FP16 (half)

6.666 TFLOPS

122.6 TFLOPS

FP32 (float)

3.333 TFLOPS

61.3 TFLOPS

FP64 (double)

1.667 TFLOPS

Graphics Processor

MI300

GPU Name

GA10B

-

GPU Variant

-

CDNA 3.0

Architecture

Ampere

TSMC

Foundry

Samsung

5 nm

Process Size

8 nm

146 billion

Transistors

Unknown

1017 mm²

Die Size

Unknown

Board Design

760W

TDP

40W

1000 W

Suggested PSU

-

No outputs

Outputs

Portable Device Dependent

None

Power Connectors

-

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

-

CUDA

8.6

N/A

Shader Model

6.7

Related GPU Comparisons

1

AMD Instinct MI300A vs AMD Instinct MI300X

2

NVIDIA L40 vs AMD Instinct MI300A

3

NVIDIA Jetson AGX Orin 64 GB vs AMD Instinct MI300A

4

NVIDIA RTX A2000 12 GB vs AMD Instinct MI300A

5

AMD Radeon Instinct MI8 vs AMD Instinct MI300A

6

AMD Instinct MI300A vs NVIDIA Tesla T10 Processor

7

AMD Instinct MI300A vs AMD Radeon PRO W7800

8

AMD Instinct MI300A vs NVIDIA GRID K180Q

9

AMD Instinct MI300A vs NVIDIA Tesla K8

10

AMD Instinct MI300A vs NVIDIA Quadro M2000