NVIDIA Jetson AGX Orin 32 GB vs NVIDIA GeForce RTX 4090

VS

NVIDIA Jetson AGX Orin 32 GB NVIDIA GeForce RTX 4090

We compared a Professional market GPU: 32GB VRAM Jetson AGX Orin 32 GB and a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA Jetson AGX Orin 32 GB 's Advantages

More VRAM (32GB vs 24GB)

Lower TDP (40W vs 450W)

NVIDIA GeForce RTX 4090 's Advantages

Boost Clock2520MHz

Larger VRAM bandwidth (1008GB/s vs 204.8GB/s)

14592 additional rendering cores

Score

Benchmark

FP32 (float)

Jetson AGX Orin 32 GB

3.333 TFLOPS

GeForce RTX 4090 +2377%

82.58 TFLOPS

Jetson AGX Orin 32 GB

VS

GeForce RTX 4090

Graphics Card

Feb 2023

Release Date

Sep 2022

Tegra

Generation

GeForce 40

Professional

Type

Desktop

PCIe 4.0 x4

Bus Interface

PCIe 4.0 x16

Clock Speeds

-

Base Clock

2235 MHz

-

Boost Clock

2520 MHz

1600 MHz

Memory Clock

1313 MHz

Memory

32GB

Memory Size

24GB

LPDDR5

Memory Type

GDDR6X

256bit

Memory Bus

384bit

204.8GB/s

Bandwidth

1008GB/s

Render Config

14

SM Count

128

-

Compute Units

-

1792

Shading Units

16384

56

TMUs

512

24

ROPs

176

56

Tensor Cores

512

-

RT Cores

128

128 KB (per SM)

L1 Cache

128 KB (per SM)

256 KB

L2 Cache

72 MB

Theoretical Performance

22.32 GPixel/s

Pixel Rate

443.5 GPixel/s

52.08 GTexel/s

Texture Rate

1290 GTexel/s

6.666 TFLOPS

FP16 (half)

82.58 TFLOPS

3.333 TFLOPS

FP32 (float)

82.58 TFLOPS

1.667 TFLOPS

FP64 (double)

1290 GFLOPS

Graphics Processor

GA10B

GPU Name

AD102

-

GPU Variant

AD102-300-A1

Ampere

Architecture

Ada Lovelace

Samsung

Foundry

TSMC

8 nm

Process Size

5 nm

Unknown

Transistors

76.3 billion

Unknown

Die Size

609 mm²

Board Design

40W

TDP

450W

-

Suggested PSU

850 W

Portable Device Dependent

Outputs

1x HDMI 2.1 3x DisplayPort 1.4a

-

Power Connectors

1x 16-pin

Graphics Features

12 Ultimate (12_2)

DirectX

12 Ultimate (12_2)

4.6

OpenGL

4.6

3.0

OpenCL

3.0

1.3

Vulkan

1.3

8.6

CUDA

8.9

6.7

Shader Model

6.7

Related GPU Comparisons

1

NVIDIA Jetson AGX Orin 64 GB vs NVIDIA Jetson AGX Orin 32 GB

2

NVIDIA GeForce RTX 3090 vs NVIDIA Jetson AGX Orin 32 GB

3

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA RTX A2000

4

NVIDIA GeForce RTX 4070 Mobile vs NVIDIA Jetson AGX Orin 32 GB

5

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Jetson AGX Xavier GPU

6

NVIDIA RTX A500 Mobile vs NVIDIA Jetson AGX Orin 32 GB

7

NVIDIA GeForce RTX 4090 vs NVIDIA A100 PCIe 80 GB

8

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Quadro M5000M

9

NVIDIA Jetson AGX Orin 32 GB vs Intel Data Center GPU Max 1550

10

NVIDIA Jetson AGX Orin 32 GB vs NVIDIA Quadro P2000 Mobile