NVIDIA A100 PCIe vs NVIDIA Jetson AGX Orin 64 GB

VS

NVIDIA A100 PCIe NVIDIA Jetson AGX Orin 64 GB

AI GPU We compared a GPU: 40GB VRAM A100 PCIe and a Professional market GPU: 64GB VRAM Jetson AGX Orin 64 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA A100 PCIe 's Advantages

Boost Clock1410MHz

Larger VRAM bandwidth (1555GB/s vs 204.8GB/s)

4864 additional rendering cores

NVIDIA Jetson AGX Orin 64 GB 's Advantages

Released 2 years and 9 months late

More VRAM (64GB vs 40GB)

Lower TDP (60W vs 250W)

Score

Benchmark

FP32 (float)

A100 PCIe +266%

19.49 TFLOPS

Jetson AGX Orin 64 GB

5.325 TFLOPS

A100 PCIe

VS

Jetson AGX Orin 64 GB

Graphics Card

Jun 2020

Release Date

Mar 2023

Tesla

Generation

Tegra

AI GPU

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x4

Clock Speeds

765 MHz

Base Clock

-

1410 MHz

Boost Clock

-

1215 MHz

Memory Clock

1600 MHz

Memory

40GB

Memory Size

64GB

HBM2e

Memory Type

LPDDR5

5120bit

Memory Bus

256bit

1555GB/s

Bandwidth

204.8GB/s

Render Config

108

SM Count

16

-

Compute Units

-

6912

Shading Units

2048

432

TMUs

64

160

ROPs

32

432

Tensor Cores

64

-

RT Cores

-

192 KB (per SM)

L1 Cache

128 KB (per SM)

40 MB

L2 Cache

256 KB

Theoretical Performance

225.6 GPixel/s

Pixel Rate

41.60 GPixel/s

609.1 GTexel/s

Texture Rate

83.20 GTexel/s

77.97 TFLOPS

FP16 (half)

10.65 TFLOPS

19.49 TFLOPS

FP32 (float)

5.325 TFLOPS

9.746 TFLOPS

FP64 (double)

2.662 TFLOPS

Graphics Processor

GA100

GPU Name

GA10B

-

GPU Variant

-

Ampere

Architecture

Ampere

TSMC

Foundry

Samsung

7 nm

Process Size

8 nm

54.2 billion

Transistors

Unknown

826 mm²

Die Size

Unknown

Board Design

250W

TDP

60W

600 W

Suggested PSU

-

No outputs

Outputs

Portable Device Dependent

8-pin EPS

Power Connectors

-

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

8.0

CUDA

8.6

N/A

Shader Model

6.7

Related GPU Comparisons

1

NVIDIA L4 vs NVIDIA A100 PCIe

2

NVIDIA Tesla T4 vs NVIDIA A100 PCIe

3

NVIDIA H100 PCIe vs NVIDIA A100 PCIe

4

NVIDIA A100 PCIe vs NVIDIA L40

5

NVIDIA A100 PCIe vs NVIDIA A40 PCIe

6

NVIDIA A100 PCIe vs NVIDIA A10 PCIe

7

NVIDIA A100 PCIe vs NVIDIA RTX 6000 Ada

8

NVIDIA A100 PCIe vs NVIDIA H800 SXM5

9

NVIDIA A100 PCIe vs NVIDIA H100 PCIe 96 GB

10

NVIDIA A100 PCIe vs NVIDIA A800 PCIe 40 GB