NVIDIA RTX 4000 SFF Ada Generation vs AMD Radeon Instinct MI100

VS

NVIDIA RTX 4000 SFF Ada Generation AMD Radeon Instinct MI100

We compared two Professional market GPUs: 20GB VRAM RTX 4000 SFF Ada Generation and 32GB VRAM Radeon Instinct MI100 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA RTX 4000 SFF Ada Generation 's Advantages

Released 2 years and 4 months late

Boost Clock has increased by 4% (1560MHz vs 1502MHz)

Lower TDP (70W vs 300W)

AMD Radeon Instinct MI100 's Advantages

More VRAM (32GB vs 20GB)

Larger VRAM bandwidth (1229GB/s vs 280.0GB/s)

1536 additional rendering cores

Score

Benchmark

FP32 (float)

RTX 4000 SFF Ada Generation

19.17 TFLOPS

Radeon Instinct MI100 +20%

23.07 TFLOPS

RTX 4000 SFF Ada Generation

VS

Radeon Instinct MI100

Graphics Card

Mar 2023

Release Date

Nov 2020

Quadro Ada

Generation

Radeon Instinct

Professional

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

720 MHz

Base Clock

1000 MHz

1560 MHz

Boost Clock

1502 MHz

1750 MHz

Memory Clock

1200 MHz

Memory

20GB

Memory Size

32GB

GDDR6

Memory Type

HBM2

160bit

Memory Bus

4096bit

280.0GB/s

Bandwidth

1229GB/s

Render Config

48

SM Count

-

Compute Units

120

6144

Shading Units

7680

192

TMUs

480

80

ROPs

64

192

Tensor Cores

-

48

RT Cores

-

128 KB (per SM)

L1 Cache

16 KB (per CU)

48 MB

L2 Cache

8 MB

Theoretical Performance

124.8 GPixel/s

Pixel Rate

96.13 GPixel/s

299.5 GTexel/s

Texture Rate

721.0 GTexel/s

19.17 TFLOPS

FP16 (half)

184.6 TFLOPS

19.17 TFLOPS

FP32 (float)

23.07 TFLOPS

299.5 GFLOPS

FP64 (double)

11.54 TFLOPS

Graphics Processor

AD104

GPU Name

Arcturus

-

GPU Variant

Arcturus XL

Ada Lovelace

Architecture

CDNA 1.0

TSMC

Foundry

TSMC

5 nm

Process Size

7 nm

35.8 billion

Transistors

25.6 billion

294 mm²

Die Size

750 mm²

Board Design

70W

TDP

300W

250 W

Suggested PSU

700 W

4x mini-DisplayPort 1.4a

Outputs

No outputs

None

Power Connectors

2x 8-pin

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

2.1

1.3

Vulkan

N/A

8.9

CUDA

-

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA RTX A4500 vs NVIDIA RTX 4000 SFF Ada Generation

2

NVIDIA RTX A4000 vs NVIDIA RTX 4000 SFF Ada Generation

3

NVIDIA L4 vs NVIDIA RTX 4000 SFF Ada Generation

4

NVIDIA GeForce RTX 4090 vs NVIDIA RTX 4000 SFF Ada Generation

5

NVIDIA A100 PCIe vs NVIDIA RTX 4000 SFF Ada Generation

6

NVIDIA Quadro 4000 vs NVIDIA RTX 4000 SFF Ada Generation

7

AMD Radeon Instinct MI100 vs AMD Radeon Instinct MI50

8

NVIDIA RTX 4000 SFF Ada Generation vs NVIDIA GRID M60 1Q

9

NVIDIA RTX 4000 SFF Ada Generation vs NVIDIA Tesla M2070 Q

10

NVIDIA RTX 4000 SFF Ada Generation vs NVIDIA Tesla K10