NVIDIA GeForce RTX 4090 vs AMD Radeon Instinct MI300A
We compared two Desktop platform GPUs: 24GB VRAM GeForce RTX 4090 and 192GB VRAM Radeon Instinct MI300A to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA GeForce RTX 4090 's Advantages
Boost Clock has increased by 20% (2520MHz vs 2100MHz)
Lower TDP (450W vs 750W)
AMD Radeon Instinct MI300A 's Advantages
Released 1 years and 3 months late
More VRAM (192GB vs 24GB)
Larger VRAM bandwidth (10.3TB/s vs 1.01TB/s)
3072 additional rendering cores
Score
Benchmark
FP32 (float)
GeForce RTX 4090
+1%
82.58 TFLOPS
Radeon Instinct MI300A
81.72 TFLOPS
Graphics Card
Sep 2022
Release Date
Dec 2023
GeForce 40
Generation
Radeon Instinct
Desktop
Type
Desktop
PCIe 4.0 x16
Bus Interface
PCIe 5.0 x16
Clock Speeds
2235 MHz
Base Clock
1000 MHz
2520 MHz
Boost Clock
2100 MHz
1313 MHz
Memory Clock
2525 MHz
Memory
24GB
Memory Size
192GB
GDDR6X
Memory Type
HBM3
384bit
Memory Bus
8192bit
1.01TB/s
Bandwidth
10.3TB/s
Render Config
-
Compute Units
304
128
SM Count
-
16384
Shading Units
19456
512
TMUs
1216
176
ROPs
0
512
Tensor Cores
1216
128
RT Cores
-
128 KB (per SM)
L1 Cache
16 KB (per CU)
72 MB
L2 Cache
16 MB
-
L3 Cache
256 MB
Theoretical Performance
443.5 GPixel/s
Pixel Rate
0 MPixel/s
1290 GTexel/s
Texture Rate
2554 GTexel/s
82.58 TFLOPS
FP16 (half)
653.7 TFLOPS
82.58 TFLOPS
FP32 (float)
81.72 TFLOPS
1290 GFLOPS
FP64 (double)
81.72 TFLOPS
Board Design
450W
TDP
750W
850 W
Suggested PSU
1150 W
1x HDMI 2.1
3x DisplayPort 1.4a
Outputs
No outputs
1x 16-pin
Power Connectors
None
Graphics Processor
AD102
GPU Name
Aqua Vanjaram
AD102-300-A1
GPU Variant
-
Ada Lovelace
Architecture
CDNA 3.0
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
76.3 billion
Transistors
153 billion
609 mm²
Die Size
1017 mm²
Graphics Features
12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.9
CUDA
-
6.8
Shader Model
N/A
