AMD Radeon Instinct MI300A vs NVIDIA RTX 3500 Embedded Ada Generation
We compared two Desktop platform GPUs: 192GB VRAM Radeon Instinct MI300A and 12GB VRAM RTX 3500 Embedded Ada Generation to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
AMD Radeon Instinct MI300A 's Advantages
Released 9 months late
More VRAM (192GB vs 12GB)
Larger VRAM bandwidth (10.3TB/s vs 432.0GB/s)
14336 additional rendering cores
NVIDIA RTX 3500 Embedded Ada Generation 's Advantages
Boost Clock has increased by 7% (2250MHz vs 2100MHz)
Lower TDP (100W vs 750W)
Score
Benchmark
FP32 (float)
Radeon Instinct MI300A
+254%
81.72 TFLOPS
RTX 3500 Embedded Ada Generation
23.04 TFLOPS
Graphics Card
Dec 2023
Release Date
Mar 2023
Radeon Instinct
Generation
Quadro Ada-M
Desktop
Type
Desktop
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16
Clock Speeds
1000 MHz
Base Clock
1725 MHz
2100 MHz
Boost Clock
2250 MHz
2525 MHz
Memory Clock
2250 MHz
Memory
192GB
Memory Size
12GB
HBM3
Memory Type
GDDR6
8192bit
Memory Bus
192bit
10.3TB/s
Bandwidth
432.0GB/s
Render Config
304
Compute Units
-
-
SM Count
40
19456
Shading Units
5120
1216
TMUs
160
0
ROPs
64
1216
Tensor Cores
160
-
RT Cores
40
16 KB (per CU)
L1 Cache
128 KB (per SM)
16 MB
L2 Cache
48 MB
256 MB
L3 Cache
-
Theoretical Performance
0 MPixel/s
Pixel Rate
144.0 GPixel/s
2554 GTexel/s
Texture Rate
360.0 GTexel/s
653.7 TFLOPS
FP16 (half)
23.04 TFLOPS
81.72 TFLOPS
FP32 (float)
23.04 TFLOPS
81.72 TFLOPS
FP64 (double)
360.0 GFLOPS
Board Design
750W
TDP
100W
1150 W
Suggested PSU
300 W
No outputs
Outputs
No outputs
None
Power Connectors
None
Graphics Processor
Aqua Vanjaram
GPU Name
AD104
-
-
-
CDNA 3.0
Architecture
Ada Lovelace
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
153 billion
Transistors
35.8 billion
1017 mm²
Die Size
294 mm²
Graphics Features
N/A
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
3.0
OpenCL
3.0
N/A
Vulkan
1.3
-
CUDA
8.9
N/A
Shader Model
6.7
