AMD Radeon Instinct MI50 vs NVIDIA H100 PCIe 96 GB

VS

AMD Radeon Instinct MI50 NVIDIA H100 PCIe 96 GB

AI GPU We compared a Professional market GPU: 16GB VRAM Radeon Instinct MI50 and a GPU: 96GB VRAM H100 PCIe 96 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Radeon Instinct MI50 's Advantages

Lower TDP (300W vs 700W)

NVIDIA H100 PCIe 96 GB 's Advantages

Released 4 years and 4 months late

Boost Clock has increased by 5% (1837MHz vs 1746MHz)

More VRAM (96GB vs 16GB)

Larger VRAM bandwidth (1681TB/s vs 1.02TB/s)

13056 additional rendering cores

Score

Benchmark

FP32 (float)

Radeon Instinct MI50

13.41 TFLOPS

H100 PCIe 96 GB +362%

62.08 TFLOPS

Radeon Instinct MI50

VS

H100 PCIe 96 GB

Graphics Card

Nov 2018

Release Date

Mar 2023

Radeon Instinct

Generation

Tesla Hopper

Professional

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1200 MHz

Base Clock

1665 MHz

1746 MHz

Boost Clock

1837 MHz

1000 MHz

Memory Clock

1313 MHz

Memory

16GB

Memory Size

96GB

HBM2

Memory Type

HBM3

4096bit

Memory Bus

5120bit

1.02TB/s

Bandwidth

1681GB/s

Render Config

-

SM Count

132

60

Compute Units

-

3840

Shading Units

16896

240

TMUs

528

64

ROPs

24

-

Tensor Cores

528

-

RT Cores

-

16 KB (per CU)

L1 Cache

256 KB (per SM)

4 MB

L2 Cache

50 MB

Theoretical Performance

111.7 GPixel/s

Pixel Rate

44.09 GPixel/s

419.0 GTexel/s

Texture Rate

969.9 GTexel/s

26.82 TFLOPS

FP16 (half)

248.3 TFLOPS

13.41 TFLOPS

FP32 (float)

62.08 TFLOPS

6.705 TFLOPS

FP64 (double)

31.04 TFLOPS

Graphics Processor

Vega 20

GPU Name

GH100

Vega 20 GLXT

GPU Variant

-

GCN 5.1

Architecture

Hopper

TSMC

Foundry

TSMC

7 nm

Process Size

4 nm

13.23 billion

Transistors

80 billion

331 mm²

Die Size

814 mm²

Board Design

300W

TDP

700W

700 W

Suggested PSU

1100 W

1x mini-DisplayPort 1.4a

Outputs

No outputs

2x 8-pin

Power Connectors

8-pin EPS

Graphics Features

12 (12_1)

DirectX

N/A

4.6

OpenGL

N/A

2.1

OpenCL

3.0

1.3

Vulkan

N/A

-

CUDA

9.0

6.7

Shader Model

N/A

Related GPU Comparisons

1

AMD Radeon Instinct MI25 vs AMD Radeon Instinct MI50

2

AMD Radeon Instinct MI50 vs AMD Radeon VII

3

AMD Radeon Instinct MI50 vs NVIDIA Tesla P40

4

NVIDIA Tesla P100 PCIe 16 GB vs AMD Radeon Instinct MI50

5

AMD Radeon Instinct MI50 vs NVIDIA Tesla V100 PCIe 16 GB

6

AMD Radeon Instinct MI50 vs NVIDIA Tesla K80

7

AMD Radeon Instinct MI50 vs NVIDIA Quadro RTX 3000 Mobile Refresh

8

AMD Radeon Instinct MI50 vs NVIDIA Quadro 2000D

9

AMD Radeon Instinct MI50 vs NVIDIA Tesla S870

10

AMD Radeon Instinct MI50 vs NVIDIA Quadro NVS 440 PCIe x16