NVIDIA RTX 6000 Ada Generation vs NVIDIA H100 PCIe 96 GB

VS

NVIDIA RTX 6000 Ada Generation NVIDIA H100 PCIe 96 GB

AI GPU We compared a Desktop platform GPU: 48GB VRAM RTX 6000 Ada Generation and a GPU: 96GB VRAM H100 PCIe 96 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA RTX 6000 Ada Generation 's Advantages

Boost Clock has increased by 36% (2505MHz vs 1837MHz)

1280 additional rendering cores

Lower TDP (300W vs 700W)

NVIDIA H100 PCIe 96 GB 's Advantages

More VRAM (96GB vs 48GB)

Larger VRAM bandwidth (1681GB/s vs 960.0GB/s)

Score

Benchmark

FP32 (float)

RTX 6000 Ada Generation +46%

91.06 TFLOPS

H100 PCIe 96 GB

62.08 TFLOPS

RTX 6000 Ada Generation

VS

H100 PCIe 96 GB

Graphics Card

Dec 2022

Release Date

Mar 2023

Quadro Ada

Generation

Tesla Hopper

Desktop

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

915 MHz

Base Clock

1665 MHz

2505 MHz

Boost Clock

1837 MHz

2500 MHz

Memory Clock

1313 MHz

Memory

48GB

Memory Size

96GB

GDDR6

Memory Type

HBM3

384bit

Memory Bus

5120bit

960.0GB/s

Bandwidth

1681GB/s

Render Config

142

SM Count

132

-

Compute Units

-

18176

Shading Units

16896

568

TMUs

528

192

ROPs

24

568

Tensor Cores

528

142

RT Cores

-

128 KB (per SM)

L1 Cache

256 KB (per SM)

96 MB

L2 Cache

50 MB

Theoretical Performance

481.0 GPixel/s

Pixel Rate

44.09 GPixel/s

1423 GTexel/s

Texture Rate

969.9 GTexel/s

91.06 TFLOPS

FP16 (half)

248.3 TFLOPS

91.06 TFLOPS

FP32 (float)

62.08 TFLOPS

1423 GFLOPS

FP64 (double)

31.04 TFLOPS

Graphics Processor

AD102

GPU Name

GH100

AD102

GPU Variant

-

Ada Lovelace

Architecture

Hopper

TSMC

Foundry

TSMC

4 nm

Process Size

4 nm

76.3 billion

Transistors

80 billion

608 mm²

Die Size

814 mm²

Board Design

300W

TDP

700W

700 W

Suggested PSU

1100 W

4x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

9.0

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA RTX 6000 Ada Generation vs NVIDIA L40S

2

NVIDIA RTX A6000 vs NVIDIA RTX 6000 Ada Generation

3

NVIDIA RTX 6000 Ada Generation vs NVIDIA RTX 5000 Ada Generation

4

NVIDIA RTX 6000 Ada Generation vs NVIDIA L40

5

NVIDIA GeForce RTX 4090 vs NVIDIA RTX 6000 Ada Generation

6

NVIDIA L40S vs NVIDIA H100 PCIe 96 GB

7

NVIDIA GeForce RTX 4090 vs NVIDIA H100 PCIe 96 GB

8

NVIDIA RTX 6000 Ada Generation vs AMD Radeon R5 435 OEM

9

NVIDIA RTX 6000 Ada Generation vs NVIDIA GeForce GTX 1060 6 GB Rev. 2

10

NVIDIA RTX 6000 Ada Generation vs NVIDIA GeForce GT 545