NVIDIA H100 CNX vs NVIDIA A100 SXM4 40 GB

VS

AI GPUAI GPU We compared two GPUs: 80GB VRAM H100 CNX and 40GB VRAM A100 SXM4 40 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA H100 CNX 's Advantages

Released 2 years and 10 months late

Boost Clock has increased by 31% (1845MHz vs 1410MHz)

More VRAM (80GB vs 40GB)

Larger VRAM bandwidth (2039GB/s vs 1555GB/s)

7680 additional rendering cores

Lower TDP (350W vs 400W)

Score

Benchmark

FP32 (float)

H100 CNX +176%

53.84 TFLOPS

A100 SXM4 40 GB

19.49 TFLOPS

H100 CNX

VS

A100 SXM4 40 GB

Graphics Card

Mar 2023

Release Date

May 2020

Tesla Hopper

Generation

Tesla Ampere

AI GPU

Type

AI GPU

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

690 MHz

Base Clock

1095 MHz

1845 MHz

Boost Clock

1410 MHz

1593 MHz

Memory Clock

1215 MHz

Memory

80GB

Memory Size

40GB

HBM2e

Memory Type

HBM2e

5120bit

Memory Bus

5120bit

2039GB/s

Bandwidth

1555GB/s

Render Config

114

SM Count

108

-

Compute Units

-

14592

Shading Units

6912

456

TMUs

432

24

ROPs

160

456

Tensor Cores

432

-

RT Cores

-

256 KB (per SM)

L1 Cache

192 KB (per SM)

50 MB

L2 Cache

40 MB

Theoretical Performance

44.28 GPixel/s

Pixel Rate

225.6 GPixel/s

841.3 GTexel/s

Texture Rate

609.1 GTexel/s

215.4 TFLOPS

FP16 (half)

77.97 TFLOPS

53.84 TFLOPS

FP32 (float)

19.49 TFLOPS

26.92 TFLOPS

FP64 (double)

9.746 TFLOPS

Graphics Processor

GH100

GPU Name

GA100

-

GPU Variant

-

Hopper

Architecture

Ampere

TSMC

Foundry

TSMC

4 nm

Process Size

7 nm

80 billion

Transistors

54.2 billion

814 mm²

Die Size

826 mm²

Board Design

350W

TDP

400W

750 W

Suggested PSU

800 W

No outputs

Outputs

No outputs

8-pin EPS

Power Connectors

None

Graphics Features

N/A

DirectX

N/A

OpenGL

N/A

3.0

OpenCL

3.0

N/A

Vulkan

N/A

9.0

CUDA

8.0

N/A

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA H100 CNX vs NVIDIA Tesla V100 PCIe 32 GB

2

NVIDIA H100 CNX vs AMD Radeon Instinct MI250

3

NVIDIA H100 CNX vs NVIDIA RTX A6000

4

NVIDIA H100 CNX vs NVIDIA H100 SXM5

5

NVIDIA H100 CNX vs NVIDIA A100 PCIe

6

AMD Radeon Instinct MI300 vs NVIDIA H100 CNX

7

NVIDIA GRID RTX T10 8 vs NVIDIA H100 CNX

8

NVIDIA H100 CNX vs NVIDIA H100 SXM5 80 GB

9

NVIDIA H100 CNX vs H200 SXM

10

NVIDIA H100 CNX vs NVIDIA A100 PCIe