NVIDIA A10G vs NVIDIA H100 SXM5 64 GB

VS

AI GPU We compared a Professional market GPU: 12GB VRAM A10G and a GPU: 64GB VRAM H100 SXM5 64 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA A10G 's Advantages

Lower TDP (150W vs 700W)

NVIDIA H100 SXM5 64 GB 's Advantages

Released 1 years and 11 months late

Boost Clock has increased by 16% (1980MHz vs 1710MHz)

More VRAM (64GB vs 12GB)

Larger VRAM bandwidth (1008GB/s vs 600.2GB/s)

7680 additional rendering cores

Score

Benchmark

FP32 (float)

A10G

31.52 TFLOPS

H100 SXM5 64 GB +112%

66.91 TFLOPS

A10G

VS

H100 SXM5 64 GB

Graphics Card

Apr 2021

Release Date

Mar 2023

Tesla

Generation

Tesla Hopper

Professional

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1320 MHz

Base Clock

1665 MHz

1710 MHz

Boost Clock

1980 MHz

1563 MHz

Memory Clock

1313 MHz

Memory

12GB

Memory Size

64GB

GDDR6

Memory Type

HBM3

384bit

Memory Bus

3072bit

600.2GB/s

Bandwidth

1008GB/s

Render Config

72

SM Count

132

-

Compute Units

-

9216

Shading Units

16896

288

TMUs

528

96

ROPs

24

288

Tensor Cores

528

72

RT Cores

-

128 KB (per SM)

L1 Cache

256 KB (per SM)

6 MB

L2 Cache

50 MB

Theoretical Performance

164.2 GPixel/s

Pixel Rate

47.52 GPixel/s

492.5 GTexel/s

Texture Rate

1045 GTexel/s

31.52 TFLOPS

FP16 (half)

267.6 TFLOPS

31.52 TFLOPS

FP32 (float)

66.91 TFLOPS

985.0 GFLOPS

FP64 (double)

33.45 TFLOPS

Graphics Processor

GA102

GPU Name

GH100

GA102-890-A1

GPU Variant

-

Ampere

Architecture

Hopper

Samsung

Foundry

TSMC

8 nm

Process Size

4 nm

28.3 billion

Transistors

80 billion

628 mm²

Die Size

814 mm²

Board Design

150W

TDP

700W

450 W

Suggested PSU

1100 W

No outputs

Outputs

No outputs

8-pin EPS

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.6

CUDA

9.0

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA Tesla T4 vs NVIDIA A10G

2

NVIDIA Tesla V100 PCIe 16 GB vs NVIDIA A10G

3

NVIDIA GeForce RTX 4090 vs NVIDIA A10G

4

NVIDIA A10G vs NVIDIA L4

5

NVIDIA A10G vs NVIDIA A10 PCIe

6

NVIDIA H100 PCIe vs NVIDIA A10G

7

NVIDIA H100 SXM5 64 GB vs NVIDIA H800 SXM5

8

NVIDIA A10G vs NVIDIA RTX A1000 Embedded

9

NVIDIA A10G vs Intel Data Center GPU Flex 170

10

NVIDIA A10G vs NVIDIA Tesla P100 DGXS