NVIDIA Tesla T4 vs NVIDIA H100 SXM5

VS

NVIDIA Tesla T4 NVIDIA H100 SXM5

We compared a Professional market GPU: 16GB VRAM Tesla T4 and a GPU: 80GB VRAM H100 SXM5 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA Tesla T4's Advantages

Lower TDP (70W vs 700W)

NVIDIA H100 SXM5's Advantages

Released 3 years and 6 months late

Boost Clock has increased by 25% (1980MHz vs 1590MHz)

More VRAM (80GB vs 16GB)

Larger VRAM bandwidth (3350GB/s vs 320.0GB/s)

14336 additional rendering cores

Score

Benchmark

FP32 (float)

Tesla T4

8.141 TFLOPS

H100 SXM5 +721%

66.91 TFLOPS

Tesla T4

VS

H100 SXM5

Graphics Card

Sep 2018

Release Date

Mar 2022

Tesla

Generation

Tesla Hopper

Professional

Type

AI GPU

PCIe 3.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

585MHz

Base Clock

1590MHz

Boost Clock

1980MHz

1250MHz

Memory Clock

1313MHz

Memory

16GB

Memory Size

80GB

GDDR6

Memory Type

HBM3

256bit

Memory Bus

5120bit

320.0 GB/s

Bandwidth

3350 GB/s

Render Config

40

SM Count

132

-

Compute Units

-

2560

Shading Units

16896

160

TMUs

528

64

ROPs

24

320

Tensor Cores

528

40

RT Cores

-

64 KB (per SM)

L1 Cache

256 KB (per SM)

4MB

L2 Cache

50MB

Theoretical Performance

101.8 GPixel/s

Pixel Rate

47.52 GPixel/s

254.4 GTexel/s

Texture Rate

1045 GTexel/s

65.13 TFLOPS

FP16 (half)

267.6 TFLOPS

8.141 TFLOPS

FP32 (float)

66.91 TFLOPS

254.4 GFLOPS

FP64 (double)

33.45 TFLOPS

Graphics Processor

TU104

GPU Name

GH100

TU104-895-A1

GPU Variant

-

Turing

Architecture

Hopper

TSMC

Foundry

TSMC

12 nm

Process Size

4 nm

13,600 million

Transistors

80,000 million

545mm²

Die Size

814mm²

Board Design

70W

TDP

700W

250W

Suggested PSU

1100W

No outputs

Outputs

No outputs

None

Power Connectors

8-pin EPS

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

7.5

CUDA

9.0

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA Tesla T4 vs NVIDIA L4

2

NVIDIA Tesla T4 vs NVIDIA A100 PCIe

3

NVIDIA Tesla T4 vs NVIDIA GeForce RTX 3060

4

NVIDIA Tesla T4 vs NVIDIA GeForce RTX 4090

5

NVIDIA Tesla T4 vs NVIDIA Tesla V100 DGXS 16 GB

6

NVIDIA Tesla T4 vs NVIDIA A10G

7

NVIDIA A2 vs NVIDIA Tesla T4

8

NVIDIA Tesla T4 vs NVIDIA Quadro FX 570

9

NVIDIA Tesla T4 vs NVIDIA Quadro M1000M

10

NVIDIA Tesla T4 vs NVIDIA Quadro T1000 Mobile GDDR6