H100 SXM5 80GB vs RTX 4090

Compare NVIDIA H100 SXM5 80GB and NVIDIA RTX 4090 specs, performance, and cloud pricing

H100 SXM5 80GB

80GB

From $2.20/hr

RTX 4090

24GB

From $0.370/hr

Architecture

Hopper

vs Ada Lovelace

FP16 Gap

23.8x

H100 SXM5 80GB leads

SpecificationH100 SXM5 80GBRTX 4090
VRAM80 GB24 GB
VRAM TypeHBM3GDDR6X
FP16 TFLOPS2.0 PFLOPS83 TFLOPS
FP8 TFLOPS4.0 PFLOPS166 TFLOPS
Memory Bandwidth3.4 TB/s1.0 TB/s
TDP700W450W
InterconnectNVLink 4None
ArchitectureHopperAda Lovelace

Price Comparison

MetricH100 SXM5 80GBRTX 4090
Cheapest On-Demand$2.20/hr$0.370/hr
Cheapest Spot$1.35/hr$0.280/hr
Providers Available73

Verdict

Best for Training

NVIDIA H100 SXM5 80GB

2.0 PFLOPS FP16 with 80GB VRAM

Best Value

NVIDIA H100 SXM5 80GB

900 TFLOPS per $/hr

Best for Inference

NVIDIA H100 SXM5 80GB

4.0 PFLOPS FP8/FP16

Use-Case Recommendations

Large-Scale Training

Training LLMs and large multi-modal models

Winner

H100 SXM5 80GB

2.0 PFLOPS FP16 with 80GB HBM3 provides the best training throughput.

Inference at Scale

Deploying models in production for real-time inference

Winner

H100 SXM5 80GB

4.0 PFLOPS FP8/FP16 gives superior inference throughput.

Budget-Conscious Workloads

Getting the best performance per dollar

Winner

H100 SXM5 80GB

Starting at $2.20/hr delivers the best TFLOPS per dollar.

Learn More