A100 SXM4 80GB vs A100 PCIe 80GB

Compare NVIDIA A100 SXM4 80GB and NVIDIA A100 PCIe 80GB specs, performance, and cloud pricing

A100 SXM4 80GB

80GB

From $1.10/hr

A100 PCIe 80GB

80GB

From $1.05/hr

Architecture

Ampere

vs Ampere

FP16 Gap

1.0x

A100 PCIe 80GB leads

SpecificationA100 SXM4 80GBA100 PCIe 80GB
VRAM80 GB80 GB
VRAM TypeHBM2eHBM2e
FP16 TFLOPS624 TFLOPS624 TFLOPS
FP8 TFLOPSN/AN/A
Memory Bandwidth2.0 TB/s2.0 TB/s
TDP400W300W
InterconnectNVLink 3PCIe Gen4
ArchitectureAmpereAmpere

Price Comparison

MetricA100 SXM4 80GBA100 PCIe 80GB
Cheapest On-Demand$1.10/hr$1.05/hr
Cheapest Spot$0.760/hr$0.740/hr
Providers Available63

Verdict

Best for Training

NVIDIA A100 SXM4 80GB

624 TFLOPS FP16 with 80GB VRAM

Best Value

NVIDIA A100 PCIe 80GB

594 TFLOPS per $/hr

Best for Inference

NVIDIA A100 SXM4 80GB

624 TFLOPS FP8/FP16

Use-Case Recommendations

Large-Scale Training

Training LLMs and large multi-modal models

Winner

A100 SXM4 80GB

624 TFLOPS FP16 with 80GB HBM2e provides the best training throughput.

Inference at Scale

Deploying models in production for real-time inference

Winner

A100 SXM4 80GB

624 TFLOPS FP8/FP16 gives superior inference throughput.

Budget-Conscious Workloads

Getting the best performance per dollar

Winner

A100 PCIe 80GB

Starting at $1.05/hr delivers the best TFLOPS per dollar.

Learn More