B200 SXM 192GB vs RTX A6000

Compare NVIDIA B200 SXM 192GB and NVIDIA RTX A6000 specs, performance, and cloud pricing

B200 SXM 192GB

192GB

From $6.50/hr

RTX A6000

48GB

From $0.520/hr

Architecture

Blackwell

vs Ampere

FP16 Gap

14.5x

B200 SXM 192GB leads

SpecificationB200 SXM 192GBRTX A6000
VRAM192 GB48 GB
VRAM TypeHBM3eGDDR6
FP16 TFLOPS4.5 PFLOPS310 TFLOPS
FP8 TFLOPS9.0 PFLOPSN/A
Memory Bandwidth8.0 TB/s768 GB/s
TDP1000W300W
InterconnectNVLink 5NVLink
ArchitectureBlackwellAmpere

Price Comparison

MetricB200 SXM 192GBRTX A6000
Cheapest On-Demand$6.50/hr$0.520/hr
Cheapest Spot$4.32/hr$0.390/hr
Providers Available44

Verdict

Best for Training

NVIDIA B200 SXM 192GB

4.5 PFLOPS FP16 with 192GB VRAM

Best Value

NVIDIA B200 SXM 192GB

692 TFLOPS per $/hr

Best for Inference

NVIDIA B200 SXM 192GB

9.0 PFLOPS FP8/FP16

Use-Case Recommendations

Large-Scale Training

Training LLMs and large multi-modal models

Winner

B200 SXM 192GB

4.5 PFLOPS FP16 with 192GB HBM3e provides the best training throughput.

Inference at Scale

Deploying models in production for real-time inference

Winner

B200 SXM 192GB

9.0 PFLOPS FP8/FP16 gives superior inference throughput.

Budget-Conscious Workloads

Getting the best performance per dollar

Winner

B200 SXM 192GB

Starting at $6.50/hr delivers the best TFLOPS per dollar.

Learn More