L4 vs RTX 4090

Compare NVIDIA L4 and NVIDIA RTX 4090 specs, performance, and cloud pricing

L4

24GB

From $0.350/hr

RTX 4090

24GB

From $0.370/hr

Architecture

Ada Lovelace

vs Ada Lovelace

FP16 Gap

2.9x

L4 leads

SpecificationL4RTX 4090
VRAM24 GB24 GB
VRAM TypeGDDR6GDDR6X
FP16 TFLOPS242 TFLOPS83 TFLOPS
FP8 TFLOPS485 TFLOPS166 TFLOPS
Memory Bandwidth300 GB/s1.0 TB/s
TDP72W450W
InterconnectPCIe Gen4None
ArchitectureAda LovelaceAda Lovelace

Price Comparison

MetricL4RTX 4090
Cheapest On-Demand$0.350/hr$0.370/hr
Cheapest Spot$0.210/hr$0.280/hr
Providers Available33

Verdict

Best for Training

NVIDIA L4

242 TFLOPS FP16 with 24GB VRAM

Best Value

NVIDIA L4

691 TFLOPS per $/hr

Best for Inference

NVIDIA L4

485 TFLOPS FP8/FP16

Use-Case Recommendations

Large-Scale Training

Training LLMs and large multi-modal models

Winner

L4

242 TFLOPS FP16 with 24GB GDDR6 provides the best training throughput.

Inference at Scale

Deploying models in production for real-time inference

Winner

L4

485 TFLOPS FP8/FP16 gives superior inference throughput.

Budget-Conscious Workloads

Getting the best performance per dollar

Winner

L4

Starting at $0.350/hr delivers the best TFLOPS per dollar.

Learn More