GPU SmithCOMPUTE ENGINEERING

lora vs full fine tuning memory

1 article

LoRA and QLoRA GPU Memory: How Much VRAM Do You Need?

A memory ledger for LoRA and QLoRA fine-tuning: frozen base weights, adapter optimizer state, activations and checkpointing, mapped to 24-141 GB GPUs.

October 28, 2026• 17 min read
qlora vram requirementslora fine tuning gpu memoryhow much gpu memory to fine tune llama lora