Tag:low-rank adaptation

LoRA: Why Fine-Tuning a Billion-Parameter Model Only Takes a Few Million Parameters

LoRA Deep Dive · Part 1

Full fine-tuning of a large language model is brutally expensive — not because of the forward pass, but because training multiplies memory.