Vol. IV · 14
LoRA: Why Fine-Tuning a Billion-Parameter Model Only Takes a Few Million Parameters
LoRA Deep Dive · Part 1
Full fine-tuning of a large language model is brutally expensive — not because of the forward pass, but because training multiplies memory.
Read entry