Tag:rank

The LoRA Knobs: Rank, Alpha, Targets, and the Settings Everyone Copies Without Understanding

LoRA Deep Dive · Part 3

Every LoRA config file has the same handful of lines — r, alpha, dropout, targetmodules, learning rate — and almost everyone (me included, at first) fills them in by copying a config that worked for someone else.