Start a project

Fig. I — A run, in order

Quantization

4 parts, read in order — each one assumes the one before it. Back toall runs orthe full archive.

Start at the beginning

The parts

Every series I've written so far has bumped into quantization from the side — QLoRA compressing frozen bases, the optimization guide's memory math, GGUF files on Hugging Face with cryptic suffixes.

  1. Quantization From the Bits Up: How 4-Bit Models Actually Work
  2. The Outlier Problem: The Discovery That Shaped Modern Quantization
  3. GGUF and the Art of Choosing a Quant: A Field Guide to Local Models
  4. Below Four Bits: QAT, BitNet, and the Race Toward One-Bit Intelligence