Tag:awq

The Outlier Problem: The Discovery That Shaped Modern Quantization

Quantization · Part 2

Here's a puzzle that stumped the field around 2022. Quantization recipes that worked beautifully on small language models — clean INT8, minimal quality loss — fell off a cliff on big ones.