huffman

Definition

A lossless coding scheme that assigns shorter bit patterns to more frequent symbols, named after its inventor. In model compression it appears as the final stage of the classic pruning-quantization-Huffman pipeline: once weights have been reduced to a small set of shared values, their skewed frequency distribution makes entropy coding pay off. Unlike quantization it discards nothing and is exactly reversible, so it shrinks stored size rather than runtime cost.