quantized

Definition

Having had weights or activations rounded from higher-precision floats down to a coarser representation — 8-bit, 4-bit, sometimes lower. It is the standard way to shrink a model's memory footprint and speed up inference, since decoding is usually bandwidth-bound; the open question is always how much accuracy is lost. Despite the shared root, this has nothing to do with quantum computing: it simply means discretised.