optimizations

Definition

Engineering changes that make a system faster or cheaper without changing what it computes — kernel fusion, quantization, KV-cache management, better batching and scheduling. Papers list them as a bundle because the gains are multiplicative and individually small. Do not confuse this sense with optimization as in minimizing a loss; that is the optimizer's job and lives in a different part of the paper.