normalized

Definition

Divided by something so that scale no longer matters — a vector by its norm, activations by their standard deviation, a count by a total. The word is incomplete on its own: normalised cosine similarity, normalised discounted gain and normalised activations share nothing but the operation. When you meet it, find the denominator before assuming the meaning.

Explainers using this term

• Paper Walkthrough: Normalized Low-Rank Adaptation — Why Normalizing LoRA's Entry Matrix WorksNormalized Low-Rank Adaptation