alignment

Definition

Making a model's behaviour conform to human intent, values, or a specified set of norms — refusing harmful requests, following the spirit of an instruction rather than gaming its letter. RLHF, constitutional methods, and preference optimization are all alignment techniques. Note a separate, unrelated technical sense of the word: in multimodal and translation work, alignment means putting two representations or sequences into correspondence.