instruction

Definition

A natural-language statement of what the model should do. Instruction tuning is the fine-tuning stage that teaches a model to treat such statements as commands rather than as text to continue, using many pairs of instructions and desired responses. Most of the behavioural gap between a raw pretrained checkpoint and a usable chat model comes from this stage plus preference optimization on top of it.