extension

Definition

Stretching a limit rather than redesigning around it. In long-context work, extension almost always means context length extension: making a model accept inputs longer than anything it saw in pretraining, usually by interpolating its position embeddings and fine-tuning briefly. The implication is economy — you keep the existing weights and widen them, instead of retraining from scratch at the longer length.