frozen

Definition

Held fixed during training — the parameters still run in the forward pass but receive no gradient updates. Freezing a large pretrained encoder or LLM and training only a connector, adapter, or small head is standard practice: it slashes the compute and memory needed, and it prevents catastrophic forgetting of what the backbone already knows. The word describes the optimization, not the computation, so a frozen module is fully active at inference.