task-agnostic

Definition

Built without committing to a particular downstream task. A task-agnostic pretraining or distillation procedure produces a general representation that can later be adapted to many tasks, which is the whole appeal of foundation models. Its counterpart is task-specific, tuned for one job and usually stronger on it; the pair names a real trade-off between reuse and peak per-task performance.