transfer

Definition

Reusing what was learned on one task to help another — the premise behind pre-train-then-adapt. It pays off most where the target task has little data, since the representation carries structure the target set could never supply on its own. When source and target are too dissimilar the effect reverses, which is called negative transfer, so transfer is a hypothesis to test rather than a guarantee.