rehearsal

Definition

In continual learning, replaying earlier data while training on a new task so the model does not lose what it already had — the standard defence against catastrophic forgetting. Variants differ in where the replayed examples come from: experience replay keeps a buffer of real ones, pseudo-rehearsal generates substitutes from a model of the old distribution. The competing family is regularization-based methods, which store nothing and instead constrain how far weights may move.

Explainers using this term

• Paper Walkthrough: EnvACE — Agents That Rehearse the World Instead of Calling ItEnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning