continually

Definition

"Continually" flags the streaming setting: data or tasks keep arriving and the model keeps updating, instead of training once on a frozen dataset and freezing the weights. Continual pre-training, for instance, keeps a base model current with new corpora rather than retraining from scratch. The word implies its own difficulty — every update risks overwriting what earlier updates installed — which is why it usually appears near "forgetting."