noisy

Definition

Describes data or a signal containing errors, mislabels, or random variation. Noisy labels are the common case — web-scraped and crowd-annotated corpora are never clean — and robustness to them separates methods that survive real data from methods that only work on curated sets. Contrast diffusion models, where noise is deliberately injected as part of the process rather than being unwanted contamination.

Explainers using this term

• Paper Explained: Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-ImprovementDoes On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement