denoising

Definition

Recovering a clean signal from a corrupted one, and the training objective built on that idea. Diffusion models turn generation into repeated denoising: start from pure noise and remove a little at each step, guided by a network trained to predict what was added. The operation is the one signal processing always used; what changed is that it became a way to generate data rather than to clean it.

Explainers using this term

• Build Your Own Diffusion Model — Starting from MNISTDenoising Diffusion Probabilistic Models
• Diffusion Models from the Ground Up — Add Noise, Then Subtract ItDenoising Diffusion Probabilistic Models