Generative Models
Diffusion, VAE, GAN — models that create
01
·Generative Models·★ MEMBER·PAPER·9 min read
Diffusion Models from the Ground Up — Add Noise, Then Subtract It
A reading of the DDPM paper (Ho et al., 2020) grounded strictly in its own text: the forward process that adds noise and the reverse process that removes it, why the objective settles into 'predict the noise', how a simplified loss hurt likelihood while improving samples, and what the paper does and does not say about step count.
02
·Generative Models·FREE·10 min read
VAEs from Scratch — Stir Probability into "Compress and Restore" and You Get a Generator
An autoencoder that only compresses and restores cannot invent anything new. This walks through why a single drop of probability turns it into a generative model — ELBO, the reparameterization trick, and walking the latent space — assuming no prior knowledge.
03
·Generative Models·★ MEMBER·PAPER·10 min read
The Rise and Fall of GANs — An Invention Trained by Rivalry, and Why Diffusion Won
In 2014, GANs upended image generation with one idea: don't write down what 'realistic' means — learn it. This traces the decade that followed, through mode collapse, the Wasserstein rescue, and the reasons diffusion models eventually took the crown.
04
·Generative Models·★ MEMBER·PAPER·10 min read
Flow Matching from Scratch — What Came After Diffusion, and Why It Goes Straight
Flow matching — the formulation underneath Stable Diffusion 3 and FLUX — explained with no prerequisites. Velocity fields, ODEs, and rectified flow, told through analogy and interactive figures, all the way to the scheduler settings you actually touch in production.
05
·Generative Models·★ MEMBER·PAPER·8 min read
CFG and Samplers — What the "Strength" Knob in Generative AI Really Does
What "CFG Scale" and "Sampling steps / method" actually do inside an image generator, explained from zero. CFG extrapolates along the difference between the conditional and unconditional prediction; the sampler is a numerical ODE solver. Both knobs trade something away.
06
·Generative Models·★ MEMBER·PAPER·11 min read
The Mathematics of Diffusion — Generation Seen Through Scores and SDEs
A layer beneath 'add noise, then subtract it': diffusion models restated in the language of the score, the gradient of log-density. Why denoising and score estimation are literally the same job, what the forward SDE, reverse SDE and probability flow ODE actually assert, and how those equations turn into the knobs you set at inference time.
07
·Generative Models·FREE·PAPER·11 min read
A Practical Map of Image Generation — SD, ControlNet, and Applying LoRA
A single map for anyone about to touch image generation for the first time: the four boxes of latent diffusion, where the prompt actually takes effect, locking down composition with ControlNet, fine-tuning with LoRA, and the licensing layers that quietly cause the most damage.
08
·Generative Models·★ MEMBER·PAPER·9 min read
Music and Audio Generation from Scratch — Sound as Tokens
A three-minute song is more than 15 million numbers. The history of music generation is largely the history of folding that sequence down to something a model can hold. Codec tokens, the fork between autoregressive and diffusion approaches, how text conditioning actually bites, and how to reconstruct the shape of Suno-style products from published parts — no prior knowledge assumed.
09
·Generative Models·★ MEMBER·PAPER·10 min read
The State of 3D Generation — From NeRF to Gaussian Splatting
3D stopped being something you sculpt and became something you fit by optimization. How the representation moved from meshes to NeRF to Gaussian Splatting, how SDS turns a 2D diffusion model into a judge that supervises 3D, and what breaks when you take any of it into a game or film pipeline.
10
·Generative Models·★ MEMBER·PAPER·11 min read
Build Your Own Diffusion Model — Starting from MNIST
A diffusion model built up from nothing on 28×28 handwritten digits: the two conditions a noise schedule has to satisfy, how the step number gets injected into a U-Net, and why the sampler adds noise back at the very end — the places you only discover by writing the code yourself.