#vae

3 articles

01 ·Audio & Speech·★ MEMBER·PAPER·9 min read Paper Walkthrough: AuK — Folding Speech Generation and Editing Into One Model AuK is an open-source foundation model that puts speech generation, editing, enhancement and separation behind one door: a natural-language instruction plus optional audio. A ground-up walkthrough of its data design, MMDiT backbone, rectified flow, human-preference and GRPO post-training, and four-step distillation. 02 ·Generative Models·FREE·10 min read VAEs from Scratch — Stir Probability into "Compress and Restore" and You Get a Generator An autoencoder that only compresses and restores cannot invent anything new. This walks through why a single drop of probability turns it into a generative model — ELBO, the reparameterization trick, and walking the latent space — assuming no prior knowledge. 03 ·Information Theory·★ MEMBER·PAPER·9 min read KL Divergence From Scratch — Measuring the Gap Between Two Distributions KL divergence measures the gap between two probability distributions. We build it up from a compression metaphor to the definition, its famous asymmetry, and a numpy implementation — then watch it at work as the regularizer in VAEs and the leash in RLHF.