#language-model

1 articles

01 ·FREE·PAPER·9 min read Paper Walkthrough: AURORA-LM — A Diffusion Language Model That Keeps Its Text Latent Full-Width Instead of Compressing It A walkthrough of AURORA-LM, a continuous-latent diffusion language model that rejects the usual compromise of compressing text latents to make diffusion easier. It keeps a decodable, width-1024 latent and learns its distribution with a low-rank input pathway, width-calibrated noise, and self-trajectory consistency.