Students Professional
JA EN

#audio-generation

2 articles

01 ·Generative Models·★ MEMBER·PAPER·9 min read Music and Audio Generation from Scratch — Sound as Tokens A three-minute song is more than 15 million numbers. The history of music generation is largely the history of folding that sequence down to something a model can hold. Codec tokens, the fork between autoregressive and diffusion approaches, how text conditioning actually bites, and how to reconstruct the shape of Suno-style products from published parts — no prior knowledge assumed. 02 ·Audio & Speech·★ MEMBER·PAPER·10 min read Paper Walkthrough: SwanTale — Designing Voices from Words Alone, with Speech and Sound in One Waveform ByteDance's SwanTale handles two jobs in one model: cloning a voice from reference audio (zero-shot) and building voices, ambience, and sound effects purely from a natural-language caption (instruct). We walk through the paper, from the 70M-caption data pipeline to Unified MoE routing and GRPO post-training.