Students Professional
JA EN

#audio-tokens

2 articles

01 ·Audio & Speech·★ MEMBER·PAPER·13 min read Representing Sound — Mel Spectrograms and Audio Tokens Why speech models never eat raw waveforms, and what they eat instead: the chain from short-time Fourier transform to the mel scale to the log to discrete tokens. Covers the window-length tradeoff, why MFCCs dropped the DCT, how acoustic and semantic tokens differ, and the config mismatches that silently wreck audio in production. 02 ·Audio Codecs·★ MEMBER·PAPER·12 min read Neural Audio Codecs — EnCodec and the Foundation Under Speech LLMs MP3 and Opus were hand-designed around what the ear cannot hear. Neural audio codecs learn the coding itself and turn sound into a finite alphabet of integers. From vector quantization to residual VQ, EnCodec's bitrate arithmetic, and why VALL-E and AudioLM are built on top of it — starting from zero.