audio

Definition

Sound signals in general — music, environmental sound, and speech alike. Models either operate on the raw waveform or on a time-frequency representation such as a spectrogram, and typical tasks include generation, recognition, separation, and captioning. It is the broader term: speech is the subset concerned specifically with spoken language.

Explainers using this term

• Paper Walkthrough: Dynamic Band Splitting — Letting Each Mixture Decide Where the Frequency Bands GoLearning Where to Split: Dynamic Band Splitting for Audio Source Separation
• Paper Walkthrough: X-AuT — Pull Audio-Encoder Layers Out Two at a Time, Then Backfill from a Bigger TeacherX-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation
• Paper Walkthrough — The Missing Temporal Link: Putting Script Timing on the Video–Audio Axis with Temporal Context RoutingThe Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation