audio

Definition

Sound signals in general — music, environmental sound, and speech alike. Models either operate on the raw waveform or on a time-frequency representation such as a spectrogram, and typical tasks include generation, recognition, separation, and captioning. It is the broader term: speech is the subset concerned specifically with spoken language.

Explainers using this term

• Paper Walkthrough — The Missing Temporal Link: Putting Script Timing on the Video–Audio Axis with Temporal Context RoutingThe Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation
• Paper Walkthrough: DreamX-Creator — Making Sound and Picture Together in 7B, Then Finishing at 2K in One StepDreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution
• Speech Synthesis from Scratch — From Text to a VoiceWaveNet: A Generative Model for Raw Audio