speech

Definition

Spoken language as an audio signal, covering recognition, synthesis, speaker separation, and speech-to-speech translation. The characteristic difficulty is variability: the same words differ by speaker, accent, rate, and background noise, while the signal itself is continuous with no clean word boundaries. It is a subset of audio, distinguished by carrying linguistic content.

Explainers using this term

• Paper Walkthrough: X-AuT — Pull Audio-Encoder Layers Out Two at a Time, Then Backfill from a Bigger TeacherX-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation
• Paper Walkthrough: AuK — Folding Speech Generation and Editing Into One ModelAuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing
• Paper Walkthrough: Motion-Omni — Speaking and Moving in One Forward PassMotion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue