weak

Definition

Marks a supervision signal, or a supervisor, of limited quality — not a judgement of the model in general. Weak supervision means learning from labels that are noisy, incomplete, or produced by heuristics rather than experts. Weak-to-strong is a separate question: how far a less capable teacher can elicit the abilities of a stronger student, used as a stand-in for humans overseeing models that exceed them at the task.

Explainers using this term

• Representing Sound — Mel Spectrograms and Audio TokensRobust Speech Recognition via Large-Scale Weak Supervision
• Paper Deep-Dive: Why Whisper Is Robust — Large-Scale Weak SupervisionRobust Speech Recognition via Large-Scale Weak Supervision