prediction

Definition

Producing an estimate of something not given — the next token, a future frame, a held-out label. Its importance is that a trivially cheap objective, predict what comes next, supplies unlimited supervision from raw data and turns out to induce grammar, factual knowledge, and reasoning-like behaviour at scale. Classification, regression, and generation are all framings of the same underlying prediction problem.

Explainers using this term

• Paper Walkthrough: EarlyEval — Making Agent Evaluation Cheaper by Stopping EarlyEarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction
• Paper Walkthrough: Alpamayo — NVIDIA's Reasoning Model for Autonomous DrivingAlpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail