online

Definition

Learning from data as it arrives, updating on the stream rather than on a fixed corpus. In RL it specifically means the learner collects fresh experience with its current policy and trains on that, as opposed to offline RL, which learns only from a previously logged dataset. Nothing to do with the everyday sense of being connected to the internet.

Explainers using this term

• Paper Walkthrough: Stop Anchoring to Frame One — Scal3R's Multi-Reference Relative Pose QueryScal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction
• Time-Series Anomaly Detection — The Math Behind the AlertsBayesian Online Changepoint Detection