foundation

Definition

Almost always part of "foundation model": a large model pre-trained broadly and then adapted to many downstream tasks. The term, introduced by researchers at Stanford, names a shift in practice — build one general model and specialise it, rather than train a separate model per task. It stresses the model's role as shared infrastructure, and the fact that its flaws propagate to everything built on it.

Explainers using this term

• Paper Explained: RayOrch — Batching Children Across Parents on GPUs Without Losing Track of Who Owns WhatRayOrch: Programming and Executing Lineage-Controlled Multi-Grain Dataflows for Foundation-Model Data Preparation
• Paper Explained: LIT — Stopping Robots from Cheating on Visual Cues by Giving Vision a Single DoorwayBreaking the Vision-Action Shortcut: Latent Interface Training for Generalizable Robotics Foundation Models
• Paper Explained: OmniEdu — Building an Open Education LLM Around Four Skills: Solve, Place, Diagnose, GuideOmniEdu: Open Foundation Models for Learning and Teaching