scale

Definition

In this field, the size of the system — parameters, training tokens, and compute — as in "at scale" or "scaling up". Its significance is empirical: performance improves predictably as these quantities grow, and that observation has driven the strategy of the last several years of model development. The everyday senses of scale, meaning a measuring scale or a ratio, are rarely what is meant here.

Explainers using this term

• Paper Walkthrough — RoboTok: Mining the Web for Demonstrations That Move Like YoursRoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning
• Paper Walkthrough — UrbanGround: Where MLLM Agents Break Down on a Real StreetUrbanGround: From Local Perception to Spatial Agency in a Real-Scale City
• The ImageNet Moment — The Day Deep Learning WonImageNet Large Scale Visual Recognition Challenge