smaller

Definition

Almost always about model size, and almost always part of a claim: this smaller model matches or beats a much larger one. The mechanisms are distillation, better data, or a stronger training recipe rather than architectural magic. What is really being sold is inference economics — a model small enough to serve cheaply, or to run on one device, changes what you can build with it.