smelt

Definition

Ordinarily the metallurgical process of extracting metal from ore; here it is a coined method name. Names like this are usually chosen for the metaphor — separating something valuable from surrounding material — and the metaphor may hint at intent, such as distillation or pruning, without telling you the mechanism. Since it is invented, the inputs, outputs, and procedure have to be read from the paper that introduced it.

Explainers using this term

• Paper Walkthrough — SMELT: Is Looping the Same Layers Twice Actually a Win When the Budget Is Matched?SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers