variants

Definition

Members of a family that differ in one swapped component — the framing of papers like "GLU Variants Improve Transformer." Seeing the word tells you what kind of contribution to expect: not a new framework, but a controlled comparison holding everything else fixed so the effect of that one choice is isolated. These ablation-style papers are often what actually settles which design becomes the default.