thin

Definition

Describing a network with few units or channels per layer, usually paired with deep as in "thin and deep" — a design that spends its parameter budget on depth rather than width. Thin models are cheaper in memory and FLOPs but harder to optimize, since narrow layers restrict information flow and gradients degrade, which is why they are often trained with distillation or intermediate supervision.