stratified

Definition

Means the population has been divided into subgroups and handled group by group. Stratified sampling draws a fixed share from each stratum, which lowers the variance of an estimate and guarantees small subgroups are represented rather than lost to chance. In evaluation, reporting stratified results — by language, difficulty, or demographic slice — is a deliberate check against an aggregate average that hides systematic failure on a minority of cases.

Explainers using this term

• Paper Explained: StarHarness — Evolving the Scaffold Instead of the WeightsStarHarness: Evolving Harnesses with Stratified Search for Enterprise Environments