length-controlled

Definition

An evaluation setting that statistically removes the advantage verbose answers enjoy, since LLM judges reliably prefer longer responses and a model can climb a leaderboard simply by padding. The length-controlled variant of AlpacaEval fits the relationship between response length and win rate, then reports the win rate with the length term factored out. Note it does not constrain generation length — it corrects the scoring after the fact.