rubric-centered

Definition

Organising evaluation around an explicit rubric — a checklist of criteria, each scored — rather than around a single reference answer. It suits outputs where many good answers exist: research plans, essays, code reviews. The distinguishing feature is that the standard of quality is written down rather than implied by a gold label, which makes disagreement visible and makes LLM-as-judge scoring auditable.

Explainers using this term

• Paper Walkthrough: PaperGym — Turning One Paper Into a Graded Training Environment for Research PlansPaperGym: Rubric-Centered Evolution for Research-Plan Generation