#benchmark-contamination

1 articles

01 ·Distillation & Compression·★ MEMBER·PAPER·9 min read Evaluating Distilled Models — Is "Close to the Teacher" a Good Metric? Score a distilled student by how often it agrees with its teacher and the students that faithfully reproduce the teacher's mistakes come out on top. What agreement actually guarantees, what breaks outside the training distribution, and how to test for contamination that arrives paraphrased through synthetic data.