Students Professional
JA EN

#rejection-sampling

1 articles

01 ·Distillation & Compression·★ MEMBER·PAPER·8 min read Designing Distillation Data — Deciding What to Ask the Teacher What decides a distilled student's quality is less how smart the teacher is than what you asked the teacher to answer. Synthetic data generation, coverage design, why you should skew toward hard problems, correctness filtering, and why DeepSeek-R1's distillation worked — from first principles.