rethinking

Definition

A title convention announcing that the paper questions a settled assumption rather than proposing something wholly new. Papers named "Rethinking X" typically re-examine a standard architecture, training recipe, or evaluation protocol and show the received wisdom holds only under conditions people stopped checking. Expect ablations and negative results more than a new state of the art.

Explainers using this term

• Paper Walkthrough: One Training Example Keeps On-Policy Distillation Improving for Hundreds of StepsRethinking On-Policy Distillation of Large Language Models II: One Training Example
• Paper Walkthrough: Random Attention — Throwing KV Cache Entries Away at Random Works Just as WellRandom Attention: Rethinking KV Cache Eviction for Efficient Reasoning
• Benchmark Contamination — How to Doubt a High ScoreRethinking Benchmark and Contamination for Language Models with Rephrased Samples