illusion

Definition

The appearance of something that is not actually there. In research criticism it names a specific failure mode: scores improve while real capability does not, because the evaluation rewards the wrong thing. Common causes are test-set contamination, metrics that a shortcut can satisfy, and benchmarks whose tasks no longer discriminate between methods. The word targets the impression created, not any single wrong result.