JA EN
Glossary › solve

GLOSSARY

solve

appears in 2 paper titles

Definition

To produce a correct answer — though in benchmark contexts the interesting question is what counts as solved. Grading on final-answer match is weaker than grading by execution or proof checking, since a right answer can follow from wrong reasoning. And solving a benchmark is not solving the domain it samples from; the distance between those two readings is where much overclaiming happens.