Glossary › solve
GLOSSARY
solve
appears in 2 paper titles
Definition
To produce a correct answer — though in benchmark contexts the interesting question is what counts as solved. Grading on final-answer match is weaker than grading by execution or proof checking, since a right answer can follow from wrong reasoning. And solving a benchmark is not solving the domain it samples from; the distance between those two readings is where much overclaiming happens.