executable

Definition

In a form that can actually be run, not merely read. Requiring a model to emit executable code or an executable plan changes evaluation: the output is judged by running it and checking the result, rather than by human judgement or overlap with a reference answer. That is why execution-based grading has become the preferred measure in code work. It is not proof of correctness, though — passing only certifies behavior on the tests that exist.

Explainers using this term

• Paper Walkthrough: Code as Worlds — An Agent That Writes the World Down as Runnable CodeCode as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning
• Paper Walkthrough — FACET: Grounding Instruction, Environment, Solution and Verifier in One Executable StateFACET: Preserving Source Intent and Executable State in Terminal Task Synthesis