project-grounded

Definition

Indicates that a task or system is anchored in a whole real codebase rather than an isolated snippet: the model must respect existing file layout, dependencies, and conventions instead of writing something self-contained. This is substantially harder than function-level benchmarks and much closer to the actual work. Grounded here means tied to a concrete artifact; it is not a claim that the outputs are correct.

Explainers using this term

• Paper Explainer: SemaPLC — The Agent That Isn't Allowed to Say "Done"SemaPLC: A Project-Grounded, Verification-Gated Agent Harness for PLC Code Generation