looparena

Definition

A named evaluation environment where agents run a task repeatedly in a loop and competing approaches are compared under matched conditions. The arena convention, inherited from Chatbot Arena and its descendants, means results come out as relative standings — win rates or ratings from head-to-head comparison — rather than absolute scores against a fixed answer key. Consult the paper for the specific task set it defines.

Explainers using this term

• Paper Walkthrough: LoopArena — Benchmarking the Model That Steers a Coding AgentLoopArena: Benchmarking Models as Runtime Controllers for Loop Engineering