papergym

Definition

A coined name for an environment in which research work itself is posed as a trainable, scorable task. The naming echoes OpenAI Gym: the claim is that steps of the research process — reading, planning, writing, reviewing — can be packaged as episodes an agent repeatedly attempts and is graded on. As a proper noun, its task set and scoring come from the paper that defines it.

Explainers using this term

• Paper Walkthrough: PaperGym — Turning One Paper Into a Graded Training Environment for Research PlansPaperGym: Rubric-Centered Evolution for Research-Plan Generation