assistants

Definition

AI systems positioned as helpers acting on a user's behalf, spanning everything from a chat responder to a tool-calling agent that operates external software. In evaluation contexts the word marks a shift in what is measured: not raw capability on a fixed task, but whether the system was actually useful for a request as a person phrased it, which is why assistant benchmarks lean on open-ended, multi-step questions.