task

Definition

One unit of work with a defined input, an expected output, and a way of being scored; benchmarks are assembled by collecting many of them. The word carries the field's evaluation assumptions, which is why it appears in multi-task, task-specific, and downstream task. For general-purpose models the live question is transfer: whether performance holds on tasks that were never in the training mixture.

Explainers using this term

• Paper Walkthrough: SemComp-Bench — Asking Video Generators 'So Did It Actually Get Done?'SemComp-Bench: Benchmarking Semantic Task Completion in Video Generation
• Paper Walkthrough — FACET: Grounding Instruction, Environment, Solution and Verifier in One Executable StateFACET: Preserving Source Intent and Executable State in Terminal Task Synthesis