semcomp-bench

Definition

A named benchmark aimed at semantic capability. The -Bench suffix reliably tells you the artifact is an evaluation suite — tasks, data, and a scoring protocol — rather than a model or a method. What the first element abbreviates is not recoverable from the name; semantic composition and semantic compression are both plausible readings, so the measured construct and the scoring rules must be taken from the introducing paper.

Explainers using this term

• Paper Walkthrough: SemComp-Bench — Asking Video Generators 'So Did It Actually Get Done?'SemComp-Bench: Benchmarking Semantic Task Completion in Video Generation