asi-bench

Definition

The name of a benchmark aimed at measuring capability at or beyond the superintelligence level. Suites like this exist because established exams saturate — once frontier models score near the ceiling, the test stops discriminating — so the response is harder items that spread scores out again. The label is aspirational, though: what counts as surpassing humans is fixed by the designers' scoring rules, which is what you should read.

Explainers using this term

• Paper walkthrough: ASI-Bench — peeling away human guidance to measure what AI can do aloneASI-Bench: At the Dawn of Artificial Superintelligence