ruler

Definition

A synthetic long-context benchmark from NVIDIA. It generalises needle-in-a-haystack retrieval into harder categories — multi-hop tracing, aggregation over many scattered items, long-context question answering — each generated at any target length. Its contribution was showing that a model's effective context length, the point where accuracy still holds up, is typically far shorter than its advertised window; the everyday word means a measuring stick.