factuality

Definition

The degree to which generated content matches reality. It is the positive framing of hallucination, and it has to be measured separately from fluency, since the failure mode is precisely well-written text that is wrong. Distinguish it from coherence: coherence can be judged from the text alone, whereas factuality requires checking claims against an external source, which is what makes it expensive to evaluate at scale.

Explainers using this term

• Multi-Agent Design Patterns — Division, Debate, VerificationImproving Factuality and Reasoning in Language Models through Multiagent Debate