precision

Definition

Two unrelated senses share the word. In systems contexts it is numeric width — FP32, BF16, INT8 — and appears in mixed-precision training and quantisation, where the question is how few bits a computation tolerates. In evaluation it is the fraction of positive predictions that were correct, always read against recall, since either can be inflated at the other's expense. The neighbours disambiguate: mixed and low point to bits, recall and F1 to the metric.

Explainers using this term

• Mixed Precision Training — Going Faster in fp16/bf16/fp8 Without BreakingMixed Precision Training