production

Definition

The live environment serving real users, as opposed to a research or staging setup. Latency budgets, uptime, cost per request, and on-call consequences all become binding constraints, and the input distribution includes traffic no benchmark anticipated. When a paper advertises production data or production deployment, it is claiming its numbers survived those conditions — which is a substantially stronger claim than a leaderboard result, and worth checking for scale and duration.

Explainers using this term

• Paper Walkthrough: From Production Traffic to Post-Training — Folding 200 Internal Apps Into One Self-Hosted LLMFrom Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix