automated

Definition

Describes a pipeline that runs without a human in the loop — automated evaluation, automated data generation, automated experiment design. The appeal is scale: a process that no longer needs annotators can be run thousands of times. The cost is that quality control shifts from the people doing the work to whatever proxy now judges it, so it is worth reading such papers for what still gets checked by hand.

Explainers using this term

• Evaluating RAG in Practice — Turning “Seems Better” Into a NumberRAGAS: Automated Evaluation of Retrieval Augmented Generation