llm-based

Definition

States that a general-purpose language model sits at the core of a system, in a role that previously required a purpose-built component. The appeal is development speed; the cost is inheriting the model's properties wholesale — nondeterminism, per-call expense, dependence on an external provider, and version drift that quietly breaks reproducibility. The design question worth asking is which parts were handed to the model and which were kept deterministic.

Explainers using this term

• Paper Walkthrough: StudentSim — Training a Simulator That Is Actually *That* StudentStudentSim: Training LLM-based Student Simulators