lima

Definition

A LLaMA-based model from Meta fine-tuned on roughly a thousand carefully curated prompt-response pairs, with no reinforcement learning from human feedback. Its argument, captured in the name Less Is More for Alignment, is that pretraining already holds the knowledge and alignment mostly teaches response format and style, so a small high-quality set can suffice. It is a standard citation in data-quality-versus-quantity debates.