#instruction-tuning

2 articles

01 ·Large Language Models·★ MEMBER·PAPER·7 min read Paper Explained: OmniEdu — Building an Open Education LLM Around Four Skills: Solve, Place, Diagnose, Guide A from-scratch walkthrough of OmniEdu, an open K-12 LLM family: how ~1.34M candidate examples were curated down to 60,951, how per-example teaching instructions let one model either answer or hold back, and what the results and limitations actually show. 02 ·Training & Alignment·FREE·PAPER·9 min read Instruction Tuning and RLHF from Scratch — How a Model Learns to Follow Orders A pretrained model ignores your instructions not because it lacks the ability but because it was optimised for something else. Working only from the InstructGPT paper (Ouyang et al., 2022): the three stages — SFT, reward model, RL — down to the equations, the claim that a 1.3B model beat a 175B one in human evaluation, and the limits the authors themselves put in writing.