#gpt

3 articles

01 ·How Transformers Work·★ MEMBER·PAPER·12 min read Build Your Own Mini GPT — A Language Model in 300 Lines Write a character-level GPT in PyTorch from an empty file: tokenizer, causally masked self-attention, training loop, and temperature sampling — then watch Shakespeare's formatting emerge from nothing but next-character prediction. 02 ·How Transformers Work·★ MEMBER·PAPER·9 min read Encoder or Decoder — The Fork in the Road Between BERT and GPT One masked triangle in the attention table is what separated BERT from GPT. This piece works through bidirectional versus autoregressive with the equations and an interactive figure, then asks why generation won and where encoders are still the first choice. 03 ·Model Families·★ MEMBER·9 min read The GPT Lineage — Design Thinking from GPT-1 to Today A generation-by-generation walk from GPT-1 to GPT-4o and the reasoning models, asking what changed and what deliberately did not. At the centre sits one machine that only ever predicts the next token; what moved was scale, the order of training, and how the output was disciplined.