Every Number Has a Parent
How LLM training actually works, shown in a working miniature transformer-style model with 44 knobs that you can train in your browser. Tokens, embeddings, Q K V attention, logits, loss, backpropagation and Adam, with every number traced...