How LLMs work

What you’ll learn

• Tokenize text, embed words and watch attention pick what matters
• Train a small GPT and see its loss fall, checkpoint by checkpoint
• Fine-tune it to follow instructions, then teach it your taste with DPO
• Chat with the model you built and read every token it chose

For example: Build a tokenizer by merging letters, one pair at a time.

Levels