Learn LLM internals step by step - from tokenization to attention to inference optimization.
-
Updated
Oct 14, 2026
Learn LLM internals step by step - from tokenization to attention to inference optimization.
Learn how language models work by building a Bigram model from scratch — first with pure Python, then with PyTorch. Every line is heavily commented for beginners.
Between 2023 and 2026, the number of people working with LLMs (Large Language Models) has grown fast, but most of them get stuck at one particular level. They can make API calls and write prompts, but they have no answers to questions like these: what is the model actually doing inside, why did a fine-tune work or not, and why did an agent get stuc
Build an LLM inference engine from scratch in pure C with no frameworks.
To associate your repository with the learn-llm topic, visit your repo's landing page and select "manage topics."