LLM from Scratch¶
Notes from learning to build a large language model from scratch: working through tensors, attention, and the training loop by hand to understand how the pieces fit together.
The work lives in Jupyter notebooks, now rendered right here in the KB:
- Walkthrough — the main build.
- Tensors — tensor basics.