Skip to content

LLM from Scratch

Notes from learning to build a large language model from scratch: working through tensors, attention, and the training loop by hand to understand how the pieces fit together.

The work lives in Jupyter notebooks, now rendered right here in the KB:

Source: github.com/zufardhiyaulhaq/llm-from-scratch.