This is a personal notebook to learn and experiment theories in the deep-learning space from math to code. Everything is designed to be simple enough to be easily understandable with basic knowledge in linear algebra and Python.
Also all the code is written in Python using tinygrad.
- Good understanding of linear algebra (matrices, derivative, vectors)
- Understand basics of Python and programming
I recommend you to clone the repository and read the markdown files in Obsidian, VS Code markdown reader or other software you prefer.
Then you should install the packages by running uv
You can check in the md/ directory to find the documents linked with scripts.
python3 -m scripts.attentionor
uv run -m scripts.attention