Experiments for learning neural networks and pytorch, starting in Feb 2023. Large focus has been on learning Transformers.
Huge thanks to Andrej Karpathy for his YouTube lectures, which were incredibly helpful.
makemore_xformers is heavily inspired by https://github.com/karpathy/nanoGPT.