Rebuilding "Attention Is All You Need" From Scratch on a Mac M1 with 16GB of RAM
An ~11M-parameter Transformer built tensor by tensor on a single MacBook — the full math, the build order, and the findings only constrained hardware surfaces.
transformers
1 post
