Introduction
Start your journey here. Understand the fundamental concepts and why Transformers changed everything.
The Mathematics
Deep dive into the equations. Explore Self-Attention, Positional Encoding, and the math that makes it work.
Reference Papers
Explore the 40+ foundational research papers cited in the original work to understand the context.
Meet the Authors
Connect with the brilliant researchers from Google Brain and Google Research who authored the paper.
FAQ
Common questions answered. Understand the nuances of the Transformer architecture and the paper.
Interactive Explainer
Visualize the magic. An interactive, animated guide to seeing exactly how the Transformer processes text.
LLM 3D Visualization
Explore the 3D structure of an LLM. A stunning visualization by bbycroft.net.
Transformer Evolution
Follow the journey from the original Transformer paper to modern reasoning-centric LLMs, with curated PDFs and resources.
Paper Versions
Access the original 2017 paper and the updated versions directly in your browser.