-
December 11, 2024Transformer Teardown: Build Your Own Llama Development Kit — Build a Collection of Reusable Building Blocks You Can Mix and Match in Your Own LLM Research Experiments
-
September 21, 2024Transformer Teardown: Llama 3.1 — Trace an Inference Through Each Layer of the SOTA Llama 3.1 Foundation Models
-
September 4, 2024Transformer Teardown: DistilBERT — See the Code Behind Fundamental Transformer Concepts Like Embeddings, Residuals, and Multi-Head Self-Attention