{"type": "article", "title": "Writing an LLM from scratch, part 34b -- from bigrams to GPT-2, one component at a time (in JAX)", "publisher": "Web Pulse", "url": "https://wpnews.pro/news/writing-an-llm-from-scratch-part-34b-from-bigrams-to-gpt-2-one-component-at-a-in", "original_source": "https://www.gilesthomas.com/2026/07/llm-from-scratch-34b-building-and-training-gpt-2-small-in-jax", "published": "2026-07-08T17:59:57.661129+00:00", "accessed": "2026-07-08", "id": "writing-an-llm-from-scratch-part-34b-from-bigrams-to-gpt-2-one-component-at-a-in"}