Giles Thomas completed building and training a GPT-2 small model from scratch using JAX, achieving a test loss of 3.418784, outperforming both his PyTorch model (3.538161) and the original GPT-2 small…
Giles Thomas built a JAX training loop for an LLM from scratch, using NNX and Optax, as part of a project to replicate GPT-2 small quality without referencing Sebastian Raschka's book. He trained a ba…
Ian Barber argues that large language models have entered the engineering phase long familiar in recommendation systems, where performance is now part of the research loop rather than an afterthought.…
Researchers Sebastian Raschka released a curated list of LLM research papers from January to May 2026, focusing on reasoning models, reinforcement learning, and efficient inference. The list, organize…
A developer who has spent years working extensively with PyTorch has begun exploring JAX, a competing machine learning framework, and reports finding it cleaner and more mathematically pure. The autho…