Andrej Karpathy's LLM Wiki has evolved its search methodology to eliminate token waste caused by agents retrieving entire files for single relevant sections. The system now uses targeted retrieval to …
Anthropic held an onboarding day where a speaker was introduced in a manner compared to Michael Scott introducing Karpathy. The event's details were not accessible due to JavaScript being disabled in …
The article introduces LLM Wiki V3, a concept document that proposes a "compartmentalized wiki architecture" for scaling LLM-maintained knowledge systems. It argues that stateful LLM systems are built…
TokenZip v2 is a token compression engine that reduces LLM input token costs by up to 95% for coding copilots like Claude Code and Codex by transforming an entire codebase into a multi-level, queryabl…
`microgpt.py`, a minimal, dependency-free Python implementation of a GPT (Generative Pre-trained Transformer) model for training and inference. It includes a complete autograd system, a character-leve…