# BITNET – an autoregressive language model on the 6502 processor

> Source: <https://blog.adafruit.com/2026/08/03/bitnet-an-autoregressive-language-model-on-the-6502-processor/>
> Published: 2026-08-03 19:06:25+00:00

Matt Beton trained a tiny Mamba-based autoregressive language model and wrote an inference engine to run it on the 8-bit 6502 processor (from 1975, with 32KB RAM). The MOS 6502 is an 8-bit microprocessor released in 1975, powering the BBC Micro and the Apple II. I am lucky enough to have access to my dad’s […]