Developer slvDev_ has run a 28.9-million-parameter TinyStories language model entirely on an Espressif ESP32-S3 microcontroller — an $8 chip with 512KB SRAM — generating text at 9.5 tokens per second …
A developer known as slvDev has run a 28.9-million-parameter language model on an ESP32-S3 microcontroller, an $8 chip with 512KB of SRAM, achieving 9.5 tokens per second for offline text generation. …
A developer known as slvDev has run a 28.9 million parameter language model on an ESP32-S3 microcontroller that costs about $8, generating text at roughly 9.5 tokens per second entirely on-device. The…
A developer trained a 30M-parameter decoder-only transformer from scratch on the TinyStories dataset using Kaggle's free T4 GPUs, achieving a validation loss of 1.401 at a learning rate of 1e-3. The p…
A developer has created WiFi-LLM, a system that runs a Llama-2-architecture model on an ESP32 microcontroller by streaming weights from a PC over WiFi, keeping the ESP32's RAM usage flat at around 110…
Researchers at an undisclosed institution developed a method to replace attention heads in transformer language models with human-readable Python programs, achieving over 75% similarity in attention p…
Two ESP32-S3 microcontrollers running a Llama-architecture language model have achieved the first multi-chip pipelined LLM inference on ESP32-class hardware, splitting layers across two boards connect…