10:40
2026-08-03
cnx-software.com
artificial-intelligence
28.9M-parameter LLM runs locally on ESP32-S3 at 9 tokens/s
Slava S. (slvDev) has optimized a 28.9M-parameter LLM to run locally on an ESP32-S3 development board at about 9 tokens/s, generating short stories on an I2C display. The project, called 'esp32-ai', rโฆ