Dev proves LLMs will run on anything – even a $10 microcontroller

A developer has demonstrated that large language models can run on a $10 microcontroller, achieving nearly 10 tokens per second with mostly coherent output, according to The Register. The proof-of-concept challenges assumptions about the hardware requirements for AI inference, potentially enabling low-cost edge AI applications.

MOST POPULAR AI https://beta.theregister.com/tag/ai - EDGE AND IOT Dev proves LLMs will run on anything – even a $10 microcontroller Nearly 10 tok/s and it's mostly coherent — What's not to like? - Security This one time, at Hacker Summer Camp … What to expect as BSides, Black Hat, and DEF CON descend on Las Vegas - ai and ml China turns up the heat with open model blitz as US model makers panic For the first time, Alibaba's Qwen team is letting its 'Max' model out of the API pen; meanwhile, DeepSeek V4-Flash gives new meaning to cheap and cheerful competition - Security Google dev kit spurs first-ever agent-on-agent violence Poisoned pull requests contain prompt injection that allows one to control another - SYSTEMS A deep dive into Nvidia's Vera CPU and the Olympus cores that power it 88 custom cores, 176 funky threads, 1.5 TB of laptop RAM, and 1.8 TB/s of NVLink connectivity — this isn't your typical datacenter chip Infosec https://beta.theregister.com/security - Security Russians are posing as Signal support to launch phishing attacks PLUS: US takes down Iranian propaganda sites; Marketing company asks 'Why Do We Have Your Information?' And more - Security Microsoft patches failed to fix on-prem SharePoint, which is now under zero-day attack PLUS: China upgrades smartphone surveillance tools; Ring eases anti-snooping stance; and more - Black Hat and DEF CON DEF CON Franklin project enlists hackers to harden critical infrastructure Voting village reports have been so successful, says Jeff Moss, that the whole of DEF CON will now be included - Security EQT buys majority share in Swiss cybersecurity biz Acronis Went at equivalent of $3.5B+ valuation for entire firm, though portion sold not specified - Malware Month Ten years since the first corp ransomware, Mikko Hyppönen sees no end in sight On the plus side, infosec's a good bet for a long, stable career FOSS https://beta.theregister.com/tag/FOSS - FOSS smashed one Microsoft monopoly. After 20 years of failure, it's time to smash another Word up - GNOME can look like Windows – and Flashback can do it without extensions New 'Simple-taskbar' is an option, but there's a simpler, stabler way - A moment of silence, please, for the final release of Debian on x86-32 New Debian versions hit FOSSland in the form of 13.6 and 12.15 - Baddies caught exploiting extensions bugs with perfect 10 scores on vulnerable Joomla websites Flaws in iCagenda, Balbooa Forms extensions can impact open source CMS that powers a million sites worldwide - Frame: A new X11 server – implemented directly in assembly Joins yserver, Phoenix, and of course XLibre – and outlier Arcan - Cinnamon 6.8 will support Wayland – if you want it Next version of Linux Mint’s desktop has both kinds of display server