RKLLM

Rockchip's RK3588 SoC, found in boards like the Orange Pi 5 and Radxa Rock 5B starting at $75, can run local LLMs but is limited by memory bandwidth rather than its advertised 6-TOPS NPU, according to…

A developer created a Docker Compose stack that turns a Rockchip RK3576 board into a fully local voice backend for Home Assistant, using openWakeWord, Whisper, Piper, and a local LLM. The setup keeps …