12:00
2026-06-28
loomcycle.dev
large-language-models
Local LLMs on my TrueNAS, and the frontend I had to build
A developer upgraded a TrueNAS NAS with an AMD Ryzen 7 8700G APU and 96 GB DDR5 for local LLM inference, achieving 13-15 tok/s on gemma4, after rejecting pricier options like NVIDIA DGX Spark and Mac โฆ