{"slug": "eli-a-local-ai-assistant-where-the-llm-isn-t-the-source-of-truth", "title": "ELI — a local AI assistant where the LLM isn't the source of truth", "summary": "A developer built ELI, a local AI assistant that does not rely on the LLM as the source of truth for system state. The project features desktop automation, local voice input/output, layered memory, document-grounded reports, sandboxed code execution, and MQTT smart-home integration, all running locally and offline. The developer is seeking feedback on the architecture and the separation of deterministic system state from probabilistic LLM reasoning.", "body_md": "I ended up building ELI around a pretty simple idea: don't trust the LLM to describe system state.\n\nSo i am looking for some feedback if posible, hopefully this project works for you and helps you out in daily life! So poke holes, ask questions, and get involved if you want to participate!\n\nAt this point it can:\n\n```\nDesktop automation\n\nRead your screen, PDFs and images\n\nLocal voice in/out with your own wake word\n\nLayered memory (SQLite + FAISS + knowledge graph)\n\nGenerate document-grounded reports with citations\n\nSandboxed code execution\n\nLocal FastAPI/PWA interface you can open from anything on your LAN\n\nMQTT smart-home integration\n\nRuns locally and offline by default\n```\n\nIt's mostly just been me over the guts of a year, so it's definitely not finished and I'm under no illusion there's plenty I've missed. That's kind of why I'm posting it here, just to get some honest feedback and to see if this project helps people.\n\nI'd really appreciate people pulling the architecture apart, pointing out bad ideas, suggesting improvements, or just generally trying to break it. I'm especially interested in how other people separate deterministic system state from probabilistic LLM reasoning (if you do at all). One last thing! Check out the readme's, and the documents in /blueprints for a much clearer idea!", "url": "https://wpnews.pro/news/eli-a-local-ai-assistant-where-the-llm-isn-t-the-source-of-truth", "canonical_source": "https://dev.to/shadowesc95/eli-a-local-ai-assistant-where-the-llm-isnt-the-source-of-truth-l5m", "published_at": "2026-07-15 16:41:57+00:00", "updated_at": "2026-07-15 17:12:05.124217+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-agents", "developer-tools", "ai-infrastructure"], "entities": ["ELI", "SQLite", "FAISS", "FastAPI", "MQTT"], "alternates": {"html": "https://wpnews.pro/news/eli-a-local-ai-assistant-where-the-llm-isn-t-the-source-of-truth", "markdown": "https://wpnews.pro/news/eli-a-local-ai-assistant-where-the-llm-isn-t-the-source-of-truth.md", "text": "https://wpnews.pro/news/eli-a-local-ai-assistant-where-the-llm-isn-t-the-source-of-truth.txt", "jsonld": "https://wpnews.pro/news/eli-a-local-ai-assistant-where-the-llm-isn-t-the-source-of-truth.jsonld"}}