{"slug": "what-if-a-small-llm-didn-t-have-to-make-every-decision", "title": "What if a small LLM didn't have to make every decision?", "summary": "Sfeir has released Esus, an open-source experimental code-generation system that pairs a 4B-parameter local LLM with a deterministic Python kernel to handle decisions that can be formalized, rather than having the model make every choice. The project's author frames the central question as how much the model actually needs to decide, and published the architecture, experiments and benchmark results alongside the code on GitHub. The author is soliciting feedback from developers working with small or local models on which parts of an agent should remain probabilistic and which should be deterministic.", "body_md": "I’ve been experimenting with a different approach to code generation using a small local LLM.\n\nThe initial idea was simple: could a 4B model actually generate a usable Python application?\n\nIt could.\n\nWell… sometimes.\n\nInstead of trying to make the model responsible for everything, I started moving decisions that can be formalized into a deterministic Python kernel.\n\n**LLM**\n\n**Deterministic kernel**\n\nThe result is **Esus**, an open-source experimental code-generation system.\n\nThe interesting question for me is not:\n\n*“How do we make a 4B model code like a much larger model?”*\n\nIt’s:\n\n**“How much do we actually need the model to decide?”**\n\nI’ve written up the architecture, experiments and benchmark results here:\n\n [Devops agentique, et si le LLM ne devait pas tout décider ?](https://www.sfeir.dev/devops-agentique-et-si-le-llm-ne-devait-pas-tout-decider/)\n\nThe project is open source:\n\n [GitHub - stengerg-sfeir/esus: Agent Smith · GitHub](https://github.com/stengerg-sfeir/esus)\n\nI’d be interested in feedback from people working with small/local models:\n\n**Which parts of your agents do you think should remain probabilistic, and which parts should be deterministic?**", "url": "https://wpnews.pro/news/what-if-a-small-llm-didn-t-have-to-make-every-decision", "canonical_source": "https://discuss.huggingface.co/t/what-if-a-small-llm-didnt-have-to-make-every-decision/180693#post_1", "published_at": "2026-09-23 11:23:27+00:00", "updated_at": "2026-09-23 11:29:44.111950+00:00", "lang": "en", "topics": ["large-language-models", "ai-agents", "ai-tools", "developer-tools"], "entities": ["Sfeir", "Esus", "GitHub"], "alternates": {"html": "https://wpnews.pro/news/what-if-a-small-llm-didn-t-have-to-make-every-decision", "markdown": "https://wpnews.pro/news/what-if-a-small-llm-didn-t-have-to-make-every-decision.md", "text": "https://wpnews.pro/news/what-if-a-small-llm-didn-t-have-to-make-every-decision.txt", "jsonld": "https://wpnews.pro/news/what-if-a-small-llm-didn-t-have-to-make-every-decision.jsonld"}}