{"slug": "more-ram-changed-what-matters-in-my-local-ai-setup", "title": "More RAM Changed What Matters in My Local AI Setup", "summary": "A developer documented six months of running local LLMs for coding-agent work, reporting that upgrading from 16 GB to 48 GB of unified memory on a Mac shifted the main constraint from whether a model fits to how long a session can run before the workflow breaks down. The stack pairs LM Studio with Qwen3.8 and Splash models driven by the OpenCode agentic coding workflow, where context length, compaction timing and thinking-mode latency now dominate the trade-offs.", "body_md": "Six months ago, I started running local LLMs seriously on a Mac with 16 GB of unified memory. Most of my decisions were dictated by memory: which models fit, which quantization to use, and how much context I could afford.\n\nMoving to 48 GB changed that.\n\nModels such as Qwen3.8-27B became practical for everyday use, and my attention shifted toward a different problem: **how well does the model work during a real coding-agent session?**\n\nMy current setup uses LM Studio with Qwen3.8 and Splash, while OpenCode provides the agentic coding workflow.\n\nWith enough memory to run larger models comfortably, other constraints became much more visible.\n\nContext length has a direct cost. Longer sessions accumulate tool output and code. Compaction can interrupt the flow earlier than expected. Thinking improves some tasks while adding latency to others.\n\nA model that looks impressive in a short prompt can therefore feel quite different when it has to navigate a repository, inspect several files, use tools, make changes, and preserve enough context to continue reasoning about them.\n\nThat changed how I evaluate local models.\n\nI care less about whether a model technically fits on my machine. I care more about how long I can work with it before the workflow starts getting in the way.\n\nAfter quite a bit of experimentation, the stack has become relatively small:\n\n**Mac with 48 GB unified memory → LM Studio → Qwen3.8 / Splash → OpenCode**\n\nThe interesting optimization work now happens around that stack: choosing a sensible context size, deciding when thinking is worth enabling, understanding why compaction happens, and balancing model capability against interactive speed.\n\nThere is still plenty to experiment with, but having more memory has made the trade-offs much clearer.\n\nI documented my current configuration, what changed since the original 16 GB setup, and the lessons from using it for actual development work in the full article:\n\n[https://ammar-najjar.com/blog/local-ai-setup-six-months-later/](https://ammar-najjar.com/blog/local-ai-setup-six-months-later/)\n\nIf you use local LLMs with coding agents, I would be interested in comparing experiences. Once model size and memory stopped being your main constraint, what became the next bottleneck?", "url": "https://wpnews.pro/news/more-ram-changed-what-matters-in-my-local-ai-setup", "canonical_source": "https://dev.to/ammarnajjar/more-ram-changed-what-matters-in-my-local-ai-setup-3e5b", "published_at": "2026-09-26 11:11:34+00:00", "updated_at": "2026-09-26 12:00:18.399001+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools", "ai-agents", "developer-tools", "ai-infrastructure"], "entities": ["LM Studio", "Qwen3.8", "Splash", "OpenCode", "Mac"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/more-ram-changed-what-matters-in-my-local-ai-setup", "markdown": "https://wpnews.pro/news/more-ram-changed-what-matters-in-my-local-ai-setup.md", "text": "https://wpnews.pro/news/more-ram-changed-what-matters-in-my-local-ai-setup.txt", "jsonld": "https://wpnews.pro/news/more-ram-changed-what-matters-in-my-local-ai-setup.jsonld"}}