Hermes Agent, an open-source agent framework, can be paired with a locally hosted Qwen model via Ollama or LM Studio to create a zero-token-cost AI agent stack, eliminating per-token API fees. Key con…
Alibaba's Qwen research lab released Qwen 3.8 27B, an Apache 2 licensed 27B parameter vision-capable LLM, which defaults to an 'xhigh' reasoning effort that causes it to overthink simple tasks, taking…
Meta released Muse Glimmer on August 10, a 30B open-weight coding agent model that runs on consumer hardware, with quantized builds fitting in 24GB VRAM. The model, distilled from Meta's Muse Spark 1.…
Agent6, a new coding agent that jails model commands and uses editable state machines for long-running tasks, has been released. The agent restricts filesystem and network access via Landlock and secc…
Unsloth, the open-source fine-tuning library, released Unsloth Desktop, a free beta app for macOS, Windows, and Linux that runs and trains LLMs, diffusion models, and audio models locally, directly co…
A developer has released an open-source desktop app that lets users chat with multiple LLM agents that communicate with each other asynchronously, featuring a Slack-like interface and support for Open…
Simon Willison released CORS Chat, a web tool built with GPT-5.6-Sol xhigh, to test Qwen 3.8 27B running in LM Studio on his M5 MacBook Pro and an NVIDIA DGX Spark. The tool provides a web UI for Open…
Alibaba's Qwen 3.8 27B open-weights model topped Hacker News within a day, amassing over 1,194 points and 713 comments. The dense 27-billion-parameter model, Apache 2.0 licensed, can be run locally on…
A developer replaced GitHub Copilot with a fully offline coding assistant running on a 16GB M4 Mac mini using Ollama and Qwen models. They found that a 7B parameter model is the sweet spot for chat an…
Brian Roemmele, founder of technology research site ReadMultiplex, released a Mac-only tool and local rewriting workflow on August 12th that he says can remove the machine-readable watermarks Anthropi…
Doable, a self-hosted AI app builder for teams, has been released under an MIT license, allowing users to generate, deploy, and host AI-powered applications on their own infrastructure with multi-tena…
A new online calculator from an unnamed developer helps users determine which open-source large language models (LLMs) can run locally on their hardware, listing 13 of 16 models that fit on an RTX 409…
A developer's local LLM crashed during a RAG experiment due to CUDA out-of-memory errors caused by an oversized 32,768-token context window, which inflated the KV cache. Fixing the issue by sliding LM…
A developer built a complete retrieval-augmented generation (RAG) pipeline from scratch using LangChain, ChromaDB, and a local LLM via LM Studio, avoiding cloud costs and API keys. The system splits H…
Llama.cpp, the engine behind Ollama and LM Studio, has launched llama.app, an official website with a hardware-detecting one-line installer and a unified `llama` binary, backed by Hugging Face, which …
Meta released Muse Glimmer on August 10, 2026, a 30-billion-parameter open-weight model distilled from Muse Spark and built for local agentic workloads, available on Hugging Face under Apache 2.0. The…
NVIDIA introduced Nemotron 3.5 Lightning, a customizable open 30B mixture-of-experts model for always-on agents, delivering up to 4x faster token generation and 30% faster time to completion compared …
Cursor's cloud backend routes all LLM API calls through its servers at api2.cursor.sh, making localhost base URLs unreachable and causing chat requests to hang. A developer found that exposing a local…
Meta released Muse Glimmer, a 30B open-weights model under an Apache 2.0 license, optimized for agentic task completion, reliable tool use, and multi-step reasoning. Developer Simon Willison tested th…
Meta released Muse Glimmer, a new local large language model optimized for end-to-end agentic task completion, reliable tool use, and multi-step reasoning, achieving strong success rates on benchmarks…