Meta announced it will release an open-weight version of Muse Spark 1.2 and released Muse Glimmer, a 30B agentic model with open weights under Apache 2.0, which can run on 24GB of VRAM. The model is q…
Mirafold, an MIT-licensed open-source tool, launched a browser-based generative UI layer for terminal coding agents Claude Code, Codex, and Gemini CLI, turning raw agent output into live cards, depend…
Meta Superintelligence Labs released Muse Glimmer, a 30-billion-parameter multimodal open model under Apache 2.0, designed for local agent workloads on consumer hardware. The model scores 76 on SWE-Be…
LM Studio Bionic, in partnership with Meta, launched support for Muse Glimmer, a 30B-parameter open-source model optimized for agentic tasks, available for local download under the Apache 2.0 license.…
DeepSeek-V3, an open-weight large language model from Chinese AI company DeepSeek, has leaked and is matching or beating top-tier proprietary US models in coding and math benchmarks, according to a te…
GMKtec's EVO-X3, a tower PC with AMD's Ryzen AI Max+ 395, 128GB unified memory, and an OcuLink port, was reviewed by Wendell of Level1Techs, who called it 'one of the fastest Strix Halo machines' he h…
Liquid AI released LFM2.5-2.6B, an on-device agentic model with 2.69B total parameters, a 131,072-token context window, and a 128,000-token vocabulary, pre-trained on approximately 34 trillion tokens.…
Homebench, a new open-source command-line tool, benchmarks local large language models for speed, memory, and quality, presenting results in a live terminal leaderboard. The tool, installable via pip,…
LM Studio released Bionic, an agent and workspace for chat, work, and code, which now integrates Moonshot AI's Kimi K3 model to create documents and slide decks. In a demonstration, Kimi K3 generated …
A debate on r/SelfHostedAI asks whether self-hosted local AI will go mainstream or remain a niche for enthusiasts, with arguments citing hardware and setup friction versus closing model quality gaps a…
A benchmark test by an unnamed developer found that LLM concurrency scales on consumer hardware, with pooled agents multiplying throughput by up to 8.7x, and the top result being MiniCPM5 1B at 983 to…
A developer built JobRadar, a CLI tool that searches eight job sources concurrently and scores listings against a user's profile using a local 1.7B parameter LLM (qwen3-1.7b) running on the user's CPU…
LM Studio has released DeepSeek V4 Flash 0731, a 284B-parameter Mixture-of-Experts model, available for local download or US-hosted cloud inference with Zero Data Retention enabled by default. Accordi…
Goulash, a new open-source Rust tool, lets terminal users query local LLMs for command suggestions without leaving their shell, using a four-line overlay that supports inline comments and context cach…
A developer built a 56-task coding benchmark with hidden tests and ran 16 model configurations on the same hardware, finding that a 7.5B-parameter model (gemma-4-e4b) scored 42/56, beating a 24B model…
Fast Company reports that free desktop apps like LM Studio and Jan.ai let users run small open-source AI models such as Llama 3.2 3B, Mistral 7B, and Phi-3 entirely offline on Mac or Windows PCs, ensu…
A developer describes using local large language models as a 24/7 Python tutor, emphasizing that the AI provides targeted examples, explains error messages, and suggests code improvements without writ…
LLM 0.32rc2 fixes a dependency issue and adds two features: the default model for users without a custom default is now GPT-5.6 Luna ($0.20/M input, $1.20/M output), and a new `llm openai endpoint` co…
Big-AGI requires users to connect an AI service via an API key from the service's developer console, not a chat subscription, to populate the app with models; the four featured services are OpenAI, An…
Ollama, LM Studio, and llama.cpp are the three dominant local AI runtimes, each offering different levels of abstraction and control for running small language models on a laptop. Ollama provides a si…