Chinese AI firm DeepSeek open-sourced DSpark, a speculative decoding system that accelerates large language model inference by up to 85% without altering output quality, releasing it under the MIT lic…
Fastllm, a C++ LLM inference library, now supports running DeepSeek-V4 and the full DeepSeek R1 671B model on a single GPU with just 10GB VRAM. The library is compatible with Nvidia, AMD, and domestic…
Drifty, an AI focus agent that automatically tracks and classifies computer activity as focus, neutral, or drift, launched on Hacker News. The macOS app records apps, sites, and sessions in three-minu…
A developer built a proof-of-concept IDE called TerminateCode that represents code as an interactive node graph on a canvas, allowing developers to manipulate architecture visually while AI writes the…
A developer built VerumTrade, an open-source multi-agent AI committee for stock analysis that produces an auditable trail from raw evidence to a final trade thesis. The system forces bull and bear ana…
Qwen 3.6 27B, a dense local language model from Alibaba's Qwen team, impresses developers with its general intelligence and practical coding abilities, running efficiently on consumer hardware via lla…
An open-source coding agent called Relay has been released, supporting non-mainstream and Chinese LLM providers like DeepSeek, Qwen, and GLM. The Electron app offers chat and code workspaces with file…
Qwen's new image model, Qwen-Image-2.0-RL, achieves improved benchmark scores through reinforcement learning, but the key insight lies in the training methodology. The team found that using classifier…
A developer tested Qwen-AgentWorld-35B-A3B, a 35-billion-parameter model designed for agentic reasoning, and found it excels in state tracking and tool-use reliability. The model demonstrated discipli…
A new benchmark test of Ornith 1.0, a model that builds its own task scaffolds, found that providing a full shell and Python environment doubled its bug-finding performance without increasing false po…
Modular announced that MAX models can now run on Apple Silicon GPUs with the 26.4 release, supporting M1 through M5 chips for text LLMs, vision models, and image diffusion models. The company is worki…
Ollama provides a tool for running large language models locally on macOS, Linux, and Windows without requiring an API key or cloud service. The tool packages model weights, a runtime based on llama.c…
A developer's guide explains how to run open-source AI models locally on consumer hardware in 2026, highlighting that a mid-range laptop can now run models once considered frontier-class. The guide co…
A developer migrated two production applications from Google's Gemini API to a self-hosted Qwen model on a Mac mini, using a Cloudflare Tunnel for secure access and an Oracle Cloud free-tier instance …
A developer cut their OpenAI bill by 94% by switching to Chinese AI models via a single API gateway. After benchmarking DeepSeek V4 Flash, Qwen-Plus, GLM-4 Plus, and DeepSeek V3.1 against GPT-4o, they…
A developer replaced Google's Gemini 3 Flash with a self-hosted Qwen model via Ollama for two production applications, citing cost, control, and infrastructure economics. The setup uses a Mac mini as …
A new tutorial demonstrates how to set up a fully local coding agent using open-weight LLMs and open-source harnesses as an alternative to subscription-based services like Claude Code and Codex. The l…
An architect breaks down how to size a Mac mini M4 for local AI workloads, arguing that memory configuration is the critical decision, not the CPU. The analysis maps tasks to memory tiers: 16GB for ch…
A developer earned $11.56 in the first week by renting out an idle RTX 3060 on Vast.ai, a GPU marketplace for AI compute. The card was used for LLM inference and training, with utilization varying fro…
A developer details their local AI coding setup, including laptop specs, Ollama configuration, Qwen model, and VS Code workflow, sharing what runs well locally.…