Ollama provides a tool for running large language models locally on macOS, Linux, and Windows without requiring an API key or cloud service. The tool packages model weights, a runtime based on llama.c…
A developer's guide explains how to run open-source AI models locally on consumer hardware in 2026, highlighting that a mid-range laptop can now run models once considered frontier-class. The guide co…
DeepSeek-AI released DeepSpec, an open-source codebase for training and evaluating draft models for speculative decoding, supporting three draft model algorithms (DSpark, DFlash, Eagle3) and requiring…
Google announced a method to retrofit Multi-Token Prediction onto frozen Gemini Nano v3 models, accelerating on-device inference for Pixel 9 and 10 series devices. The approach appends a lightweight T…
LocalClicky, a new open-source voice assistant for Mac, runs entirely offline using local AI models like Whisper.cpp and Ollama, ensuring no voice data, screenshots, or commands leave the user's machi…
A researcher replicated Anthropic's concept-injection experiments on 14 open-weight language models and found that the models do not satisfy criteria for genuine introspection, instead exhibiting stat…
Off Grid AI Desktop is a free, open-source app that runs large language models locally on Apple Silicon Macs, leveraging unified memory for GPU inference. The app supports models like Gemma and Qwen, …
Researchers at arXiv found that jailbreak attacks on large language models can be detected by analyzing entropy dynamics in intermediate layers, rather than final outputs. The study shows that monoton…
Google's GKE Labs introduced OpenRL, an open-source self-hosted API for post-training and fine-tuning large language models on Kubernetes clusters. The project decouples reinforcement learning infrast…
AT&T and GSMA launched the Open Telco AI platform, using Google's open-source Gemma models to create domain-specific telecom AI models that achieved up to 91.74% accuracy in network operations. The in…
Ollama provides a REST API with 14 endpoints for running large language models locally. The API includes endpoints for text generation, chat, embeddings, model management, and OpenAI compatibility. De…
Hugging Face engineer Onur developed a real-time notification system for the OpenClaw repository using local open-weight models like Gemma and Qwen, running on an NVIDIA GB10 with 128 GB of unified me…
Google DeepMind researchers audited DiffusionGemma, a text diffusion model, and found it is not significantly less transparent than Gemma in terms of variable interpretability, but algorithmic transpa…
A developer built a fully offline voice assistant on a Raspberry Pi 4 or 5 using local AI models. The device records audio, processes it with Whisper for speech-to-text, runs a local language model vi…
A reproducible benchmark of 24 local, self-hosted, and cloud LLMs for translation into English found that a local 18 GB model (gemma-4-12b-qat) performs on par with frontier cloud models on Afrikaans→…
Modal and Z Lab released DFlash, a speculative decoding model for Qwen 3.5 397B-A17B, achieving over 4.3x throughput versus baseline and 1.5x versus MTP on HumanEval at concurrency 1. The model uses a…
A developer fixed a broken fallback chain in their OpenClaw agent that was causing request timeouts during peak hours. The new chain includes seven entries: two local Ollama models, three OpenRouter f…
Researchers developed an ensemble of large language models, including Google's Gemini and Gemma, to automatically identify EQ-5D health-related quality-of-life studies in PubMed from abstracts. The we…
Google released OpenRL, an open-source API for fine-tuning large language models on Kubernetes clusters, aiming to decouple infrastructure from AI research and improve GPU utilization by running multi…
Ollama, an open-source tool for running large language models locally, offers a beginner-friendly setup for 2026 with privacy, cost savings, and data control. Users can install it on macOS, Windows, o…