The author watched Google I/O 2026 with a focus on whether Google's AI ecosystem was becoming more practical and connected for developers, rather than just on new model announcements. They observed th…
Legal Buddy**, an AI-powered legal assistant built for the Gemma 4 Challenge that operates entirely locally via Ollama to ensure user privacy. It helps users understand, review, and draft legal docume…
At Google I/O 2026, the company announced that its open-source Android app, AI Edge Gallery, now supports agent functionality and MCP (Model Context Protocol) connections, allowing large language mode…
The Gemma 4 26B model was the first local AI to achieve a perfect score on the HumanEval benchmark, including solving the notoriously difficult problem 145. This problem requires sorting integers by t…
The Google AI Edge Gallery app now supports the open-source Model Context Protocol (MCP), allowing on-device Gemma 4 models to dynamically call external tools and data sources via Streamable HTTP. The…
Running local AI for software development is not a cost-free solution, as it simply shifts the expense from cloud subscriptions to expensive hardware upgrades, requiring at least 32GB to 64GB of RAM f…
OpenAI's cloud-based Chronicle service, which incurred per-frame costs for analyzing screen captures, with a local Gemma 4 E4B 4-bit MLX model running on a $599 Mac mini. This new setup processes vide…
The ExecuTorch MLX delegate now enables GPU-accelerated inference for PyTorch models on Apple Silicon Macs through Apple's MLX framework. The new backend achieves 3-6x higher throughput on generative …
The article describes the author's successful setup for running local AI models on an M4 Mac with 24GB of memory, specifically highlighting Qwen 3.5-9B (Q4 quantized) as the best performing model at ~…
Instructions for using a specific chat template file (`chat_template_gemma_large_fixed.jinja`) with the vLLM inference engine to enable compatibility with the Gemma 4 model and OpenCode. It directs us…