Hacker News users discuss replacing cloud-based AI coding assistants like Claude and GPT with local or self-hosted models, sharing setups and performance metrics. Some report success with models like …
A developer built inline-scribe, a Chrome extension that proofreads text using a local LLM via Ollama, ensuring privacy by keeping data on the user's machine. The extension provides an inline diff int…
A developer compiled a production-readiness checklist for AI agents based on an 'Ask HN' thread, focusing on specific behaviors rather than infrastructure. The checklist includes observable logging, g…
Meta's Llama open-source AI models can run on hardware ranging from a MacBook to a data-center GPU, with the key constraint being memory capacity. An M2 Pro MacBook with 16GB can run 1B, 3B, and 8B pa…
Batta, an open-source security review tool for AI coding agents, launches with plan-phase reviews that catch design flaws before code is written. The tool indexes a system's architecture—services, dat…
Jailer, a database subsetting and browsing tool, has integrated an AI SQL Advisor that analyzes, explains, and refactors SQL queries using Anthropic or OpenAI-compatible APIs, with an inline diff view…
A developer built BraveMCP, a local-first 'second brain' that gives Claude Desktop access to browsing history, bookmarks, highlights, and notes via the Model Context Protocol (MCP). The system uses an…
A developer tracked every GitHub traffic spike for Trooper, a privacy-aware LLM proxy written in Go, over seven weeks and found that Reddit posts in niche communities like r/ollama drove the largest s…
Open WebUI now supports the Model Context Protocol (MCP), enabling local AI assistants to use external tools like web search, file access, and code execution. Developers can set up a Docker-based envi…
A developer combined Aider, an AI pair programming tool, with Ollama running local models like Qwen3 Coder 30B to create a fully private coding assistant that works in the terminal. The setup reads fi…
A developer built a unified AI gateway using LiteLLM and Ollama, enabling a single OpenAI-compatible API endpoint for both local and cloud LLMs. The setup provides load balancing, cost tracking, rate …
A developer built a private RAG system using AnythingLLM and Ollama that runs locally on any machine, allowing users to drop in PDFs, Word docs, and code files and ask questions without cloud dependen…
A developer built a private AI app platform using Dify and Ollama, enabling chatbots, RAG pipelines, and agents to run entirely on local hardware with no monthly fees. The setup uses Qwen3 14B as the …
A developer built a Code-RAG benchmark on Apache Kafka 4.0.0 to study how retrieval pipeline choices affect model rankings. Comparing 16 embedding models, 5 chunking strategies, and 3 retrieval modes …
Developer Roan Dejager released Hillock, a local AI memory system that combines SQLite, Hebbian plasticity, and hyperdimensional computing to provide lightweight, brain-inspired memory for offline cha…
A developer built a high-performance RAG pipeline using Ollama, Python, and TypeScript that runs entirely locally, eliminating cloud API latency and data compliance issues. The architecture uses Ollam…
A developer built Lease Lens, a 3B-parameter contract risk scanner that runs entirely without an external LLM API, for the Hugging Face Build Small Hackathon. The fine-tuned Llama 3.2 3B model achieve…
A developer built local-ai.run, an open-source, self-hosted AI platform that runs entirely on local hardware. The platform supports file ingestion, vector embeddings, model routing, and a web interfac…
A new open-source benchmark, Truth Benchmark, automatically detects when code does not match its documentation claims. The project provides a dataset of 52 labeled examples across multiple programming…
A developer maintaining bulwark-mcp, an open-source proxy that scans MCP tool results for indirect prompt injection, discovered that a class of attacks bypasses the detector by impersonating the secur…