A developer built RiffSalad, a local-first AI vault for guitarists that analyzes imported or browser-recorded riffs with librosa for BPM, key, energy and note density, extracts MIDI via a Basic Pitch-…
Hermes Labs has released Hermeneutic, an open-source tool that mines user corrections from coding-agent conversations and surfaces relevant guidance when similar tasks arise. Hermeneutic reads Claude …
A developer built Casework, an agentic fraud investigation application that combines TigerGraph graph evidence, document retrieval, a local Llama 3.2 3B model via Ollama, and policy rules to trace a c…
A developer has published a walkthrough showing that RAG pipelines for corpora under roughly one million chunks can run entirely offline using SQLite with the sqlite-vec extension and local embeddings…
A developer instrumented an RTX 3090 running a resident local AI stack — a Whisper ASR service, an Ollama embedding model, and Immich ML — with a power meter over 30 days and found the GPU averaged ro…
A developer built a production RAG system addressing four key challenges: stateless HMAC-signed guest cookies for zero-friction onboarding, layered workspace isolation for multi-tenancy, hybrid retrie…
Chunking a long document into 17 overlapping pieces before embedding introduced a retrieval bias: a document split into 17 chunks now has 17 separate entries competing for top-N results, giving it mor…
A developer has published a guide for building a fully local Retrieval-Augmented Generation (RAG) chatbot for trading research using Ollama and Termux on an Android phone, eliminating API costs and da…
A developer building an on-premise RAG system for regulatory documents discovered that a semantic cache using cosine similarity was unsafe for questions differing only in polarity. Testing with Spanis…
A developer built a local embeddings pipeline using Ollama's nomic-embed-text model, ChromaDB, and Python, embedding local files and a live URL for semantic search. The pipeline encountered a context …
Intersignal's Braid v1.5.2 transferred signed semantic context between two local AI systems using different embedding models, a test of its protocol for moving machine state without cloud platforms. T…
A developer built a complete retrieval-augmented generation (RAG) pipeline from scratch using LangChain, ChromaDB, and a local LLM via LM Studio, avoiding cloud costs and API keys. The system splits H…
A developer built an on-premise RAG stack that runs without GPU, cloud, or Docker, designed for public sector health information systems. The stack uses ASP.NET Core 9, Ollama, Qdrant, and Mistral 7B,…
Embeddings are fixed-length vectors of floating-point numbers that encode semantic meaning, enabling similar sentences to be mathematically close and powering RAG, semantic search, and recommendation …
Developer Cole Hellman built a personal MCP server called Codicil that indexes documentation for AI coding assistants. When the embedding service went down for two weeks, Hellman didn't notice because…
Real-time voice agents using local LLMs face a hard latency ceiling of ~3 seconds imposed by Retell AI's WebSocket timeout, which forces reconnections and call termination if the first token is not pr…
A developer built a fully local hybrid RAG (Retrieval-Augmented Generation) application that answers questions from PDF documents and politely declines out-of-scope queries, using a React UI, FastAPI …
DocuBrowse, a new desktop application, turns local document collections into searchable knowledge bases using AI-powered semantic search and summaries, all running offline with no internet or API keys…
Ekorbia released versions 0.4 and 0.5, adding guided setup, an in-app model manager, Spaces for bundling context, and fully offline UI in v0.4, followed by on-device voice dictation via whisper.cpp in…
Ragit, a new command-line tool, enables users to chat with any folder of documents using a local LLM via Ollama. It implements Retrieval-Augmented Generation (RAG) by indexing files, creating embeddin…