Running a local embedding model on a $100-per-month GPU can cost as little as 0.24% of the price of using OpenAI's small embedding model via API, according to a technical analysis by Dzen Platform. Th…
A developer who built RAG infrastructure multiple times finally benchmarked it for the first time, using the MIRACL-zh dataset to evaluate retrieval quality in their open-source knowledge base Langhua…
A developer detailed the construction of a fully self-hosted RAG pipeline for a Gulf bank that required no data to leave its premises. The project, built on two used 3090 GPUs and open-source tools li…
A developer building a local-first phone assistant for their solo consulting practice is tackling the problem of missed calls and fragmented client communication. The system uses locally running AI mo…
A developer detailed a sequential model-loading approach to run Whisper, bge-m3, and Gemma on a single local workstation with limited VRAM, avoiding out-of-memory errors by loading and unloading model…
Researchers built RAGAL, a fully local retrieval-augmented assistant for the technical-support team of AFIR, the Romanian Agency for Financing Rural Investments, using only an 8 GB consumer laptop and…
Clair, an open-source semantic news API from Serin Labs, matches news articles by meaning rather than keywords, using vector math with the bge-m3 embedding model and MaxSim algorithm to return scored,…
A developer built session-indexer, a Go tool that indexes Claude Code session transcripts into a per-project SQLite database for semantic memory retrieval. The tool avoids centralized memory stores by…
A developer demonstrates running a complete RAG agent offline using LangGraph, Ollama, and an embedded Qdrant instance, requiring zero API keys or Docker. The system uses a provider-swap design that a…