{"slug": "show-hn-autoretrieval-autoresearch-for-rag-pipelines", "title": "Show HN: Autoretrieval – Autoresearch for RAG Pipelines", "summary": "A developer released Autoretrieval, a framework that uses an AI agent to automatically optimize RAG pipelines by running experiments against an evaluation dataset. The agent iteratively edits retrieval parameters such as chunking strategies, chunk sizes, embedding models, and keyword retrieval, keeping or discarding changes based on F-beta score improvements. On one pipeline, the framework more than doubled the F3 score after several hours of experimentation.", "body_md": "Hi, inspired by Andrej Karpathy's autoresearch, I built autoretrieval, a small framework that lets an AI agent improve a RAG pipeline by running experiments against an evaluation dataset.\n\nThe agent edits the retrieval pipeline, runs an eval, checks whether the F-beta score improved, keeps or discards the change, and repeats. It can try different chunking strategies, chunk sizes, the number of retrieved chunks, embedding models, keyword retrieval, and more, while keeping a log of every experiment.\n\nThe repo also includes a script that generates question and reference-highlight pairs from any document collection. This makes it possible to optimize a RAG pipeline for domain-specific data.\n\nOn one of my own RAG pipelines, it more than doubled the F3 score after a few hours of running experiments.\n\nI'd love to hear any feedback or ideas.\n\nComments URL: [https://news.ycombinator.com/item?id=48995907](https://news.ycombinator.com/item?id=48995907)\n\nPoints: 1\n\n# Comments: 0", "url": "https://wpnews.pro/news/show-hn-autoretrieval-autoresearch-for-rag-pipelines", "canonical_source": "https://github.com/daly2211/autoretrieval", "published_at": "2026-07-21 18:06:40+00:00", "updated_at": "2026-07-21 18:12:51.125081+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-agents", "ai-tools", "ai-infrastructure", "large-language-models"], "entities": ["Autoretrieval", "Andrej Karpathy"], "alternates": {"html": "https://wpnews.pro/news/show-hn-autoretrieval-autoresearch-for-rag-pipelines", "markdown": "https://wpnews.pro/news/show-hn-autoretrieval-autoresearch-for-rag-pipelines.md", "text": "https://wpnews.pro/news/show-hn-autoretrieval-autoresearch-for-rag-pipelines.txt", "jsonld": "https://wpnews.pro/news/show-hn-autoretrieval-autoresearch-for-rag-pipelines.jsonld"}}