19:28
2026-07-06
kapa.ai
large-language-models
Pruning RAG context down to what the answer actually needs
Kapa, a developer of AI assistants for product knowledge bases, introduced a pruning step between retrieval and generation that uses a small LLM to discard about 68% of retrieved context while retaini…