My Eval Said RAG Made Things Up. My Eval Was Wrong.
A developer maintaining django-explain-errors, a Django middleware that uses an LLM to explain unhandled exceptions, found that their RAG evaluation harness falsely flagged retrieval-augmented explana…