The RAG Superpower I Didn't See Coming: Letting a Chatbot Say 'I Don't Know'

I already wrote about building my first RAG solution, so I won’t repeat the basics. What I want to talk about is one specific moment from that project. The moment the whole thing actually clicked for me.

It wasn’t the retrieval part, or the embeddings. It was watching the chatbot say “I don’t know.”

Once you bolt RAG onto a chatbot and tighten the prompt a bit, you unlock something a regular chatbot basically can’t do. The bot can admit it doesn’t have the answer.