ashalwi 1
Hello smart people of HF!
I’ve been wrestling to build a chatbot for a company project for months now. I’m not technical, and I am still learning. The use case for the chatbot/assistant is to help users seek answers from a property related database. I have built a RAG system from PDFs, Excel sheets/workbooks and website info. The results are often rubbish: Wrong cited numbers, model hallucinates, thin answers and many more failures.
Can anyone advice on the best approach to build a chatbot, please? Is there a step by step process to this?
I am using Claude 4.6 as the chatbot model via AWS bedrock
nootxlm 2
Your three failures point to the same missing step: nothing checks the answer against its sources after the model writes it. Add that check first — every number and cited fact in a reply has to appear in the retrieved passages behind it, and when a number is not there, the system regenerates or says it does not know instead of guessing. Then freeze 20–30 real questions with answers you have verified by hand from the database, and score every change against them: if wrong citations do not fall on that set, the change did not help, whatever a single demo feels like.