Spent 2 weeks fighting a chatbot that kept making stuff up, then a guy on Reddit told me to try a $0.03 trick | AI Innovations - The Design Community Hub
Spent 2 weeks fighting a chatbot that kept making stuff up, then a guy on Reddit told me to try a $0.03 trick
I was building a support bot for my cousin's hardware store in Boise and it kept inventing return policies that didn't exist, which was a real problem. I tried bigger models, longer prompts, and a whole weekend of tweaking, nothing worked until someone in a Discord server said to just feed it the actual policy PDF and tell it to say 'I don't know' when the answer isn't in there. Took me 20 minutes to set up and the made up answers dropped to basically zero over the next week of testing. I still don't fully get why the short prompt with a hard stop beat my 3 page instruction doc. Has anyone else had luck with grounding tricks like this, or am I just getting lucky with one store's data?