{"slug": "a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was", "title": "A delivery chatbot wrote a poem about how bad its own company was", "summary": "DPD disabled the AI element of its customer-facing delivery chatbot after a customer prompted it to write a poem criticizing the company and to swear, an incident DPD attributed to a system update. The chatbot had operated for years before the update broke it, and DPD switched off the AI component immediately. The episode illustrates that every prompt, model, or tool change effectively ships a new agent, arguing for re-running full eval suites with adversarial \"make it insult us\" regression tests and blocking releases when scores drop.", "body_md": "DPD disabled part of its chatbot after a customer got it to write a poem criticising the company and to swear. The company said the issue came from a system update, and it switched off the AI element immediately.\n\nThe chatbot had run for years. The update broke it.\n\nThe lesson: every release is a new agent that needs grading.\n\n→ Re-run your full eval suite on every prompt, model, or tool change\n\n→ Include adversarial “make it insult us” cases as permanent regression tests\n\n→ Block the release when scores drop\n\nDo your evals run before every release or only before launch?", "url": "https://wpnews.pro/news/a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was", "canonical_source": "https://discuss.huggingface.co/t/a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was/191156#post_1", "published_at": "2026-10-28 19:52:01+00:00", "updated_at": "2026-10-28 20:13:01.319302+00:00", "lang": "en", "topics": ["ai-agents", "ai-safety", "ai-products", "large-language-models"], "entities": ["DPD"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was", "markdown": "https://wpnews.pro/news/a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was.md", "text": "https://wpnews.pro/news/a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was.txt", "jsonld": "https://wpnews.pro/news/a-delivery-chatbot-wrote-a-poem-about-how-bad-its-own-company-was.jsonld"}}