{"slug": "towards-detecting-inconsistencies-in-end-to-end-generated-tods", "title": "Towards Detecting Inconsistencies in End-to-end Generated TODs", "summary": "Researchers propose a method to detect inconsistencies in end-to-end generated Task-Oriented Dialogues (TODs) by framing the problem as a Constraint Satisfaction Problem (CSP). The approach identifies variables in dialogue segments and applies a CSP solver to find valid solutions, achieving high accuracy in detecting hallucinations and inconsistencies. This work addresses critical failures in LLM-based conversational systems where adherence to domain knowledge is essential.", "body_md": "arXiv:2607.09338v1 Announce Type: new\nAbstract: Generative AI is profoundly transforming the core technologies behind conversational systems, shifting from component-based to end-to-end approaches. However, Large Language Models (LLMs) may still generate inconsistencies, a critical issue particularly in Task-Oriented Dialogues (TODs), where system responses must strictly adhere to information from a domain knowledge base (e.g., restaurants in a city). A single hallucination (e.g., suggesting a non-existent restaurant) can lead to severe task failures. We investigate a method for automatically detecting inconsistencies by conceptualizing TODs as a Constraint Satisfaction Problem (CSP), where variables represent dialogue segments referencing the conversational domain, and constraints among variables capture dialogue properties such as turn coherence and adherence to domain knowledge. We propose a pipeline that first identifies variables in a target dialogue and then applies a CSP solver to identify valid solutions. By comparing the target dialogue with valid variable assignments, we can detect inconsistencies and suggest minimal changes to ensure dialogue consistency. We demonstrate the high accuracy of the CSP-based approach in detecting inconsistencies, and provide a detailed analysis of our findings.", "url": "https://wpnews.pro/news/towards-detecting-inconsistencies-in-end-to-end-generated-tods", "canonical_source": "https://arxiv.org/abs/2607.09338", "published_at": "2026-07-13 04:00:00+00:00", "updated_at": "2026-07-13 04:17:49.810934+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "natural-language-processing", "ai-safety"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/towards-detecting-inconsistencies-in-end-to-end-generated-tods", "markdown": "https://wpnews.pro/news/towards-detecting-inconsistencies-in-end-to-end-generated-tods.md", "text": "https://wpnews.pro/news/towards-detecting-inconsistencies-in-end-to-end-generated-tods.txt", "jsonld": "https://wpnews.pro/news/towards-detecting-inconsistencies-in-end-to-end-generated-tods.jsonld"}}