{"slug": "building-task-oriented-dialogue-systems-via-instruction-guidance-without-data", "title": "Building Task-Oriented Dialogue Systems via Instruction Guidance without Annotated Data", "summary": "Researchers Henry Gao and Jinho D. Choi have developed a task-oriented dialogue system that uses large language models with in-context prompting and unstructured conversational logs, eliminating the need for annotated data. Their two-stage framework, presented at SIGDIAL 2026, achieves a dialogue state F1 of 86.3% using Gemma-3-27b-it, outperforming GALAXY (84.3%) and MARS (84.6%).", "body_md": "##### Abstract\n\nTask-oriented dialogue (TOD) systems conventionally rely on supervised fine-tuning over large datasets, an approach that is both resource-intensive and difficult to generalize across domains. We investigate whether large language models (LLMs) can serve as effective TOD agents without any fine-tuning, relying solely on in-context prompting and unstructured conversational logs. To this end, we propose a two-stage framework in which an LLM first induces structured procedural instructions from raw multi-turn dialogues, then leverages these instructions to generate goal-oriented interactions. An iterative refinement loop further improves instruction quality by evaluating intermediate dialogue outputs and propagating feedback to update the instructions. To address limitations inherent in existing evaluation protocols, we introduce an interactive evaluation framework centered on a constrained user simulator with access to ground-truth task goals. This design enables flexible assessment of task success beyond fixed dialogue trajectories, more faithfully reflecting the conditions of real-world deployment. Experiments demonstrate that the proposed approach produces coherent and task-effective dialogues without any annotated data. Using Gemma-3-27b-it as the backbone, our system achieves a dialogue state F1 of 86.3%, outperforming GALAXY (84.3%) and MARS (84.6%).- Anthology ID:\n- 2026.sigdial-1.54\n- Volume:\n[Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue](/volumes/2026.sigdial-1/)- Month:\n- August\n- Year:\n- 2026\n- Address:\n- Atlanta, Georgia, USA\n- Editors:\n[Jinho D. Choi](/people/jinho-d-choi/),[Yun-Nung Chen](/people/yun-nung-chen/),[Kotaro Funakoshi](/people/kotaro-funakoshi/),[Ali Emami](/people/ali-emami/)- Venue:\n[SIGDIAL](/venues/sigdial/)- SIG:\n[SIGDIAL](/sigs/sigdial/)- Publisher:\n- Association for Computational Linguistics\n- Note:\n- Pages:\n- 773–785\n- Language:\n- URL:\n[https://aclanthology.org/2026.sigdial-1.54/](https://aclanthology.org/2026.sigdial-1.54/)- DOI:\n- Cite (ACL):\n- Henry Gao and Jinho D. Choi. 2026.\n[Building Task-Oriented Dialogue Systems via Instruction Guidance without Annotated Data](https://aclanthology.org/2026.sigdial-1.54/). In*Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue*, pages 773–785, Atlanta, Georgia, USA. Association for Computational Linguistics. - Cite (Informal):\n[Building Task-Oriented Dialogue Systems via Instruction Guidance without Annotated Data](https://aclanthology.org/2026.sigdial-1.54/)(Gao & Choi, SIGDIAL 2026)- PDF:\n[https://aclanthology.org/2026.sigdial-1.54.pdf](https://aclanthology.org/2026.sigdial-1.54.pdf)", "url": "https://wpnews.pro/news/building-task-oriented-dialogue-systems-via-instruction-guidance-without-data", "canonical_source": "https://aclanthology.org/2026.sigdial-1.54/", "published_at": "2026-07-21 00:00:00+00:00", "updated_at": "2026-07-21 20:16:19.548344+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-agents", "natural-language-processing"], "entities": ["Henry Gao", "Jinho D. Choi", "Gemma-3-27b-it", "GALAXY", "MARS", "SIGDIAL", "Association for Computational Linguistics"], "alternates": {"html": "https://wpnews.pro/news/building-task-oriented-dialogue-systems-via-instruction-guidance-without-data", "markdown": "https://wpnews.pro/news/building-task-oriented-dialogue-systems-via-instruction-guidance-without-data.md", "text": "https://wpnews.pro/news/building-task-oriented-dialogue-systems-via-instruction-guidance-without-data.txt", "jsonld": "https://wpnews.pro/news/building-task-oriented-dialogue-systems-via-instruction-guidance-without-data.jsonld"}}