{"slug": "crossoracle-an-agentic-framework-for-real-time-expert-personas-with-parallelized", "title": "CrossOracle: An Agentic Framework for Real-Time Expert Personas with Parallelized Acoustic Synthesis", "summary": "Yash Raj Singh presents CrossOracle, a production-deployed spoken dialogue system for real-time Hinglish voice interaction across eleven Expert Persona identities, achieving a mean TTS Real-Time Factor of 0.107 and a 100% barge-in resolution rate. The system, deployed at crossoracle.io, uses parallelized acoustic synthesis, language-aware semantic boundary heuristics, and a deterministic AbortController-based barge-in protocol to overcome latency bottlenecks in cascaded ASR-LLM-TTS pipelines.", "body_md": "[CrossOracle: An Agentic Framework for Real-Time Expert Personas with Parallelized Acoustic Synthesis](https://aclanthology.org/2026.sigdial-1.18.pdf)\n\n##### Abstract\n\nWe present CrossOracle, a production-deployed spoken dialogue system for real-time Hinglish (Hindi-English code-switched) voice interaction across eleven Expert Persona identities. The system addresses the latency bottleneck of cascaded ASR-LLM-TTS pipelines through three contributions: (1) a parallelized First-In-First-Stream TTS worker that overlaps synthesis with ongoing LLM generation, mathematically ensuring gapless audio playback; (2) a language-aware semantic boundary heuristic that flushes text chunks at Hindi danda and Latin punctuation boundaries, preserving prosodic integrity across code-switched utterances; and (3) a deterministic AbortController-based barge-in protocol that resolves user interruptions in under 1 ms. Empirical evaluation of live conversational logs demonstrates a mean TTS Real-Time Factor of 0.107 and a 100% barge-in resolution rate. The live system is deployed at crossoracle.io and supports persona switching, custom persona creation from natural language descriptions, and robust Hinglish ASR error tolerance via a Devanagari ratio mishear filter. The demonstration invites attendees to hold unscripted Hinglish conversations, stress-test the barge-in protocol, and construct novel personas on-the-fly.- Anthology ID:\n- 2026.sigdial-1.18\n- Volume:\n[Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue](/volumes/2026.sigdial-1/)- Month:\n- August\n- Year:\n- 2026\n- Address:\n- Atlanta, Georgia, USA\n- Editors:\n[Jinho D. Choi](/people/jinho-d-choi/),[Yun-Nung Chen](/people/yun-nung-chen/),[Kotaro Funakoshi](/people/kotaro-funakoshi/),[Ali Emami](/people/ali-emami/)- Venue:\n[SIGDIAL](/venues/sigdial/)- SIG:\n[SIGDIAL](/sigs/sigdial/)- Publisher:\n- Association for Computational Linguistics\n- Note:\n- Pages:\n- 254–257\n- Language:\n- URL:\n[https://aclanthology.org/2026.sigdial-1.18/](https://aclanthology.org/2026.sigdial-1.18/)- DOI:\n- Cite (ACL):\n- Yash Raj Singh. 2026.\n[CrossOracle: An Agentic Framework for Real-Time Expert Personas with Parallelized Acoustic Synthesis](https://aclanthology.org/2026.sigdial-1.18/). In*Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue*, pages 254–257, Atlanta, Georgia, USA. Association for Computational Linguistics. - Cite (Informal):\n[CrossOracle: An Agentic Framework for Real-Time Expert Personas with Parallelized Acoustic Synthesis](https://aclanthology.org/2026.sigdial-1.18/)(Singh, SIGDIAL 2026)- PDF:\n[https://aclanthology.org/2026.sigdial-1.18.pdf](https://aclanthology.org/2026.sigdial-1.18.pdf)", "url": "https://wpnews.pro/news/crossoracle-an-agentic-framework-for-real-time-expert-personas-with-parallelized", "canonical_source": "https://aclanthology.org/2026.sigdial-1.18/", "published_at": "2026-07-21 00:00:00+00:00", "updated_at": "2026-07-21 20:16:38.204390+00:00", "lang": "en", "topics": ["artificial-intelligence", "natural-language-processing", "ai-products", "ai-agents"], "entities": ["CrossOracle", "Yash Raj Singh", "Association for Computational Linguistics", "SIGDIAL"], "alternates": {"html": "https://wpnews.pro/news/crossoracle-an-agentic-framework-for-real-time-expert-personas-with-parallelized", "markdown": "https://wpnews.pro/news/crossoracle-an-agentic-framework-for-real-time-expert-personas-with-parallelized.md", "text": "https://wpnews.pro/news/crossoracle-an-agentic-framework-for-real-time-expert-personas-with-parallelized.txt", "jsonld": "https://wpnews.pro/news/crossoracle-an-agentic-framework-for-real-time-expert-personas-with-parallelized.jsonld"}}