OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis

Researchers have developed OralAgent, the first dental-specialized AI agent that integrates 22 visual analysis tools and 368 dental textbooks to autonomously perform multimodal reasoning, tool-based decision-making, and knowledge retrieval for interactive dental image analysis. The system, which also introduces a 134.8-million-token bilingual dental text resource called OralCorpus, achieved state-of-the-art performance on multiple clinical benchmarks, demonstrating its potential to support real-world oral healthcare diagnosis and treatment planning.

arXiv:2605.27378v1 Announce Type: new Abstract: Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for specific tasks and individual imaging modalities, their isolated designs limit practical use in real-world clinical workflows. In this paper, we present OralAgent, the first dental-specialized AI agent that unifies multimodal reasoning, tool-based decision-making, and knowledge-grounded retrieval within an end-to-end automated framework. It integrates 22 visual analysis tools and 368 widely-used classical dental textbooks, enabling autonomous reasoning, planning, tool use, knowledge retrieval, and multi-step workflow execution. Furthermore, we introduce OralCorpus, a large-scale, high-quality bilingual textual resource containing 134.8M tokens curated for dental retrieval-augmented generation RAG . To evaluate models' multidisciplinary dental knowledge, we construct OralQA-ZH, a Chinese multiple-choice question benchmark consisting of 798 items across eleven oral subspecialties. Extensive experiments demonstrate that OralAgent achieves state-of-the-art performance on the MMOral-Uni, MMOral-OPG, and OralQA-ZH benchmarks, highlighting its effectiveness, interpretability, and adaptability in real-world clinical settings. The code and models are publicly available at https://github.com/isjinghao/OralAgent.