Researchers in Sydney published a crossover randomized trial on June 2 comparing AI-supported teleorthodontic screening with face-to-face triage in a public clinic. Among 178 completers, the remote workflow achieved 98% overall accuracy at the IOTN 3-or-higher referral threshold and was 2.9 times faster, but it incorrectly rejected three referrals and could not reliably grade borderline cases. The result supports assisted screening, not autonomous clinical replacement.
Researchers in Sydney published a single-center crossover randomized controlled trial on June 2 evaluating AI-supported teleorthodontic screening in a publicly funded clinic. The study compared the remote workflow with face-to-face assessment using the Dental Health Component of the Index of Orthodontic Treatment Need, or IOTN DHC.
The researchers randomized 255 referred patients to receive either face-to-face or remote triage first. 178 participants, aged 7 to 38, completed both assessments, separated by a two-month washout period. For remote screening, participants submitted intraoral scans through Dental Monitoring, extraoral photographs, and a patient-history survey.
What the trial measured
The primary endpoint was whether the remote workflow correctly accepted or rejected referrals at an IOTN DHC threshold of 3 or higher. The study also evaluated performance at the stricter threshold of 4, agreement across IOTN grades, and screening duration.
The authors reported that, at the 3-or-higher threshold, AI-supported teleorthodontic triage had 1.00 sensitivity, 0.67 specificity, and 0.98 overall diagnostic accuracy against face-to-face screening. They also reported three referrals that the remote workflow incorrectly rejected. At the threshold of 4, the independent specialist review of the paper reports sensitivity of 0.93 and specificity of 0.73.
Remote triage was 2.9 times faster than face-to-face screening. That operational gain matters in a public referral service, but it does not remove the need for clinical review.
Where the workflow fell short
The paper says the system did not correctly identify overbite and overjet for some patients and did not measure several traits, including crossbite, contact-point displacement, and functional shift. The authors concluded that the workflow could screen mild and severe malocclusions but could not yet confidently assign IOTN grades for borderline severity.
The evidence is also bounded. This was one public orthodontic clinic using a specific hybrid workflow and IOTN thresholds; investigators and participants could not be blinded to the assessment sequence. The authors declared no conflicts of interest, while Dental Monitoring subsidized access to the ScanBox Pro and monitoring platform.
For clinical-AI teams, the practical lesson is to evaluate the complete workflow at the decision threshold that controls access to care. Aggregate accuracy alone can hide consequential false referrals, so deployment monitoring should separately track incorrect acceptances, incorrect rejections, unmeasured traits, scan quality, and clinician overrides.
Key Points #
- 1Among 178 completers, AI-supported remote triage was 2.9 times faster than face-to-face screening.
- 2At the IOTN 3-or-higher threshold, the study reported 1.00 sensitivity, 0.67 specificity, 0.98 overall accuracy, and three incorrectly rejected referrals.
- 3The single-center workflow could not confidently grade borderline cases and did not measure several clinically relevant traits.
Scoring Rationale #
The prospective crossover trial evaluates a complete AI-supported clinical triage workflow against face-to-face screening and reports concrete diagnostic and speed results. Its operational relevance is meaningful for public orthodontic services, but generalizability is limited by the single-center setting, hybrid workflow, incomplete measurement of several traits, and difficulty with borderline cases.
Sources #
Primary source and supporting public references used for this report.
Practice with real Health & Insurance data
90 SQL & Python problems · 15 industry datasets
250 free problems · No credit card
See all Health & Insurance problems