UMLS

Researchers released MTDiag, a multi-turn diagnostic dialogue dataset built from DDXPlus, MIMIC-IV, and published case reports, to evaluate large language models (LLMs) as diagnostic agents in dynamic…

Researchers introduced T2D-Bench, a benchmark for evaluating LLM outputs on type 2 diabetes using a multi-layer clinical-lifestyle knowledge graph. Testing showed GPT-4o-mini and GPT-4o failed evidenc…

Researchers introduced DeFAb, a benchmark for defeasible abduction in foundation models, converting knowledge bases into 372,648+ logically verifiable instances. Frontier language models achieved at m…