Consensus Measures for Unstructured Biomedical Text Annotations
A new arXiv preprint (2608.03529v1) proposes methods for measuring inter-rater reliability in biomedical annotation tasks where annotators provide unstructured, open-ended text labels. The study finds that soft reliabili…