Measuring Definition Sensitivity in LLM Annotation of Social Science Concepts
A study posted to arXiv (2611.13339v1) found that swapping competing definitions of a concept in an LLM annotation prompt changes more labels, on average, than merely paraphrasing one definition, across six concepts and …