How Much Human Label Variation Does Formal Semantic Structure Explain?: Group-Level Effects and Item-Level Ceilings in NLI
A new study measuring how much formal semantic structure explains human label variation in natural language inference finds that it accounts for only 3.3 to 3.6 percent of entropy variance, with a group-level effect show…