IRT

A study of a production analytics LLM agent serving tens of thousands of monthly active users found that multidimensional 2PL adaptive testing delivered the best score fidelity, executing 200 question…

A new study finds that averaging benchmark scores produces misleading rankings when evaluation data is sparse and item difficulty varies widely, with Spearman rank correlation dropping from 1.000 to 0…