LLM benchmarks shift towards action and professional applications
An analysis of 14,767 arXiv evaluation-resource papers published between 2022 and 2026 found that LLM benchmarks are shifting toward action, interaction, and professional-use tasks, with LLM-based scoring increasingly us…