ACL Anthology

Computer Anthology, a new benchmark family from the ACL Anthology repository, evaluates AI models on reasoning over newly published NLP papers, with monthly updates to prevent data contamination. The …

The LMR-BENCH benchmark, introduced by researchers at the University of Texas at Dallas at EMNLP 2025, evaluates whether LLM agents can reproduce core implementations from NLP research papers by filli…