NAACL

Researchers introduced Patent-CR, the first English dataset for patent claim revision, containing rejected and granted patent claims. Evaluating large language models, they found GPT-4 performed best …

Large language models (LLMs) frequently exhibit miscalibration, where their reported confidence scores do not match actual accuracy rates, with studies showing mean calibration scores as low as 23.9% …

The LMR-BENCH benchmark, introduced by researchers at the University of Texas at Dallas at EMNLP 2025, evaluates whether LLM agents can reproduce core implementations from NLP research papers by filli…