FIRE-Bench

Autonomous agents using large language models (LLMs) struggle to replicate recent scientific findings, with top systems achieving less than 50 F1 on the new FIRE-Bench evaluation framework, which test…