Nathan Witkin

AI models remain unreliable for workplace tasks, with METR (Model Evaluation and Threat Research) reporting that AI can complete tasks taking humans 16 hours only 50% of the time, a caveat highlighted…

AI researcher Nathan Witkin has challenged the validity of METR's widely-cited Long Tasks benchmark, arguing its methodology is fundamentally flawed despite its status as a leading indicator of AI cap…