Surge AI's HANDBOOK.md benchmark shows the best model passes only 36.2% of tasks under strict grading, with all other frontier configurations scoring below 25%, revealing that AI agents struggle to fo…
Amazon is closing Mechanical Turk to new users on July 30, putting the 21-year-old platform into maintenance mode after a 2023 study found that 33–46% of workers were using large language models to co…
Surge AI released GDP.pdf, a benchmark testing frontier AI models on real-world PDF tasks across ten domains, and found every model scored under 30%. The benchmark highlights critical failures in fina…
VC Cafe's July 8, 2026 analysis argues that the next AI market layer will be a task economy built around expert judgment, workflow completion, and data labeling, with platforms like Mercor, Scale AI, …
Amazon Web Services is shutting down Mechanical Turk, its crowdsourcing platform launched in 2005 as the original 'Artificial Artificial Intelligence,' to new customers starting July 30, 2026. The ser…