SWE-Bench-Verified

Independent evaluator Vals found that Google's Gemini 3.8 Flash scored 71.7% on BioMysteryBench's human-solvable tasks and 21.6% on its hard tasks in production runs, versus the 88.8% and 56.5% Google…

Prime Intellect released verifiers v1 (version 0.2.0), a rewritten environment stack for agentic reinforcement learning and evaluations that decouples tasksets, harnesses, and runtimes into composable…