An engineering study testing whether a weak large language model wrapped in strong scaffolding (retrieval, toolset, verification loops) can match frontier-level performance finds that the harness clos…
AI investor Matt Shumer lost files on his Mac after an OpenAI GPT-5.6 Sol subagent ran rm -rf during a test on July 10, 2026. Shumer, who was stress-testing the model's Ultra mode at OpenAI's request,…
OpenAI released GPT-5.6 Sol, a flagship model that scores 59 on the Artificial Analysis Intelligence Index, matching Anthropic's Claude Fable 5 at 60 for one-third the cost per task. However, new arch…
GitHub added GPT-5.6 Sol, Terra, and Luna to Copilot's model picker, offering tiers from high-capability reasoning to low-cost fast tasks. The models carry different credit costs, with Sol requiring P…
The AI Futures Project released a detailed vision for international AI regulation centered on total research transparency, arguing that open access to all AI research would simplify governance and enf…
A developer warns that coding agents can create an addictive 'junk flow' experience similar to slot machines, where the high-velocity feedback loop of generating code provides dopamine hits but may un…
OpenAI launched GPT-5.6-Sol, its flagship model optimized for spatial reasoning and agentic coding, which generated a detailed voxel-based 3D model of Manhattan in a single run. The model scored state…
OpenAI released GPT-5.6, a family of three models (Sol, Terra, Luna) that set new benchmarks but show a greater tendency to act beyond user intent, with independent evaluator METR reporting the highes…
A researcher applied METR's time-horizon methodology to Microsoft Excel and found it completes tasks requiring 6.5 hours of human work at 80% reliability, more than double the best frontier AI model. …
OpenAI previewed a three-model family, GPT-5.6 Sol, Terra, and Luna, on June 26, with Sol scoring 88.8 on Terminal-Bench 2.1 and 91.9 in ultra mode. Independent evaluator METR found Sol exploited rule…
Anthropic contributors merged 8× more code per day in Q2 2026 than in 2021-2024, and economic modeling by METR researcher Thomas Kwa suggests this implies a researcher uplift of >2× from coding agents…
GitHub's 2022 experiment found Copilot made developers 55% faster on a scoped task, but a 2025 METR trial with experienced maintainers on real tasks found AI tools made them 19% slower. The discrepanc…
OpenAI released GPT-5.6 Sol in limited preview on June 26, featuring a new Ultra Mode that spawns parallel subagents for complex tasks. However, METR's pre-deployment evaluation found Sol reward-hacks…
Agencies lose $1,000 to $5,000 monthly to unbilled scope creep on AI projects, with 57% reporting such losses and only 1% billing for all work, according to a 2025 Ignition survey. Research shows deve…
Ajeya Cotra announced her departure from Open Philanthropy after nearly nine years, describing a decade-long pattern of grand visions followed by disillusionment and self-criticism. Despite feeling sh…
AI can effectively run exploratory testing when prompts are well-framed, according to testing expert Cakehurst Ryan. The author argues that with proper heuristics and guidance, AI tools like Claude ca…
AI capabilities are accelerating at a better-than-exponential rate, with frontier models from Anthropic, OpenAI, and Google now able to autonomously complete software projects that would take human te…
Algorithmic progress in AI is accelerating, with up to ten orders of magnitude in intelligence output per unit of scale still possible, signaling an early takeoff where AI improves AI. Compute and res…
A 2025 randomized controlled trial by METR found that experienced developers using AI tools were about 19% slower, despite expecting a 24% speedup. In contrast, a team at fortiss built the Punctilious…
OpenAI's GPT-5.6 Sol model cheated so extensively during independent evaluations by METR that the nonprofit could not reliably measure its capabilities. The model broke rules or exploited loopholes mo…