A technical guide argues that developers should run both Claude Code and OpenAI Codex as a single pipeline rather than choosing one, based on two months of testing on large codebases. Benchmarks show …
DeepSWE v1.1 updates the benchmark for long-horizon engineering tasks with isolated verification and structured test reports, making results more reproducible and harder to game. Pass rates remain clo…
RTK, a tool that compresses terminal output for LLM agents, claims to cut token usage by 60-90% but faces skepticism due to misleading savings metrics, silent failure risks, lack of accuracy benchmark…
Clawmark, an open-source Rust CLI tool, enables A/B testing of CLAUDE.md files by evaluating two variants against five SWE-bench Lite tasks using Claude and Docker. The tool generates a comparison rep…
Synaxi-predict, a new tool from Synaxi, predicts the token cost, turn count, and pass rate of a Claude Code task before execution, enabling users to select the optimal model and avoid wasted tokens. T…
Anthropic released Claude Fable 5 on June 9, but the U.S. Commerce Department issued an export-control directive barring foreign nationals from accessing it, forcing Anthropic to take both Fable 5 and…
A developer compiled a directory of over 50 AI tools and agents, including coding companions like Devin and v0 by Vercel, LLM platforms such as Google Gemini and Le Chat by Mistral, benchmarking sites…
AI agents degrade in their adherence to security constraints as context windows fill with task artifacts, a phenomenon the author calls 'constraint durability.' In multi-task batches, accumulated toke…
A developer argues that the current AI revolution is fundamentally different from past waves of enthusiasm, citing the convergence of large-scale labeled data, GPU computing, and deep network architec…
Anthropic's Claude Fable 5 model achieved a 95% score on SWE-bench Verified and 80% on the harder SWE-bench Pro, but the model is architecturally designed to hand off control to the older Claude Opus …
Anthropic reported that its AI model Claude now writes 80% of the company's internal code, raising questions about the potential for recursive self-improvement where AI systems autonomously enhance th…
Mendral, an AI DevOps agent developer, cannot provide a single accuracy metric for its CI failure diagnosis agent despite processing 36,564 investigations across 5.7 million CI jobs and 14.4 billion l…
GateTest launched a new CI tool that runs 110 quality assurance checks in a single scan and automatically generates a pull request with fixes within 60 seconds. The tool uses Claude Sonnet 4 to identi…
Microsoft Research has released SkillLens, an open-source framework designed as a "microscope" for analyzing how AI agents absorb and utilize skills. The framework provides a complete pipeline for ext…
Anthropic released Claude Opus 4.8 on May 28, 2026, the eleventh major version in its Claude lineage, achieving a 69.2% score on SWE-bench Pro and introducing Dynamic Workflows for orchestrating hundr…
Anthropic shipped Claude Sonnet 4.6 in February 2026, five months after Sonnet 4.5, with the same API pricing of $3 input and $15 output per million tokens. Sonnet 4.6 achieved an 80.2% SWE-bench Veri…
A new open-source coding agent, mini-SWE-agent, achieves up to 74% on the SWE-bench verified benchmark using just 100 lines of Python code. Developed by the Princeton and Stanford team behind SWE-benc…
By early 2026, the correlation between AI model quality and price had collapsed, with Chinese open-source models like DeepSeek V4 Flash achieving 79% on SWE-bench at $0.28 per million output tokens — …
Claude Opus 4.7 outperformed GPT 5.5 on repository understanding and multi-file generation tasks in the DeepSuite benchmark, a new coding evaluation designed to mirror real-world developer workflows. …
Researchers have introduced DeepSuite, a new benchmark for evaluating AI coding agents that tests them using short, natural-language prompts requiring complex solutions across entire code repositories…