The Writerslogic team's Claude Sonnet 4 submission ranked first among sentence-level systems in Task 1.1 of the CLEF 2026 SimpleText shared task with a SARI of 47.43 and BLEU of 14.21, placing third o…
Anthropic's Claude Sonnet 5.5, released 2026-09-28, recorded a 0.84-point drop in Neuroticism on the IPIP-50 versus Claude Sonnet 4.6, the largest single shift in the Sonnet 5.5 predecessor comparison…
Stanford researchers published Paper2Agent in Nature on September 16, a framework that converts computational research papers into executable AI agents by wrapping each paper's codebase as a Model Con…
A Stanford University paper introduces Self-Organizing Agent Teams (SAT), a framework in which groups of AI agents learn collaboration strategies from as few as 15 AIME 2024 or 25 GPQA Diamond problem…
Amazon has deprecated the APAC-hosted version of Anthropic's Claude Sonnet 4 model, identified as apac.anthropic.claude-sonnet-4-20250514-v1:0, which was released on 2025-05-22 and now carries no anno…
A developer tracked 157 AI conversations over 30 days using TokenPulse, finding an estimated total cost of $0.439, or about $0.0028 per conversation. The data showed ChatGPT (GPT-4o) was cheapest per …
OpenAI and Anthropic formally swapped access to their frontier models for cross-lab safety evaluations in early summer 2025, with results published between August 27 and 29, marking the first time two…
A new benchmark called ABLE, introduced in arXiv paper 2609.05818v1, evaluates how well LLM agents use biological AI models such as ProteinMPNN and AlphaFold3 in dual-use protein design workflows. Tes…
A study presented at the 17th Conference of the Association for Machine Translation in the Americas (AMTA 2026) benchmarked eight large language models on game localization quality assurance tasks, fi…
Researchers introduced DeltaML-Bench, a benchmark of 48 tasks from research papers that tests AI agents' ability to improve published baselines in real-world repositories. In evaluations, the ARG scaf…
Researchers introduced ClosureBench, a constructive benchmark for compositional graph-relational reasoning that generates instances on demand with programmatically verified ground truth, avoiding data…
In a benchmark of 10 leading AI models reviewing enterprise test case documentation, 9 out of 10 fell into 'Abstract Complacency,' merely summarizing headings without verifying claims. Only Kimi K3 ac…
Researchers introduced SKILL, a self-correcting knowledge-guided iterative large language model agent that unifies multi-agent LLM reasoning with reinforcement learning for logic synthesis optimizatio…
A developer built a free browser-based token counter that handles OpenAI, Anthropic, and Google models, providing exact or estimated token counts and custom pricing. The tool aims to help developers a…
AWS Bedrock provides up to three times more notice than Anthropic before Claude models are deprecated, according to an analysis of 19 model retirements. Anthropic's median notice was 63 days, while Be…
AI Change Watch, an independent project tracking model deprecations, found that Anthropic gives at least 60 days' notice before retiring a model, with a median of 63 days across 19 retirements, while …
A new study from the Supervised Program for Alignment Research (SPAR), led by Achu Menon and mentored by Santiago Aranguri of Goodfire, finds that the realism win rate, a metric used to measure evalua…
ChatPlayground AI is offering a lifetime Unlimited Plan license for $59.25 with code Aug25, down from $619, until August 9 at 11:59 p.m. The platform runs one prompt across more than 20 models simulta…
A developer's colleague incurred a $1,200 bill in a two-hour AI coding session, highlighting the hidden costs of AI assistants. Token consumption, especially for code, is 1.5-2.5x higher than prose, a…
A two-year analysis by Soamee, an AI integration firm, reveals that the real cost of running large language models in production is driven by inflated input token counts from system prompts, conversat…