A new evaluation protocol called Fair-ASR, introduced in a paper, equalizes target-call budgets across jailbreak attacks and finds that rankings of 11 representative attacks shift dramatically dependi…
The developers behind the open-source OmnisBench project have released a benchmark designed to measure the true cost savings of LLM routing. Running 364 coding and math tasks across four models, they …
Researchers introduced ICD-Deepresearch, a DeepResearch workflow that combines structured EHR foundation models with language foundation models to forecast ICD codes for future clinical visits, achiev…
Researchers introduced Dripper, a lightweight framework for main HTML content extraction that uses small language models for constrained sequence labeling, achieving a throughput of 3.08 pages per sec…
A new benchmark called CIMemories, presented in a paper on arXiv, reveals that frontier large language models leak sensitive information from persistent memory in up to 69% of attribute-level violatio…
Roboflow's benchmark analysis shows OpenAI's GPT-5.6 Sol outperforms all previous OpenAI models on visual understanding tasks, including specialized vision models. The model handles diverse computer v…
Boards are now pressing startups on AI vendor concentration risk, asking founders to prove their business isn't dependent on a single model provider. OpenAI's August 2025 GPT-5 rollout briefly cut off…
A training-free framework called ACTS-SQL, developed by researchers and deployed in Volcano Engine's Torch Log Service (TLS), improves SQL execution accuracy from 36.77% to 53.61% on real user queries…
Google researchers found that frontier LLMs such as Gemini-3-Pro and GPT-5 encode 95–98% of tested facts but fail to directly recall 26–34% of them, with recall failures accounting for more than 70% o…
AgentRouter, a non-profit unified LLM API gateway, is offering developers $200 in free credits upon signup via referral links, with no credit card required. The platform provides a single API endpoint…
Open-weight AI models have closed the performance gap with closed-source APIs, with specialized 7B to 30B models now outperforming older 175B models due to improved data quality and Mixture-of-Experts…
APIMart, an AI API aggregator founded by Anthony Max, offers discounted access to models like GPT-5 and Sora 2, aiming to reduce costs for developers. The platform aggregates multiple AI APIs, providi…
APIMart, a new AI API aggregator, launched on Hacker News offering discounted access to 500+ AI models, including GPT-5 and Sora 2, with a user account system featuring referral codes and terms of ser…
Zhipu AI's open-source GLM model has surged in popularity on Hacker News in 2026, driven by its reasoning capabilities, resource efficiency, and permissive licensing. The model's unique architecture, …
Researchers introduced ε-MemEvo, a framework for cross-task knowledge transfer in LLM program evolution, which stores prior experience as task-agnostic tactic memories and uses an adaptive injection g…
A developer's first Model Context Protocol (MCP) server crashed the LLM context window by returning 4,000 rows of raw data, causing a 'Context Window Exceeded: Input tokens 128k/128k' error. The fix w…
Google Research scientists Nitay Calderon and Gal Yona introduced knowledge profiling, a framework showing that frontier LLMs like Gemini3 and GPT-5 encode nearly all facts but fail to recall many, ma…
AI coding costs have fallen by roughly two thirds since 2025, with Anthropic's current Opus model priced at $5 input and $25 output per million tokens, down from $15 and $75, yet most users still base…
Researchers introduced RefineBench, a benchmark of 1,000 challenging problems across 11 domains, to evaluate language models' ability to refine their own responses. In self-refinement, even frontier m…
A retrospective study using the PRIME dataset found that multimodal large language models (MLLMs) achieved F1 scores above 0.9 for distinguishing neoplastic from non-neoplastic colorectal polyps, but …