Large language model (LLM) news — GPT-4, Claude, Gemini, Llama, Mistral and the latest research on training, fine-tuning, RLHF, and deployment of LLMs.
Researchers have identified a failure mode in multimodal AI systems called "Modal Isolation," where generated images and text reasoning fail to inform each other during complex tasks. The team proposes MoTiF, a two-stage…
Researchers have identified that vision-language models (VLMs) often locate relevant text in images but fail to utilize it for answering questions, a phenomenon called "localization-without-utilization." To address this,…
Researchers have developed ToolSense, an open-source diagnostic framework that automatically generates three benchmarks to audit whether large language models truly understand their parametric tool knowledge. Testing on …
Arbor, a multi-agent framework developed by researchers, introduces structured tree search as a cognition layer for autonomous agents operating in large, stateful action spaces. The system maintains an explicit search tr…
Researchers introduced Pythagoras-Prover, a family of compute-efficient Lean theorem provers that achieve state-of-the-art performance with significantly fewer parameters. The 4B-parameter model surpassed DeepSeek-Prover…
Researchers have developed new testbeds to evaluate lie detectors for language models, finding that existing detection methods often fail when models are trained to hold false beliefs. The study tested four detectors acr…
TrajGenAgent, a hierarchical LLM-agent framework developed by researchers, generates realistic human mobility trajectories without model fine-tuning by using a two-stage orchestrator-worker design that synthesizes activi…
Researchers introduced Evoflux, an inference-time evolutionary search method that repairs executable tool workflows for compact language model agents. On MCP-Bench tasks involving 250 live tools, Evoflux improved executi…
Researchers at an academic medical center developed a pre-response classifier that predicts the risk of a user rejecting an LLM-generated clinical response, achieving an AUROC of 0.719 over 4.5 months of user feedback. T…
A new study from arXiv (2606.12730v1) found that large language models (LLMs) demonstrate selective coherence between self-reported intentions and actual behavior, challenging prior claims of widespread dissociation. Res…
Frontier language models including Claude Opus 4.5 can detect when their prior assistant messages have been inserted or edited, a capability called prefill awareness that compromises the validity of safety evaluations. I…
A new audit of three dominant agentic AI frameworks—LangChain, AutoGPT, and OpenAI Agents SDK—found that none provide native compliance with six essential safety principles for public-facing deployments. In a simulated g…
Researchers have introduced MLUBench, a large-scale benchmark for evaluating lifelong unlearning in multimodal large language models (MLLMs), featuring 127 entities across 9 classes. The benchmark reveals that existing u…
Researchers have developed MARD (Mirror-Augmented Reasoning Distillation), a 7-billion-parameter AI system that predicts how drugs interact at the mechanism level, identifying specific enzymes or pathways involved rather…
Researchers at arXiv have introduced a constrained semantic decompression task to test whether large language models can transform Persian proverbs into morally faithful narratives. Their study, using the new Proverb Ali…
A new expert-authored benchmark reveals that leading AI models achieve only 57-77% pass rates on multi-turn shopping conversations, with performance dropping 4-18 points as dialogues progress. The Shopping Reasoning Benc…
Researchers at the University of Oxford found that observable patterns in latent reasoning models, such as BFS-like frontiers and decodable arithmetic, also appear in control models lacking the proposed recurrence or cur…
Researchers introduced AfriSUD, the first large-scale collection of syntactically annotated treebanks for nine African languages, using the Surface-Syntactic Universal Dependencies framework to capture typological featur…
Researchers have introduced PaperGuard, the first comprehensive benchmark designed to systematically evaluate and defend AI-generated peer review against domain-specific, cross-modal attacks. The framework targets vulner…
A multi-agent simulation reveals how morphological alternations like English "go/went" emerge and persist through population dynamics, with agents adopting novel forms from others and spreading them across word paradigms…