A study of 21 audio-recorded pediatric surgical encounters found that zero-shot prompting of Qwen 2.5 32B achieved a macro Cohen's kappa of 0.139 (95% CI 0.111-0.164) for detecting shared decision-mak…
A new survey from arXiv (2608.14797v1) identifies three emerging paradigms in decoding methods for large language models (LLMs) and large vision-language models (LVLMs), offering a systematic review o…
Researchers from the Allen Institute for AI found that Dolma, the open training corpus for the OLMo series of large language models, likely contains hundreds of thousands of documents with extremist c…
A new study from arXiv (2608.14843v1) finds that academic advisors' writing styles are 39.9% closer in cosine distance to their students' styles than random same-field authors, based on 5,803 authors …
A new pipeline called AViD Journal, described in an arXiv paper (arXiv:2608.14669v1), aims to automate novelty verification of mathematical theorems by formalizing LaTeX statements in Lean 4 and using…
An audit of frontier AI forecasting published on arXiv (2608.14903v1) finds that quantitative forecasts often lack a solid measurement foundation, with only seven of 62 selected systems jointly observ…
A correction to OpenAI's *Ten Advances in Mathematics and Theoretical Computer Science* fixes a polarity error in a greedy conditioning lemma used in a claimed exponential parallel-repetition theorem …
A new arXiv study (2608.14927v1) finds that large language models can predict failure risk but struggle to identify which multi-agent collaboration protocol is cost-effective. Across 4,181 competition…
TwinGridShield, a runtime authorization layer for LLM-assisted energy-management tools, blocked all 500 unsafe grid actions in a matched-model IEEE 14-bus test, but unsafe acceptance rose to 5.63% und…
A new framework from arXiv (2608.14613v1) introduces a mechanism-design approach to verify and repair LLM-agent negotiations over Anthropic's Model Context Protocol (MCP) and Google's Agent2Agent (A2A…
A new arXiv paper (2608.14711v1) reveals that AI coding agent benchmarks misapply the pass@k estimator, inflating reported scores by 0.85-0.97 in absolute terms (0.96-0.98 reported vs. 0.00-0.12 corre…
A new arXiv paper (arXiv:2608.14791v1) introduces CEDAR-GRPO, a process-aware reinforcement learning framework that improves abductive reasoning in large language models by combining final-answer corr…
Researchers propose Adversarial Translation Optimization (ATO), a gradient-based method that augments existing machine translation benchmarks to increase difficulty, lowering average translation quali…
A new benchmark called MecEng, introduced in an arXiv paper (2608.14615v1), evaluates large language models on mechanical engineering tasks, finding that the best open-weight model achieves an 86.0% s…
Researchers introduced Pistis, an agentic proof search tool that generates faithful formal Lean proofs, and applied it to Euclid's Elements, producing proofs favored 2.89x by human reviewers and 5.2x …
A new arXiv paper (2608.15304v1) systematically analyzes risks induced by expanding cognitive capabilities in frontier agentic systems powered by large language models (LLMs), proposing a three-level …
A new arXiv study (2608.15693v1) finds that no single model compression technique wins across edge AI tasks, reporting that Qwen3.5 0.8B reaches 93.85 SQuAD F1 and 92 EM under Q5_K_M GGUF quantization…
A benchmarking study of 14 large language models (LLMs) found that they are not reliable sources of cosmetic chemistry information, with overall performance poor and most pronounced deficits in quanti…
A new study from arXiv (2608.14651v1) evaluating open-weight Multi-Modal Large Language Models (MM-LLMs) for disaster assistance found that no model achieves reliable consistency across text and audio…
A new arXiv preprint (arXiv:2608.15382v1) proposes a causal knowledge graph-based evaluation framework for healthcare large language models (LLMs), tested in a cardiovascular pilot. The framework's in…