A new arXiv paper introduces Strategic 16K, a leakage-controlled corpus of 16,000 diplomatic cables from the WikiLeaks Public Library of US Diplomacy (PlusD), and benchmarks six model architectures fo…
A new study from arXiv (2608.16931v1) introduces SW-ProxyCE, a query-free attack framework that exploits public EEG foundation encoders to generate adversarial examples that transfer to private downst…
A new position paper from arXiv (2608.16974v1) argues that fairness failures in generative models are fundamentally an evaluation problem, citing a lack of comparability and actionability in current f…
A new arXiv paper (2608.17087v1) introduces telos, a PyTorch library providing an algebra-generic, differentiable evaluation engine for linear temporal logic, enabling gradient-based training of softl…
A new arXiv study (2608.17091v1) evaluates six deep learning models for day-ahead electricity price forecasting across multiple markets, using the Germany-Luxembourg (DE-LU) bidding zone 2024 as the t…
Aegis, a runtime governance system for agentic AI, prevented all risky tool actions in a sandbox evaluation, recording zero governed mock-tool applications and zero governed risky side-effect completi…
Researchers propose DiSCO, a zero-shot, black-box defense for text-to-image models that reduces Not-Safe-For-Work (NSFW) content generation by 37.7% on undefended models and 25.13% on defended models …
A preregistered study of Anthropic's Sonnet 5 found that explicitly requesting high reasoning effort increased mean delivered cost by $0.01031 per call compared with omitting the effort term, while ac…
A new human-AI discovery paradigm called Find, Attempt, and Recommend (FAR) automates the search for mathematical problems and filters candidate conjectures for expert review, according to a preprint …
KernelArc, a multi-agent framework for autonomous GPU kernel optimization, achieved first-place rankings on representative L1, L2, Quantization, and FlashInfer tasks at the public SOL-ExecBench leader…
A new arXiv paper (2608.17128v1) proposes 'cooperative observation' as a framework for personal AI, arguing that a system's ability to assist a user is bounded by what it can observe and that users' c…
Researchers introduced KNOWSIM, an evaluation framework with a user simulator that models evolving user knowledge to assess how well LLM assistants calibrate information delivery. Validated against 70…
Researchers at arXiv (2608.17170v1) introduced an automated approach using Large Language Models (LLMs) in an agentic check-fix-verify loop to synthesize executable Python feature extractors for const…
A new study from arXiv (2608.17183v1) evaluating five widely used safety benchmark suites across 26 open-source small language models (SLMs) finds that ambiguous judgments dominate and correlate with …
A new logit-based energy scoring method outperforms prompted LLM-as-judge for ranking scientific hypotheses, achieving 33.0% Hit@1 pooled across two scorers versus 16.6% for prompted listwise ranking,…
Researchers introduced ASI-Bench, the first benchmark to jointly evaluate AI systems' innovative exploration and autonomous scientific execution across general research domains, built by over 40 exper…
A new arXiv preprint (2608.17744v1) reports that fine-tuning three frontier mixture-of-experts models (Alibaba, OpenAI, NVIDIA; 3.6-4.0B active parameters) to reason in Greek produces no measurable ac…
A study from arXiv (2311.06273v1) found that ChatGPT can predict stock market trends for Microsoft and Google based on Twitter sentiment analysis, with a positive link between ChatGPT's evaluations an…
A new arXiv paper (2608.17950v1) reports that large language models (LLMs) organize their hidden state manifolds into Small-World networks, with deep reasoning layers compressing conceptual distances …
A new arXiv paper (arXiv:2608.17445v1) proves that decomposition attacks against large language model (LLM) services cannot be reliably stopped when attackers use unlinkable identities, even with stat…