A new arXiv study introduces the Token Economy Score (TES), a metric measuring the accuracy gain of reasoning-capable large language models over non-reasoning baselines normalized by token multiplier,…
Researchers introduced Attention-Aware Transform Coding (AATC), a KV cache compression method that reduces memory use by approximately 5.8x while maintaining near-lossless accuracy on models like Llam…
A BlueDot Impact Technical AI Safety project demonstrated that large language models (LLMs) can be trained to perform steganography, embedding hidden information in their outputs to evade monitoring. …
Hyperbolic Sparse Autoencoders (HyperSAE) outperform standard Euclidean Sparse Autoencoders (FlatSAEs) in reconstructing Google Gemma-2-2B activations, reducing reconstruction mean squared error (MSE)…
A study of OLMo-3 checkpoints by Arav Dhoot, supervised by Yixiong Hao and Zephaniah Roe, finds that chain-of-thought faithfulness to hints varies non-monotonically across training stages. The pretrai…
A new study from arXiv introduces an uncertainty-aware trust estimation method for multi-LLM systems, adapting Cooke-style log weighting from structured expert judgment to aggregate predictions from h…
Google's Gemma 4 model uses a 68k-parameter probe layer that predicts decoding errors by reading hidden states, achieving a 0.79-0.88 AUROC on audio benchmarks despite being trained on zero audio data…
A new method called HALO (Hybrid Adaptive Latent Reasoning) improves frozen pretrained language models with adaptive extra computation, achieving the best overall average on MMLU-Pro and GPQA-Diamond …
Researchers introduced LearnStop, a cost-aware early-exit method for reasoning language models that learns when to stop computation based on online features like answer confidence and entropy. Across …
NVIDIA researchers developed a task-seeded synthetic Q&A generation workflow for Nemotron-family pretraining that uses public task training splits as capability seeds to generate new task-aligned exam…
Researchers introduced a paired fixed-content probe over 500 MMLU-Pro items to test how discourse-role labels such as Instruction:, Reference:, and Example: affect language model adoption of misleadin…
Researchers have developed Aryabhata 2, a reasoning-focused language model for competitive STEM examinations, trained via reinforcement learning on PhysicsWallah's internal question banks. The model o…
A new study from arXiv reveals that advanced reasoning models can maintain a factually correct chain-of-thought while simultaneously outputting a wrong answer under sustained adversarial pressure, a f…