The Kimi Team published a new attention architecture, Kimi Linear, on arXiv in 2025. The architecture uses Kimi Delta Attention interleaved 3:1 with full attention, becoming the first linear hybrid to…
Researchers Chen et al. published a paper on arXiv 2025 introducing Janus-Pro, a unified multimodal model that uses separate encoders for understanding and generation within a single transformer. The …
Researchers Nie et al. published a paper on arXiv in 2025 introducing an 8-billion-parameter diffusion language model that generates text by un-masking tokens rather than left-to-right, rivaling autor…
Geng et al. published a paper on arXiv 2025 introducing Mean Flows for one-step generative modeling, which trains on average velocity instead of instantaneous velocity to enable one-step generation fr…
Zhang et al. published a paper on arXiv 2025 introducing Agent Learning via Early Experience, a method where agents learn from the futures created by their own early actions without rewards or imitati…
Researchers Zhao et al. published a paper on arXiv 2025 introducing Absolute Zero, a method where a model proposes its own tasks and a code executor grades them, enabling reasoning reinforcement learn…
Researchers Deng et al. published a paper on arXiv in 2025 introducing a unified multimodal pretraining model that understands, generates, and edits content, with multimodal reasoning emerging as data…
NVIDIA published Cosmos World Foundation Model Platform for Physical AI on arXiv in 2025, introducing pretrained world models that use diffusion and autoregressive techniques to simulate the physical …
DeepSeek-AI published DeepSeek-V3.2, an open large language model featuring Sparse Attention that reduces computational complexity from O(L²) to O(Lk). An interactive visual explainer of the paper is …
DeepSeek-AI published DeepSeek-OCR: Contexts Optical Compression on arXiv in 2025, achieving ~10× context compression with 97% decode accuracy by rendering long text as images. An interactive visual e…
Independent researcher Haijun Wen of Light Ark Technologies is seeking a cs.CL endorser on arXiv to post a preprint on a model-agnostic framework for persistent AI personality, addressing memory and p…
A new study from MIT and Princeton AI Lab involving 2,691 participants reveals that people systematically overestimate how much time AI saves them on simple tasks, creating an "efficiency-gain illusio…
A developer built and open-sourced GroktoCrawl, a self-hosted web scraping, search, and AI research service that eliminates per-call pricing. The MIT-licensed tool runs on personal hardware and offers…
Researchers Wenfang Sun, Xinyuan Song, Pengxiang Li, Lu Yin, Yefeng Zheng, and Shiwei Liu published a paper on arXiv titled 'The Curse of Depth in Large Language Models,' investigating performance deg…
Researchers Stangel et al. published a paper on arXiv 2025 demonstrating that reinforcement learning on a proper scoring rule can teach large language models to express calibrated confidence in their …
Zhao et al. published GenPRM, a generative process reward model that reasons and runs code to verify each step, achieving state-of-the-art performance where a 7B parameter model outperforms a 72B para…
Researchers led by Damani et al. introduced a method to train language models to express their uncertainty by adding a calibration reward to reinforcement learning from verifiable rewards (RLVR). The …
Cui et al. published a paper on arXiv 2025 (arXiv:2505.22617) explaining the entropy mechanism of reinforcement learning for reasoning language models, including why RL entropy collapses and proposing…
Researchers Liu et al. published a paper on arXiv 2025 introducing ProRL, a method using prolonged reinforcement learning with KL resets to expand reasoning boundaries in AI models. An interactive vis…
MiniMax released MiniMax-M1, a hybrid-attention reasoning model that scales test-time compute using lightning attention, detailed in a 2025 arXiv paper. The model employs efficient reinforcement learn…