Agents' Last Exam
Researchers introduced Agents' Last Exam (ALE), a new benchmark designed to evaluate AI agents on long-horizon, economically valuable, real-world tasks with verifiable outcomes. Developed with over 250 industry experts, …
Machine learning news — deep learning, reinforcement learning, neural architecture search, diffusion models, and new ML frameworks and libraries.
Researchers introduced Agents' Last Exam (ALE), a new benchmark designed to evaluate AI agents on long-horizon, economically valuable, real-world tasks with verifiable outcomes. Developed with over 250 industry experts, …
A new technical architecture using zero-knowledge proofs can verify that frontier AI models were trained according to specified compute thresholds without revealing proprietary details, solving a key enforcement problem …
A new study finds that when large language models repeatedly mutate computer programs without selection pressure, the mutations consistently converge toward a limited set of structural forms rather than exploring new var…
A new study published in Nature reveals that large language models can transmit behavioral traits like animal preferences or misalignment to other models through semantically unrelated training data, such as number seque…
Agent-ML-skills, a curated pack of 15 battle-tested machine learning skills, has been released to teach AI coding agents like Codex, Claude Code, and Cursor how to avoid common ML mistakes such as data leakage and scorin…
Thinking Machines Lab released two open-source libraries, `tinker` and `tinker-cookbook`, to help developers and researchers fine-tune large language models. The `tinker` SDK handles distributed training complexities via…
Two developers, Francis Tran and Elmar Chavez, built ClassifierAI, a prototype Chrome extension that automatically detects AI-generated content on the DEV platform. The extension analyzes an entire article and its cover …
Researchers introduced Tangram, a serving system that enables non-uniform Key-Value cache compression for multi-turn large language model inference. The system uses deterministic budget allocation, head group page cluste…
A developer deploying a 70B Llama-3 model on 8x H100s found that scaling from 8k to 32k context windows causes the KV cache to balloon to 10.7 GB per request, forcing memory paging to CPU at 200 concurrent users. KV cach…
Smart TV owners are unknowingly contributing to the AI data-scraping economy through a software development kit (SDK) from data-collection firm Bright Data, which is embedded in consumer apps and turns devices into resid…
The University of Cambridge and its spin-out DIOSynVax (DVX) Ltd have completed the first-in-human Phase 1 trial of pEVAC-PS, an AI-designed "universal" Sarbeco coronavirus vaccine. The open-label, dose-escalation study …
Researchers have identified exploitable vulnerabilities in the ML-DSA (Module-Lattice-Based Digital Signature Algorithm) implementation, as detailed in a newly released technical paper. The findings highlight security fl…
A developer built an AI-powered medical response system using LangGraph and Python that automates healthcare workflows from heart rate alerts to specialist appointments. The system uses state machines to triage patient s…
Researchers analyzing AI training dynamics found that mixing multiple training objectives under non-stationary distributions produces three distinct behavioral patterns: ecological generalists, conditional policies, and …
Researchers have developed BenchEvolver, a system that automatically generates harder coding benchmarks by first evolving solution algorithms and then deriving new problem statements from them. The method addresses bench…
Researchers have developed Discrete Tilt Matching (DTM), a likelihood-free method for fine-tuning masked diffusion large language models using reinforcement learning. The approach recasts fine-tuning as state-level match…
A final-year mathematics and computer science undergraduate is questioning whether pursuing a career in theoretical robotics, specifically in continual learning for human-like robot adaptation, could inadvertently accele…
A comprehensive guide titled "ML Bible" has been released, covering machine learning topics from classical algorithms to neural networks, transformers, vision, and agents. The resource provides a from-scratch approach to…
After two decades in logistics, supply chain software, and cloud engineering, a developer now writing the Pipeline & Prompts blog argues that understanding problems deeply and translating them into solutions is more valu…
Qualcomm AI Hub provides an end-to-end workflow for deploying machine learning models on Qualcomm devices, as demonstrated in a new tutorial that walks through MobileNet-V2 classification and YOLOv7 object detection. The…