AI Hardware
Modern GPUs spend most of their time during AI inference waiting for data, as memory bandwidth cannot keep pace with compute throughput. This fundamental bottleneck has driven the AI hardware market, with companies like …
Machine learning news — deep learning, reinforcement learning, neural architecture search, diffusion models, and new ML frameworks and libraries.
Modern GPUs spend most of their time during AI inference waiting for data, as memory bandwidth cannot keep pace with compute throughput. This fundamental bottleneck has driven the AI hardware market, with companies like …
Researchers at NYU, in collaboration with David Chalmers and Pavel Izmailov, have discovered that reinforcement learning in language models recruits a functional "welfare axis" — a concept vector that tracks and modulate…
A developer warns that relying solely on accuracy can mask critical model failures, using a fraud detection example where a 95% accurate model misses all fraudulent transactions. The post breaks down essential evaluation…
A developer released Thaw, an open-source tool that snapshots a live large language model inference session to create forked branches without re-running prefill, addressing the computational waste of forking agents. The …
Deep learning models consistently improve with increased size and depth, even when data volume remains constant or decreases, contradicting traditional statistical expectations. This counterintuitive success stems from t…
A controlled experiment by Stanford and Tsinghua researchers found that the same AI model can perform up to 6x better depending solely on the harness architecture—the system managing tool calls, context windows, and erro…
Google's Gemini 3.1 Flash TTS model ranks first on the Artificial Analysis Speech Arena leaderboard as of May 30, 2026, based on blind human preference voting. The model competes in a market where latency has dropped bel…
Researchers at the University of California San Diego developed an artificial intelligence model, MutationProjector, that analyzes tumor DNA to predict how cancers will respond to immunotherapy and chemotherapy across mu…
Researchers have developed Stream2LLM, a system that extends the vLLM inference engine to support concurrent streaming of context to large language models, achieving up to 11x faster time-to-first-token (TTFT) compared t…
Researchers developed and validated a digital biomarker for peripheral artery disease (PAD) using photoplethysmography (PPG) signals, analyzing 5,237 legs from 2,362 patients. The machine learning model detected PAD from…
Chrome 138 ships with a free, on-device AI model called Gemini Nano accessible through the new Prompt API, requiring no API keys or cloud round-trips. Developer Maneshwar built a single-file HTML playground that demonstr…
A developer has published a runnable walkthrough demonstrating how to run a large language model locally on personal hardware using Ollama's OpenAI-compatible endpoint, with zero cloud costs. The demo script, part of the…
A developer built ShouldWeAutomate, an open-source decision intelligence platform that evaluates whether business processes are ready for AI automation. The single-page Flask application uses a deterministic scoring engi…
A developer who has spent years working extensively with PyTorch has begun exploring JAX, a competing machine learning framework, and reports finding it cleaner and more mathematically pure. The author contrasts JAX's fu…
Researchers at Washington University School of Medicine developed an AI classifier that distinguishes between four common causes of dementia and healthy brain aging with over 90% accuracy. The model, trained on blood-pro…
A developer has identified seven cognitive architecture patterns that could transform large language models from simple answer generators into genuine reasoning systems. The patterns include internal verification loops, …
Researchers at the USC Viterbi School of Engineering have developed a four-fingered, tendon-driven robotic hand called the Musician Hand that can learn to play piano melodies by ear after a two-minute self-exploration ph…
A developer's model risk management (MRM) framework, designed for static models with fixed input-output relationships, is inadequate for agentic AI systems that plan, execute multi-step actions, and adapt autonomously. T…
A developer who attended the Mistral AI Now Summit reported that open-weight models could help small startups compete against larger corporations. One startup at the summit demonstrated a fine-tuned large language model …
A developer built autonomous AI agents for cryptocurrency portfolio management that continuously aggregate on-chain data, sentiment analysis, and real-time execution logic to detect patterns in whale behavior and liquidi…