Machine learning news — deep learning, reinforcement learning, neural architecture search, diffusion models, and new ML frameworks and libraries.
Small language models with 1-9 billion parameters now handle 60-80% of enterprise AI workloads more efficiently than frontier models, according to a 2026 analysis of enterprise AI infrastructure. These models run on a si…
Amazon Web Services announced Amazon Bedrock Advanced Prompt Optimization, a new tool that optimizes prompts for any model on Amazon Bedrock while comparing original and optimized prompts across up to five models simulta…
IBM has released two new multilingual embedding models under the Apache 2.0 license, built on ModernBERT: a compact 97M-parameter model and a full-size 311M-parameter model. Both support over 200 languages, handle contex…
A new generation of enterprise software companies is shifting focus from owning the "system of record" to building "systems of intelligence," according to analysts. These systems sit above databases like CRM platforms, u…
Promptimus, a new method for automatically optimizing well-developed large language model prompts, eliminates the need for manual engineering by using AI agents to identify failure points and surgically refine prompts. T…
A Reddit user on r/DHExchange offering to sell a database of over 150,000 labeled images of human feces, collected from 25,000 users of his AI-powered poop analysis app. The poster sought advice on monetizing the dataset…
Synchronous continuous batching in LLM inference causes inefficiency by forcing the CPU and GPU to work sequentially, leaving one idle while the other operates. This idle time can account for nearly a quarter of total ru…
The GGUF file format consolidates all necessary model components—including weights, chat templates, and special tokens—into a single file, offering a more ergonomic alternative to the scattered JSON files typical of safe…
PyTorch 2.12 introduces a new device-agnostic `torch.accelerator.Graph` API that unifies graph capture and replay across CUDA, XPU, and out-of-tree backends. The release delivers up to 100x faster batched eigenvalue deco…
NVIDIA and Ineffable Intelligence, the London-based AI lab founded by AlphaGo architect David Silver, announced a collaboration to build infrastructure for large-scale reinforcement learning. The partnership will focus o…
Archivists and historians are turning to large language models to rapidly transcribe centuries-old handwritten documents at scale, a task that previously required specialized training or custom software. Researchers at W…
Jon Hyman, co-founder and CTO of Braze, explained on the *Leaders of Code* podcast how he transformed the company's 300-person engineering organization into an AI-first team within months. He noted that over 60% of Braze…
Every interaction with a modern large language model is structured as a list of messages, each tagged with a role—system, user, or assistant—that shapes how the model responds and how context is managed across multiple t…
Arm has released a set of hands-on Jupyter labs demonstrating how to deploy AI models on edge devices using ExecuTorch, an extension of the PyTorch ecosystem designed for local inference on constrained hardware. The labs…
Veridian AI has released version 1.3.1 of its Quantum Mathematician, a state-vector engine that entangles historical theorems with current outcomes to produce high-resolution mathematical diagnostics. The system enforces…
Large language models like ChatGPT, Gemini, and Claude operate as next-token prediction machines, taking a sequence of tokens as input and outputting a probability distribution over their vocabulary for what the next tok…
Convergent infrastructure requirements for the foundation model lifecycle—including tightly coupled accelerator compute, high-bandwidth networking, and distributed storage—and highlights the growing reliance on open-sour…
Google's official gasket-driver repository for Coral TPU support has been abandoned as of April 2026, breaking compatibility with Debian 13/Trixie running kernel 6.13+. A community-maintained fork now provides a pre-buil…
At Google Cloud Next '26, Google announced Cloud Storage Rapid, a new family of object storage capabilities designed for data-intensive AI and analytics workloads. The offering includes Rapid Bucket, a high-performance z…
Traditional cloud reliability models, which focus on individual instances, are inadequate for trillion-parameter AI models, necessitating a shift to cluster-level reliability. Google presents its cluster-level framework …