Machine learning news — deep learning, reinforcement learning, neural architecture search, diffusion models, and new ML frameworks and libraries.
DeepSeek-V4-Flash, a new local AI model, now makes it practical for engineers to experiment with "steering" — a technique that manipulates a model's internal activations to guide its outputs. The stripped-down version, D…
Amazon Web Services has introduced document-level access control list (ACL) support for Amazon Simple Storage Service (Amazon S3) knowledge bases in Amazon Quick, allowing organizations to restrict sensitive documents to…
Amazon researchers have developed a new scaling law that connects large language model architecture directly to inference efficiency, enabling faster text generation without sacrificing accuracy. The framework, presented…
Small language models with 1-9 billion parameters now handle 60-80% of enterprise AI workloads more efficiently than frontier models, according to a 2026 analysis of enterprise AI infrastructure. These models run on a si…
Amazon Web Services announced Amazon Bedrock Advanced Prompt Optimization, a new tool that optimizes prompts for any model on Amazon Bedrock while comparing original and optimized prompts across up to five models simulta…
IBM has released two new multilingual embedding models under the Apache 2.0 license, built on ModernBERT: a compact 97M-parameter model and a full-size 311M-parameter model. Both support over 200 languages, handle contex…
A new generation of enterprise software companies is shifting focus from owning the "system of record" to building "systems of intelligence," according to analysts. These systems sit above databases like CRM platforms, u…
Promptimus, a new method for automatically optimizing well-developed large language model prompts, eliminates the need for manual engineering by using AI agents to identify failure points and surgically refine prompts. T…
A Reddit user on r/DHExchange offering to sell a database of over 150,000 labeled images of human feces, collected from 25,000 users of his AI-powered poop analysis app. The poster sought advice on monetizing the dataset…
The GGUF file format consolidates all necessary model components—including weights, chat templates, and special tokens—into a single file, offering a more ergonomic alternative to the scattered JSON files typical of safe…
Synchronous continuous batching in LLM inference causes inefficiency by forcing the CPU and GPU to work sequentially, leaving one idle while the other operates. This idle time can account for nearly a quarter of total ru…
PyTorch 2.12 introduces a new device-agnostic `torch.accelerator.Graph` API that unifies graph capture and replay across CUDA, XPU, and out-of-tree backends. The release delivers up to 100x faster batched eigenvalue deco…
NVIDIA and Ineffable Intelligence, the London-based AI lab founded by AlphaGo architect David Silver, announced a collaboration to build infrastructure for large-scale reinforcement learning. The partnership will focus o…
Archivists and historians are turning to large language models to rapidly transcribe centuries-old handwritten documents at scale, a task that previously required specialized training or custom software. Researchers at W…
Jon Hyman, co-founder and CTO of Braze, explained on the *Leaders of Code* podcast how he transformed the company's 300-person engineering organization into an AI-first team within months. He noted that over 60% of Braze…
Every interaction with a modern large language model is structured as a list of messages, each tagged with a role—system, user, or assistant—that shapes how the model responds and how context is managed across multiple t…
Arm has released a set of hands-on Jupyter labs demonstrating how to deploy AI models on edge devices using ExecuTorch, an extension of the PyTorch ecosystem designed for local inference on constrained hardware. The labs…
Veridian AI has released version 1.3.1 of its Quantum Mathematician, a state-vector engine that entangles historical theorems with current outcomes to produce high-resolution mathematical diagnostics. The system enforces…
Large language models like ChatGPT, Gemini, and Claude operate as next-token prediction machines, taking a sequence of tokens as input and outputting a probability distribution over their vocabulary for what the next tok…
Convergent infrastructure requirements for the foundation model lifecycle—including tightly coupled accelerator compute, high-bandwidth networking, and distributed storage—and highlights the growing reliance on open-sour…