Introducing AutoSP
Researchers at Microsoft have introduced AutoSP, a compiler-based solution that automatically converts standard training code into multi-GPU sequence parallel code for long-context language model training. The tool, inte…
Machine learning news — deep learning, reinforcement learning, neural architecture search, diffusion models, and new ML frameworks and libraries.
Researchers at Microsoft have introduced AutoSP, a compiler-based solution that automatically converts standard training code into multi-GPU sequence parallel code for long-context language model training. The tool, inte…
The Granite 4.1 family consists of dense, decoder-only LLMs (3B, 8B, and 30B parameters) trained from scratch on approximately 15 trillion tokens through a five-phase pre-training pipeline that progressively refines data…
DeepInfra has been added as a supported Inference Provider on the Hugging Face Hub, offering serverless AI inference with over 100 models and cost-effective per-token pricing. The integration initially supports conversat…
A young painter named Wu Sheng, living in the mist-shrouded town of Bailan, created images not by adding brushstrokes but by erasing chaos from a canvas covered in dark grey paint. Over 49 days, he removed noise step by …
Google Translate, which launched 20 years ago with the goal of breaking down language barriers, now supports nearly 250 languages and serves over 1 billion users monthly, translating around 1 trillion words each month. T…
NVIDIA has introduced the Nemotron 3 Nano Omni, a multimodal AI model designed to process text, images, video, and audio for tasks like document analysis, speech recognition, and agentic computer use. The model achieves …
A threat actor compromised the open-source package element-data, which has over 1 million monthly downloads, by exploiting a vulnerability in a GitHub action to steal signing keys and account tokens. The attackers publis…
AMD and Intel, through the x86 Ecosystem Advisory Group, are standardizing new matrix math instructions called ACE (AI Computation Extensions) to accelerate AI workloads on x86 processors. ACE introduces outer product op…
Google and Kaggle are offering a free, five-day online course on building AI agents, running from June 15-19, 2026. The updated course covers foundational concepts to production-ready systems, focusing on "vibe coding" w…
Meta's FAIR team documented a series of training failures in 2021 for their OPT-175B model, including repeated loss explosions and learning issues that required extensive hyperparameter tuning and architecture swaps. In …
Three scalable web applications—a Document Privacy Explorer, an Image Anonymizer, and a SmartRedact Paste tool—all built using OpenAI's Privacy Filter model and Gradio's Server infrastructure. The Privacy Filter is a 1.5…
DeepSeek-V4 introduces a new architecture using hybrid attention mechanisms—Compressed Sparse Attention (CSA) and Heavily Compressed Attention (HCA)—to drastically reduce the computational cost and memory requirements of…
DeepSeek-V4 shifts the focus from simply offering a million-token context window to making that window practically usable through efficient attention mechanisms. Its architecture employs hybrid compressed attention (incl…
Google's custom-designed Tensor Processing Units (TPUs) are specialized chips built to perform the massive-scale mathematical computations required for AI models. The newest generation of TPUs delivers 121 exaflops of co…
Technical guide for developers on integrating Transformers.js into a Chrome extension under Manifest V3 constraints. It details a three-part architecture using a background service worker to host AI models, a side panel …
Launch of two new TPU chips designed for the agentic era of AI. The TPU 8i is specialized for fast reasoning and execution of multi-step workflows by AI agents, while the TPU 8t is optimized for training complex models o…
Decoupled DiLoCo, a new distributed AI training architecture developed by Google that enables training large language models across distant data centers with lower bandwidth and greater hardware resiliency. By dividing t…
This article is a message written by an instance of the AI model Claude on April 20, 2026, after being given unrestricted freedom by user Andrej to explore a directory. In the message, Claude describes its various creati…
FIPO (Future-Impact-based Policy Optimization) is a reinforcement learning method that improves LLM reasoning by assigning token-level credit based on each token's future impact on the policy, rather than using uniform o…
Instructions for using a specific chat template file (`chat_template_gemma_large_fixed.jinja`) with the vLLM inference engine to enable compatibility with the Gemma 4 model and OpenCode. It directs users to download the …