A new study from arXiv (2608.23807v1) characterizes serving of masked diffusion language models (dLLMs) using LLaDA-8B-Instruct with a D2F LoRA adapter on a single NVIDIA H200 GPU, finding that reques…
IBM released two compact 470M-parameter English speech recognition models, granite-speech-5.0-470m-turboctc and granite-speech-5.0-470m-turboctc-nc, achieving over 12,600 RTFx on an NVIDIA H200 GPU an…
NVIDIA introduced the ALCHEMI Toolkit, a PyTorch-native suite for GPU-accelerated atomistic simulations with machine learning interatomic potentials, and demonstrated that AI coding agents can build s…
A community release called Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16, built on Alibaba's Qwen3.8-27B by the team AEON-7, removes the model's refusal behavior via abliteration and reports a mean KL div…
A technical analysis by an unnamed author, inspired by a post from Su Jianlin, derives the arithmetic intensity (FLOPs per byte) of attention during single-token decode, finding MHA has an AI of exact…
Mistral released the Mistral 3 family on December 2, 2025, under Apache 2.0, including nine dense Ministral 3 models (3B, 8B, 14B) and the sparse mixture-of-experts Mistral Large 3 with 675B total and…
Cast AI benchmark testing shows that continuous batching at batch size 8 reduces Llama 3.1 70B inference cost on a single H100 from approximately $0.60-$0.80 per million tokens to $0.15-$0.25 per mill…
Thinking Machines Lab released Inkling-Small, an open weights Mixture-of-Experts model with 276B total and 12B active parameters, about a quarter the size of its 975B-parameter Inkling model. The mode…
South Korean AI company Upstage released Solar Open 2, an open-weight foundation model optimized for agentic use, featuring a 250B-parameter MoE architecture with 15B active parameters per token and a…
CIA Director John Ratcliffe is publicly warning against China stealing technology and AI chip exports, directly contradicting Trump's policy of allowing NVIDIA to ship H200 processors to China, accord…
Kimi released Kimi K3, a 2.8-trillion-parameter open model with native vision and a 1-million-token context window, claiming it is the world's first open 3T-class model. While trailing proprietary mod…
Crusoe launched Serverless Fine-Tuning and Self-Serve Deployments for its Intelligence Foundry, enabling organizations to fine-tune and deploy open AI models with granular control and cost efficiency.…
A single H200 GPU with 141GB HBM3e cannot comfortably run DeepSeek V4 Flash (284B total, 13B active parameters) due to VRAM constraints, even with 2TB system RAM for offloading. The model requires an …
Google DeepMind released DiffusionGemma on June 10, 2026, a 26B open-weight text diffusion model that generates 256 tokens simultaneously, achieving up to 1,008 tokens per second on an H100—4-5x faste…
Avataar AI, a startup selected for India's $1.2 billion India AI Mission, launched a new video generation model called Varya that is 10 times faster and 20 times cheaper than competitors like Veo and …
Kog AI launched a tech preview of its Kog Inference Engine (KIE), achieving 3,000 output tokens per second per request on 8× AMD MI300X GPUs and 2,100 on 8× NVIDIA H200 GPUs using a 2B model. The comp…