NVIDIA announced partnerships with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR to establish financing platforms aimed at mobilizing more than $500 billion for AI infrastructure, w…
River AI, a two-month-old startup co-founded by former xAI researcher Igor Babuschkin, has raised $1.1 billion in an initial funding round led by General Catalyst and Amp PBC, with participation from …
Floating-point arithmetic non-determinism can cause LLM inference to produce different outputs across runs, hardware, or provider routing, according to an analysis of numerical execution in large lang…
Disaggregated LLM serving, which runs prefill and decode on separate GPU pools and transfers KV caches over the network, should always be used in practice under sufficient load, according to a technic…
ONNX Runtime, an open-source inference engine, enables interoperability of machine learning models across frameworks and hardware platforms by leveraging the ONNX standard. It simplifies deployment by…
Meta has released Muse Glimmer, a 30-billion-parameter open-weight AI model that runs on a single consumer GPU, available for free under the Apache 2.0 license. The model, distilled from Meta's closed…
NVIDIA announced on August 10, 2026, memorandums of understanding with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs, and KKR to create independent financing platforms aimed at mobilizing m…
VectorWare has made Rust's portable SIMD (core::simd) work natively on GPUs, allowing the same SIMD code to run on x86, ARM, and NVIDIA GPUs without modification. This direct mapping of SIMD vectors t…
NiceShot AI, a computer vision project developed over 26 months, automatically converts long gameplay recordings into structured event data, highlight clips, and session statistics using a pipeline of…
Humanoid robotics is hard because robots must simultaneously perceive, decide, move, and adapt, with the long-term competitive edge hinging on building a strong loop between physical operation, data c…
Amazon Web Services has added three new foundation models to its SageMaker JumpStart service, including Z.ai's GLM-5.2 FP8, NVIDIA's Nemotron-Nano-12B-v2, and Z.ai's GLM-OCR, targeting agentic enginee…
NVIDIA Nemotron 3.5 Lightning has not been released, and no release date has been announced, according to OutYet.ai, which tracks NVIDIA's official release surfaces. The tracking site, last checked Au…
NVIDIA's open-weights Nemotron 3.5 Lightning mixture-of-experts model, with 30 billion total parameters but only 3 billion active, is designed for agentic grunt work and can be run locally on consumer…
NVIDIA released Nemotron 3.5 Lightning, a 30B-A3B open mixture-of-experts language model designed for high-volume agentic tasks, claiming roughly 4x throughput versus similarly-sized Qwen models and 3…
NVIDIA has released SwitchYard, an open-source routing library that automatically directs AI agent tasks to the most appropriate local or frontier model, claiming it can deliver 50% faster responses a…
NVIDIA's open-source SwitchYard router, built on RouteLLM, can be configured with a locally hosted Nemotron 3.5 Lightning model to cut API costs without losing task quality. On DGX Spark hardware, Nem…
NVIDIA released Nemotron-3.5-Lightning, a 30B mixture-of-experts model with 3B active parameters, on the same day Modelplane, an open-source fleet-level control plane for inference, achieved zero-day …
A developer's third installment in a GPU optimization series details implementing distributed training for large language models using CUDA and ROCm, covering All-Reduce, Ring-AllReduce, and ZeRO shar…
NVIDIA announced partnerships with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR to establish independent financing platforms aimed at mobilizing over $500 billion of third-party ca…
NVIDIA Corporation announced partnerships with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs, and KKR to establish AI compute infrastructure financing platforms, aiming to mobilize over $50…