Average GPU utilization in production Kubernetes clusters is just 5%, according to the Cast AI 2026 State of Kubernetes Optimization Report, meaning 95 cents of every GPU dollar goes to idle silicon. …
Chinese AI startup Moonshot unveiled its Kimi K3 model on July 16, 2026, featuring a 2.8 trillion-parameter size and million-token context window at roughly $12 per million tokens, triggering a global…
Average GPU utilization across tens of thousands of production Kubernetes clusters is just 5%, according to the Cast AI 2026 State of Kubernetes Optimization Report. Default Kubernetes scheduling uses…
NVIDIA released Nemotron 3 Embed on July 15 and 16, 2026, an open embedding collection whose 8B checkpoint ranks #1 on RTEB with a 78.46 average NDCG@10. The collection includes three open checkpoints…
Moonshot AI released Kimi K3, the world's first open-weight model with 2.8 trillion parameters, which autonomously designed a computer chip, built a GPU compiler from scratch, and edited its own launc…
Moonshot released Kimi K3, a 2.8 trillion-parameter open-weight model, the largest ever, with native vision and a 1M-token context window, claiming ~2.5× better scaling efficiency than K2 and pricing …
Icop, an open-source AI content filtering plugin for VLC media player, uses local ONNX Runtime inference to classify video frames before display, keeping processing on-device with no cloud uploads or …
An open-source AI agent called SAM that runs on a user's own machine is now available, offering a free, private team of AI agents that can research, remember, and take real action on the computer. The…
NexSub, a fully offline AI video subtitle translator using local Whisper models, launches as the world's first tool to provide real-time multilingual subtitles without internet or cloud costs. It supp…
NVIDIA Parakeet is now available as a speech-to-text engine for Telnyx Voice AI, enabling self-hosted multilingual transcription with automatic language detection for 25 European languages on Telnyx i…
A former pilot turned entrepreneur founded RendeRex, a Dubai-based hardware company, in 2020 during the COVID-19 pandemic, initially aiming to sell 3D rendering workstations but pivoting to AI worksta…
A hardware analysis reveals that deploying 70-billion parameter models in FP16 requires moving 140 gigabytes of weights across the memory bus per token, creating a memory-bound bottleneck that limits …
A hardware-software co-design prototype called PIM-HBM explores zero-copy memory view fusion and fault telemetry for LLM training, using JAX/XLA integration and branchless CUDA kernels to mitigate com…
Alphabet Inc.'s stock fell over 4% on July 16, 2026, after delays in Google's AI initiatives, including the Gemini 3.5 Pro model and the postponement of replacing Google Assistant with Gemini on Andro…
Thinking Machines Lab, the AI startup founded by former OpenAI executive Mira Murati, released its first fully open source AI model called Inkling on July 15. The model has 975 billion parameters, use…
Self-hosting open-weight large language models can save millions of dollars compared to using inference providers, according to a practical guide by Cline that analyzes the economics using Kimi K2.6 a…
A FreeBSD Foundation intern, Sourojeet Adhikari, is porting AMD's ROCm compute stack to FreeBSD, aiming to get at least simple vector addition working on the BSD platform. The project was highlighted …
NVIDIA announced it will expand its Jetson Thor lineup with two new mid-range modules, the Jetson Thor T3000 and T2000, set for release in Q1 2027. The T3000 offers 8 Arm Neoverse V3AE CPU cores, 1536…
NVIDIA introduced NemoClaw, a collection of open blueprints for building autonomous agents, to integrate context-aware video AI agents into enterprise workflows. The approach combines the NVIDIA Metro…
NVIDIA released the Nemotron 3 Embed collection of open embedding models, led by an 8B model that ranks #1 on the RTEB leaderboard with a score of 78.5%, alongside efficient 1B variants for production…