Higgsfield AI, a generative AI company with $500M in annual revenue run rate and 25M+ users, is hiring an ML Systems Performance Engineer (MFU) for its Almaty, Kazakhstan office. The role focuses on o…
Researchers introduced HAWKEYE, an open-source framework that uses only 10 expert-written unit tests per GPU architecture to enable AI coding agents to generate hardware-aware kernels, approaching or …
Pine AI's 1.2B-parameter speech recognition model tops the τ³-Voice leaderboard with a score of 75, achieving significant gains on accented speech, medical dictation, and code-switching, but only marg…
A kernel is a single function that runs on a GPU, and the steep memory hierarchy—with a 1,600x gap between L2 cache and HBM—makes kernel design crucial for AI performance. FlashAttention, developed by…
A Kubernetes engineer's guide compares LLM serving engines, arguing that vLLM is not the only option and that choosing an engine is a critical production decision. The post highlights vLLM's strengths…
The KV cache has no standard ABI, with vLLM's FlashAttention backend alone reporting its cache shape as a four-dimensional tensor that varies by backend, attention variant, and model family, complicat…
A new arXiv preprint (2608.13756v1) reports that swapping only the INT8 linear kernel (CUTLASS versus Triton) inside vLLM causes the two arms to agree on no sequence in any end-to-end comparison (0/8,…
Triton 3.7's new plugin extension system lets GPU kernel developers load custom MLIR compiler passes at runtime as shared libraries, eliminating the need to maintain a Triton fork. Meta's TLX extensio…
A solo developer with no professional GPU background placed 12th of 183 in GPU MODE's batched QR decomposition contest, beating the cuSolver-backed baseline by 232x (419,000 µs down to 1,805 µs on NVI…
A new study comparing CUDA C++, Rust via NVIDIA's cuda-oxide, and Triton on a hash-blocked TSDF fusion kernel found that Triton is more than an order of magnitude slower than hand-written CUDA C++ on …
A developer has open-sourced a Decay-Gated O(N) Causal Linear Attention architecture with fused Triton/CUDA kernels, aiming to bypass quadratic multi-head attention bottlenecks. The project includes a…
The US lead over China in AI has essentially disappeared, according to an analysis of model releases and deployment trends. Chinese models like DeepSeek's R1 and V3 and Qwen now match or beat US open-…
Researchers have developed a compiler-grounded hierarchical optimization framework for Triton kernels that achieves a geometric-mean speedup of 4.35× and a median speedup of 2.73× across 37 benchmark …
At the AMD Advancing AI event, analysts from theCUBE Research highlighted AMD's transformation into a full-stack AI infrastructure company, with Dave Vellante noting AMD's $60 billion in M&A, includin…
JAX's Pallas kernel system, which lowers through Triton on GPU and Mosaic on TPU, lets developers write custom kernels when XLA's automatic fusion is insufficient for operations like flash attention, …
Netflix detailed its in-house LLM serving platform built on Triton and vLLM, revealing how it handles real-time and batch inference across CPUs and GPUs while managing version compatibility and constr…
NVIDIA CEO Jensen Huang's new X account signals a shift toward real-time, decentralized communication with the developer community, potentially accelerating feedback loops on AI hardware and software …
SonicSampler, a unified suite of tile-aware Triton kernels from arXiv, vertically fuses the complete LLM sampling pipeline into a fixed, workload-aware execution model, achieving up to 16x speedup ove…
A developer building the Triton DirectX 11 driver for QEMU argues that AI tools amplify human developers rather than replace them, citing challenges such as sparse documentation, multi-boundary debugg…
Triton-blackhole, a deterministic numerical debugger for Triton kernels, identifies where output diverges from a PyTorch reference and classifies drift as benign fp16/bf16 drift or a real bug without …