Waymo posted an opening for a Senior Machine Learning Engineer on its Predictive Planning (PrePlan) team, offering a base salary of $213,000 to $263,000 per year for an on-site role in Mountain View o…
Ray 2.55 adds official TPU support with atomic gang scheduling for TPU slices, aiming to cut GPU costs by enabling Ray-based workloads to run on Google's TPUs. Google's motive is to boost external TPU…
Extropic, a Boston-based hardware startup, is hiring junior ML scientists for its Thermo ML Resident program, offering a salary of $75,000–$200,000 per year for on-site work. Residents will collaborat…
42dot, the Global Software Center of Hyundai Motor Group, is hiring a Staff VLA Engineer in Sunnyvale, California, with a salary range of $189,000–$311,000 per year, to research and prototype next-gen…
Developer gpjt has uploaded PyTorch-compatible versions of all his JAX-trained GPT-2 models to the Hugging Face Hub, including models from his blog series on writing an LLM from scratch and Chinchilla…
Waymo, an autonomous driving technology company, is hiring a Sr Staff Tech Lead, Machine Learning Engineer for its Perception team in Mountain View or San Francisco, California, with a salary range of…
A developer benchmarked three Gemma 4 deployments on a single AWS T4G GPU for under $3, comparing vLLM, JAX, and PyTorch runtimes. The project built a common harness to measure decode throughput, reve…
A developer benchmarked AWS g5g and g6 GPU instances for serving Google's Gemma-4-E2B language model with identical code and weights, finding the g6 delivers 3.7x the decode throughput. Profiling reve…
A developer's hand-written Gemma 4 port in pure JAX runs on both Turing and Ada NVIDIA GPUs with identical weights, but performance differs drastically due to hardware-specific compute dtype handling …
A developer's hand-written Gemma 4 port in pure JAX runs across TPU v5e/v6e and NVIDIA T4G GPUs, revealing that while most of the code is portable, two hardware-specific issues break the abstraction. …
A developer has published a step-by-step guide for serving Google's Gemma 4 model on an AWS EC2 G5g instance using pure JAX, targeting the cheapest whole NVIDIA GPU available on AWS. The guide details…
Thinking Machines Lab, a San Francisco-based AI company, is hiring a Coding Agents researcher with a salary range of $350k–475k per year to work on agentic coding capabilities for its frontier models.…
A developer has released a tool to reconstruct and visualize distributed LLM training traces, enabling users to drag and drop compute kernels and collectives to create DDP, TP, FSDP, EP, and CP traces…
Google Cloud has introduced native vLLM TPU support for embedding inference, targeting production long-context retrieval with Qwen3-Embedding-8B and Qwen3-VL-Embedding-8B. The engineering effort addre…
Google engineers reported a 4.7x faster prefill and 3.1x faster decode for Qwen 3.5-397B-A17B on Ironwood TPUs between April and June, achieved by using data parallelism for attention layers and exper…
Google Cloud has integrated native TPU support into vLLM, the open-source LLM serving engine, to enable enterprise-grade precision for long-context multimodal embedding inference, targeting the Qwen3 …
PyTorch's built-in GELU function is 20% faster than a hand-rolled version when training GPT-2 small models, according to a developer's benchmark. The same code training the same model on the same data…
OpenAI is hiring a Software Engineer, Trainium in San Francisco with a salary range of $295k–380k/yr, to build and optimize its inference stack for AWS Trainium, developing high-performance kernels an…
A new interactive adaptation of the JAX scaling book chapter on transformer training parallelism lets readers drag sliders to see how data, tensor, pipeline, and expert parallelism affect communicatio…
Jump Trading Group is hiring a Research Scientist/Research Engineer for its reinforcement learning team in Chicago, New York, or London, offering an annual base salary of $200,000–$350,000. The role i…