Hugging Face's upcoming tokenizers v1 release candidate produces the same token IDs as v0.23 while running often tens of times faster, the company reported, citing benchmarks run from its tokbench rep…
Bedrock Robotics posted an internship opening for a 2027 Onboard Infrastructure Engineer, ML Inference role based in San Francisco, CA, on a hybrid schedule, with pay not published. The intern will in…
Noctua, an open-source Kotlin SDK for the Oura Ring, provides on-device AI wellness insights and next-day readiness forecasts without uploading health data to the cloud. The SDK includes a typed Oura …
Meta AI Research has released Muse Glimmer, a 30-billion-parameter open-weight model under the Apache 2.0 license, designed for on-device agentic execution on consumer GPUs. The model uses 4-bit dynam…
Meta released Muse Glimmer, a 30-billion-parameter AI model optimized for always-on local agent workflows, available under the Apache 2.0 license. The model supports tool calling, function calling, lo…
Meta released Muse Glimmer, a 30-billion-parameter open-weight model for local agentic work, with a 4-bit version fitting under 20 GB and tested within 24 GB or 32 GB memory envelopes on consumer hard…
Meta introduced Muse Glimmer, an open-weight 30-billion-parameter model distilled from Muse Spark for on-device agentic workflows, with ExecuTorch adding end-to-end support for running it on NVIDIA GP…
Meta Superintelligence Labs released Muse Glimmer, a 30-billion-parameter open-weights model optimized for local agent workflows, under an Apache 2.0 license. The model runs on a single consumer GPU a…
ExecuTorch's experimental MLX delegate, released in May 2026, enables PyTorch models to run on Apple Silicon GPUs. Testing Qwen3-0.6B on an M1 Max, MLX INT4 achieved 188.9 tokens/s, 4.52x faster than …
PyTorch 2.13 has been released with performance improvements including FlexAttention on Apple Silicon with up to 12x speedups, a CuTeDSL backend for Inductor, and fused nn.LinearCrossEntropyLoss reduc…
Over 100 participants across 20+ teams competed in the ExecuTorch Hackathon in San Francisco on June 27-28, 2026, building on-device AI applications for Snapdragon-powered Samsung Galaxy S25 Ultra dev…
Software Mansion's react-native-executorch library, built on Meta's ExecuTorch runtime, enables running AI models on-device in React Native without API calls or network connectivity. A developer demon…
The PyTorch Docathon 2026, held from May 5 to May 19, resulted in over 150 merged pull requests after more than 260 registrants and 30 active participants contributed fixes, API documentation, and Exe…
The ExecuTorch MLX delegate now enables GPU-accelerated inference for PyTorch models on Apple Silicon Macs through Apple's MLX framework. The new backend achieves 3-6x higher throughput on generative …
Arm has released a set of hands-on Jupyter labs demonstrating how to deploy AI models on edge devices using ExecuTorch, an extension of the PyTorch ecosystem designed for local inference on constraine…