Researchers at Apple have developed PICO (Perceptual Image Codec), the first learned image compression model optimized for human visual perception and practical on-device deployment. The codec achieves 2.3-3× bitrate sav…
The ExecuTorch MLX delegate now enables GPU-accelerated inference for PyTorch models on Apple Silicon Macs through Apple's MLX framework. The new backend achieves 3-6x higher throughput on generative AI workloads compare…
Google's Gemma 4, DeepSeek V4, and other new open-weight large language models incorporate architecture changes like KV sharing, compressed convolutional attention, and layer-wise attention budgeting to reduce long-conte…
PyTorch 2.12 introduces a new device-agnostic `torch.accelerator.Graph` API that unifies graph capture and replay across CUDA, XPU, and out-of-tree backends. The release delivers up to 100x faster batched eigenvalue deco…
Arm has released a set of hands-on Jupyter labs demonstrating how to deploy AI models on edge devices using ExecuTorch, an extension of the PyTorch ecosystem designed for local inference on constrained hardware. The labs…
Meta researchers developed In-Kernel Broadcast Optimization (IKBO), a kernel-model-system co-design that eliminates redundant user-embedding replication during recommendation model inference. Deployed across Meta's multi…