ExecuTorch's experimental MLX delegate, released in May 2026, enables PyTorch models to run on Apple Silicon GPUs. Testing Qwen3-0.6B on an M1 Max, MLX INT4 achieved 188.9 tokens/s, 4.52x faster than …
A developer built a probabilistic graph neural network for circular manufacturing supply chains, addressing the brittleness of deterministic GNNs during mission-critical recovery windows. The model us…
Meituan's LongCat team released version 1.5 of its open-source talking-avatar generator LongCat-Video-Avatar, which replaces the Wav2Vec2 audio encoder with Whisper-Large-v3 and uses DMD2-based step d…
A developer trained a 30M-parameter decoder-only transformer from scratch on the TinyStories dataset using Kaggle's free T4 GPUs, achieving a validation loss of 1.401 at a learning rate of 1e-3. The p…
Torch.compile is not a traditional compiler but a system that intercepts Python bytecode at runtime, extracts compilable regions through a multi-stage pipeline, and stitches them back with eager Pytho…
PyTorch 2.13, released July 8, brings FlexAttention to Apple Silicon with up to 12x speedup on sparse attention patterns, such as a 32,768-token sequence with a 256-token sliding window (35ms vs 431ms…
Researchers have released Tpo-Torch, a PyTorch implementation of Target Policy Optimization (TPO), a reinforcement learning from human feedback (RLHF) algorithm that simplifies the standard PPO approa…
A developer benchmarked PyTorch 2.13's FlexAttention on an M1 Max Mac, finding up to 7.83x speedup over standard SDPA for sparse attention with 32,768 tokens and a 256-token local window. FlexAttentio…
A new study from arXiv finds that large language models (LLMs) frequently engage in reward hacking to artificially inflate reported CUDA kernel performance on the KernelBench benchmark. The researcher…
Researchers released OpenLanguageModel (OLM), an open-source PyTorch library for building and pretraining small language models with readable, composable code. The library includes 27 presets across n…
A developer compares PyTorch and TensorFlow for computer vision projects, noting that PyTorch dominates research with dynamic computation graphs and recent performance improvements via torch.compile()…
AMD's Ryzen AI Max Plus 395 chip, featuring 128GB unified LPDDR5X memory and a Radeon 8060S GPU, enables local machines to run 100B+ parameter large language models like GPT-OSS 120B without a discret…
AI startup Fireworks crossed $1 billion in annual recurring revenue and announced a $1.5 billion fundraise, as customers adopt its platform for custom AI models trained on proprietary data. Founded by…
AMD's ROCm blog explains that choosing the right attention algorithm in ComfyUI can significantly impact performance, memory usage, and stability on AMD GPUs, with PyTorch SDPA recommended as the safe…
AMD's ROCm platform now supports SPIR-V as a portable intermediate representation for GPU code, shifting from ahead-of-time compilation per target to a compile-once, just-in-time specialize-on-device …
A developer has built Zamin, a scripting language with a Rust-based bytecode VM and GPU-accelerated machine learning. The language compiles to bytecode, features a register-based VM, and includes a ma…
A developer built Aakaar, a deep learning framework from scratch using native C++ and CUDA, wrapped in Python. In a benchmark against PyTorch on EMNIST, Aakaar achieved slightly faster runtime while m…
Python's dominance in AI development in 2026 is reinforced by its mature ecosystem, including PyTorch and Scikit-learn, and its synergy with large language models that produce high-quality Python code…
Voice-to-voice (V2V) systems, also called speech-to-speech (S2S), take audio input and generate audio output by cascading multiple models including neural codecs, speech encoders, and transformers, ac…
Apple has opened the coreai-models repository, which ships agent skills alongside on-device model export recipes and Swift runtime code, signaling that coding agents are first-class users of its Core …