cd /news/machine-learning/pytorch-2-13-flexattention-on-apple-… · home topics machine-learning article
[ARTICLE · art-56675] src=byteiota.com ↗ pub= topic=machine-learning verified=true sentiment=↑ positive

PyTorch 2.13: FlexAttention on Apple Silicon, 4x Memory Savings, Upgrade Guide

PyTorch 2.13, released July 8, introduces FlexAttention with native Metal support on Apple Silicon, delivering up to 12x speedup over SDPA on sparse patterns, and a new fused loss function that reduces peak GPU memory by 4x for large-vocabulary LLM training. The release also includes API renames and a hard removal of one feature set, prompting users to review changes before upgrading.

read1 min views1 publishedJul 13, 2026

PyTorch 2.13 shipped July 8 with changes worth acting on before your next training run. FlexAttention now has native Metal support on Apple Silicon — up to 12x faster than SDPA on sparse patterns. A new fused loss function cuts peak GPU memory 4x for large-vocabulary LLM training. And two APIs got renamed, with one feature set hard-removed. Here is what to check before upgrading. FlexAttention on Apple Silicon: Finally a Reason to Train on MPS If you have been running inference on an M-series Mac but sending training jobs to a cloud GPU, PyTorch 2.13 gives you a reason […]

The post

── more in #machine-learning 4 stories · sorted by recency
── more on @pytorch 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/pytorch-2-13-flexatt…] indexed:0 read:1min 2026-07-13 ·