{"slug": "pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide", "title": "PyTorch 2.13: FlexAttention on Apple Silicon, 4x Memory Savings, Upgrade Guide", "summary": "PyTorch 2.13, released July 8, introduces FlexAttention with native Metal support on Apple Silicon, delivering up to 12x speedup over SDPA on sparse patterns, and a new fused loss function that reduces peak GPU memory by 4x for large-vocabulary LLM training. The release also includes API renames and a hard removal of one feature set, prompting users to review changes before upgrading.", "body_md": "PyTorch 2.13 shipped July 8 with changes worth acting on before your next training run. FlexAttention now has native Metal support on Apple Silicon — up to 12x faster than SDPA on sparse patterns. A new fused loss function cuts peak GPU memory 4x for large-vocabulary LLM training. And two APIs got renamed, with one feature set hard-removed. Here is what to check before upgrading. FlexAttention on Apple Silicon: Finally a Reason to Train on MPS If you have been running inference on an M-series Mac but sending training jobs to a cloud GPU, PyTorch 2.13 gives you a reason […]\n\nThe post", "url": "https://wpnews.pro/news/pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide", "canonical_source": "https://byteiota.com/pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide/", "published_at": "2026-07-13 00:12:49+00:00", "updated_at": "2026-07-13 00:15:36.696130+00:00", "lang": "en", "topics": ["machine-learning", "developer-tools", "ai-infrastructure"], "entities": ["PyTorch", "Apple", "Metal"], "alternates": {"html": "https://wpnews.pro/news/pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide", "markdown": "https://wpnews.pro/news/pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide.md", "text": "https://wpnews.pro/news/pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide.txt", "jsonld": "https://wpnews.pro/news/pytorch-2-13-flexattention-on-apple-silicon-4x-memory-savings-upgrade-guide.jsonld"}}