00:00
2026-09-30
blog.janestreet.com
machine-learning
Trading off compute for memory with activation checkpointing
Jane Street ML Infra intern Arsh Koneru built an activation checkpointing scheme that, given a model spec and a memory budget, selects a set of nodes to drop from the save set to minimize extra comput…