# How to automatically find the batch size when using Accelerate with FSDP2? [D] > Source: > Published: 2026-09-14 21:00:44+00:00 Hi, For single-GPU training, I’m using Hugging Face SFTTrainer with auto_find_batch_size=True, which automatically reduces the batch size after a CUDA OOM until it finds a batch size that works. I would like to have similar behavior when training on multiple GPUs on a single node using accelerate la