Same effective batch, different LoRA training time: a small TRL diagnostic
A diagnostic experiment by TraceML maintainer found that Qwen3-1.7B LoRA training with TRL on a single T4 ran 17% faster with per-device batch size 4 and no gradient accumulation (238.2s) than with pe…