22:33
2026-09-12
promptcube3.com
machine-learning
LoRA rank 4 is the sweet spot for diffusion fine-tuning
A controlled test using a DDPM U-Net on CIFAR-10 found that LoRA rank 4 achieved the best FID score of 124.1380, slightly beating rank 8 at 124.2136, according to data from arXiv:2609.10656v1. The stuβ¦