DiffusionBlocks – Block-Wise NN Training via Diffusion Interpretation
Researchers have developed DiffusionBlocks, a framework that partitions transformer neural networks into independently trainable blocks to reduce memory requirements proportionally while maintaining competitive performan…