arXiv:2609.13239v1 Announce Type: new Abstract: Diffusion models represent one of the most advanced paradigms in generative modeling. Leveraging their development, a growing number of style transfer methods based on diffusion models have been proposed. However, among these methods, multi-image style transfer approaches that require at least five to ten style examples tend to achieve more satisfactory results. Single-image methods, by contrast, often struggle with either insufficient content preservation or inadequate style fidelity. This greatly limits style extraction from scarce artworks and undermines their artistic value. To address this, we propose Abstract-LoRA, a method that pushes the boundaries of single-image style transfer through lightweight LoRA training on specific U-Net blocks in diffusion models. Specifically, our work is inspired by B-LoRA, a style transfer method that achieves basic style-content disentanglement by training specific U-Net blocks. However, it suffers from a critical limitation: the inability to capture complex backgrounds. Building upon B-LoRA, our method conducts a more refined analysis of U-Net blocks, employing additional U-Net blocks and clustering-based abstraction of style images to better disentangle and balance style and content. Extensive experiments demonstrate that our proposed method not only generates visually more harmonious and satisfying artistic images but also quantitatively improves the preservation of both style and content in the final outputs.
Abstract-LoRA: Unlocking Single-Image Style Transfer through Targeted U-Net Block Training
Researchers introduced Abstract-LoRA, a single-image style transfer method that trains lightweight LoRA adapters on specific U-Net blocks in diffusion models, according to an arXiv paper (arXiv:2609.13239v1). Building on B-LoRA, which the authors say cannot capture complex backgrounds, Abstract-LoRA adds additional U-Net blocks and clustering-based abstraction of style images to better disentangle and balance style and content. The authors report that experiments show the method generates more visually harmonious artistic images and quantitatively improves preservation of both style and content, addressing single-image methods' struggles with content preservation and style fidelity compared with multi-image approaches that require five to ten style examples.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.