Experiments on a Google Colab T4 with a 16 GB GPU show that SDXL's low-VRAM performance depends more on the granularity of runtime offloading than on the nominal memory budget, with finer-grained poli…
Philip Kiely's new book, 'Inference Engineering,' is now available as a digital download, offering a comprehensive guide to the technologies and techniques powering AI inference across runtime, infras…
Nunchaku integrates 4-bit diffusion inference into the Diffusers library, enabling large models like Flux.1 to run on consumer GPUs with significantly reduced VRAM requirements while maintaining image…
Hugging Face has integrated Nunchaku 4-bit diffusion inference natively into Diffusers, enabling users to load quantized checkpoints with a simple from_pretrained() call and no local CUDA compilation.…
NVIDIA NeMo Automodel now integrates with Hugging Face Diffusers, enabling scalable fine-tuning of video and image models like FLUX.1-dev and HunyuanVideo without checkpoint conversion or model rewrit…
NVIDIA and Hugging Face have integrated the NVIDIA NeMo Automodel open-source library with the Hugging Face Diffusers library, enabling production-grade distributed fine-tuning of video and image diff…
AMD Quark, a quantization library optimized for AMD Instinct MI350 GPUs, enables MXFP4 quantization for Diffusers and xDiT FLUX.1-dev image generation, achieving up to 1.92× speedup over BF16 eager an…