A Hugging Face community response advises ComfyUI users not to manually concatenate sharded .safetensors files such as part1of4.safetensors and part2of4.safetensors, and instead to start from the Comf…
A developer documented a working Linux setup for running Stable Diffusion XL through Hugging Face Diffusers on an Nvidia GTX 1070 Pascal GPU, pinning PyTorch to the CUDA 12.4 wheel index and transform…
A developer compared Docker Model Runner and Ollama for local LLM inference, concluding that raw generation speed cannot be declared a winner because both tools commonly run llama.cpp underneath. The …
A developer has released EverSpark Forge, an open-source, self-hostable modular AI creation and orchestration system that unifies AI models, workflows, execution backends, runtime environments, and st…
NVIDIA Dynamo-Triton release 26.07 now enables TensorRT multi-device inference, allowing a single TensorRT network to execute across multiple GPUs using NCCL-backed distributed collectives, with full …
ComfyUI, the node-graph interface for generative AI, has become the de facto runtime for open-weight models, with its parent company raising $30 million at a $500 million valuation in April and the re…
Lightricks released LTX-2.5, a video generation model that uses a 32×32×8 spatiotemporal compression ratio (1:192) and a diffusion-based decoder to avoid blur, achieving an artifact score of 0.28 vers…
Experiments on a Google Colab T4 with a 16 GB GPU show that SDXL's low-VRAM performance depends more on the granularity of runtime offloading than on the nominal memory budget, with finer-grained poli…
Philip Kiely's new book, 'Inference Engineering,' is now available as a digital download, offering a comprehensive guide to the technologies and techniques powering AI inference across runtime, infras…
Nunchaku integrates 4-bit diffusion inference into the Diffusers library, enabling large models like Flux.1 to run on consumer GPUs with significantly reduced VRAM requirements while maintaining image…
Hugging Face has integrated Nunchaku 4-bit diffusion inference natively into Diffusers, enabling users to load quantized checkpoints with a simple from_pretrained() call and no local CUDA compilation.…
NVIDIA NeMo Automodel now integrates with Hugging Face Diffusers, enabling scalable fine-tuning of video and image models like FLUX.1-dev and HunyuanVideo without checkpoint conversion or model rewrit…
NVIDIA and Hugging Face have integrated the NVIDIA NeMo Automodel open-source library with the Hugging Face Diffusers library, enabling production-grade distributed fine-tuning of video and image diff…
AMD Quark, a quantization library optimized for AMD Instinct MI350 GPUs, enables MXFP4 quantization for Diffusers and xDiT FLUX.1-dev image generation, achieving up to 1.92× speedup over BF16 eager an…