arXiv:2610.12530v1 Announce Type: new Abstract: Training-free feature reuse accelerates diffusion transformer inference by replacing full denoising computation at selected steps with cached approximations. Existing methods mainly improve the reconstruction of skipped features, but we find that once a stable first-order reconstructor is used, increasing reconstruction complexity brings limited gains, whereas the placement of exact-computation steps has a much larger effect on fidelity. More importantly, absolute shallow-probe variation is jointly affected by input-trajectory displacement and network response strength, and therefore does not directly reflect cache risk. We address this confounding by normalizing probe-output variation with the corresponding input displacement, yielding a directional gain per unit trajectory movement. Based on this signal, we propose CacheScope, which identifies high-risk reuse steps online and selectively falls back to full denoising computation while leaving the underlying cache reconstructor unchanged. CacheScope requires no additional training, gradients, auxiliary networks, or prompt-specific offline schedule optimization. Across FLUX.1-dev, Wan2.1-T2V-1.3B, and Open-Sora 1.2, CacheScope achieves up to 3.57x acceleration and reduces median LPIPS by up to 70.1% over the strongest probe-based baseline.
CacheScope: Exact-Compute Allocation for Training-Free Diffusion Acceleration
CacheScope, a training-free method for accelerating diffusion transformer inference, achieves up to 3.57x acceleration and reduces median LPIPS by up to 70.1% over the strongest probe-based baseline, according to an arXiv paper (arXiv:2610.12530v1). CacheScope identifies high-risk feature-reuse steps online by normalizing probe-output variation with input displacement, then selectively falls back to full denoising computation without changing the underlying cache reconstructor. The method requires no additional training, gradients, auxiliary networks, or prompt-specific offline schedule optimization, and was evaluated on FLUX.1-dev, Wan2.1-T2V-1.3B, and Open-Sora 1.2.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.