arXiv:2609.35924v1 Announce Type: new Abstract: Discrete diffusion models generate sequences by iteratively resolving multiple tokens in parallel, offering a flexible alternative to left-to-right generation. However, guiding this process with a sequence-level objective is difficult because the value of one unresolved token depends on the other tokens with which it can form a high-reward sequence. Enumerating all such completions makes the whole guidance computation grow exponentially with the number of unresolved positions. We introduce COFFEE, a plug-and-play framework that avoids this enumeration by separating sequence dependence from the objective. At each diffusion step, a target-free carrier absorbs the marginal token distributions predicted by the denoiser to construct a joint model over the unresolved tokens, while a compiled finite-state model records how their combinations affect the sequence-level preference. Pairing their states allows COFFEE to transfer global preferences to unresolved positions and sample a clean reconstruction without retraining the diffusion model. The same framework supports explicit hard constraints and learned soft objectives. We evaluate COFFEE across multiple symbolic, language, and biological benchmarks, where it achieves strong control results with task-dependent quality and diversity trade-offs. By making objectives available to inference rather than only evaluation, COFFEE brings joint conditioning, completion-weighted guidance, and optimization-based constraints into pretrained neural generation, showing the potential of neural-symbolic methods in diffusion guidance.
Grab a Coffee: Future-Aware Guidance for Discrete Diffusion with Compiled Objectives
Researchers introduced COFFEE, a plug-and-play framework that guides discrete diffusion models with sequence-level objectives without retraining the diffusion model, according to the arXiv paper 2609.35924v1. COFFEE separates sequence dependence from the objective, using a target-free carrier to absorb the denoiser's marginal token distributions and a compiled finite-state model to record how token combinations affect sequence-level preference, avoiding the exponential enumeration of completions. The framework supports explicit hard constraints and learned soft objectives and was evaluated across symbolic, language, and biological benchmarks, achieving strong control results with task-dependent quality and diversity trade-offs.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.