{"slug": "hiflow-hierarchical-feedback-driven-optimization-for-constrained-long-form-text", "title": "HiFlow: Hierarchical Feedback-Driven Optimization for Constrained Long-Form Text Generation", "summary": "Researchers behind arXiv paper 2603.04996v2 introduced LoopWeaver, a hierarchical workflow that uses two sequential offline preference-optimization stages to improve constrained long-form text generation in large language models. LoopWeaver combines constraint-aware planning, feasibility filtering and a shared deterministic reward to build preference pairs for plan-level and generation-level DPO, while inference stays feed-forward. Across four LongGenBench-style structured scenarios and multiple open-source backbones, the method improved both constraint accuracy and text quality, with software and data released at github.com/cgtaa-cmyk/LoopWeaver.", "body_md": "arXiv:2603.04996v2 Announce Type: replace \nAbstract: Large Language Models face a multi-objective optimization problem in constrained long-text generation, balancing global structure, local coherence, and constraint satisfaction. We propose LoopWeaver, a hierarchical workflow with two sequential offline preference-optimization stages. Constraint-aware planning produces structured plans, feasibility filtering removes invalid plans, and a shared deterministic reward constructs preference pairs for plan-level and generation-level DPO. At inference time, LoopWeaver remains feed-forward: it generates and revises a complete plan, filters the revised plan, and then generates segments conditioned on the current sub-plan and running narrative. We evaluate the method on four LongGenBench-style structured scenarios across multiple backbones. Results show improvements in both constraint accuracy and text quality across all four open-source backbones. Our software and data are publicly available at https://github.com/cgtaa-cmyk/LoopWeaver.", "url": "https://wpnews.pro/news/hiflow-hierarchical-feedback-driven-optimization-for-constrained-long-form-text", "canonical_source": "https://www.machinebrief.com/news/hiflow-hierarchical-feedback-driven-optimization-for-constra-qx50", "published_at": "2026-11-09 05:00:00+00:00", "updated_at": "2026-11-09 05:23:09.184070+00:00", "lang": "en", "topics": ["large-language-models", "natural-language-processing", "ai-research", "generative-ai"], "entities": ["LoopWeaver", "LongGenBench", "arXiv", "cgtaa-cmyk"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/hiflow-hierarchical-feedback-driven-optimization-for-constrained-long-form-text", "markdown": "https://wpnews.pro/news/hiflow-hierarchical-feedback-driven-optimization-for-constrained-long-form-text.md", "text": "https://wpnews.pro/news/hiflow-hierarchical-feedback-driven-optimization-for-constrained-long-form-text.txt", "jsonld": "https://wpnews.pro/news/hiflow-hierarchical-feedback-driven-optimization-for-constrained-long-form-text.jsonld"}}