{"slug": "next-concept-modeling-9-31x-faster-than-diffusion-baselines", "title": "Next-Concept Modeling: 9–31× faster than diffusion baselines", "summary": "HazyResearch released Next-Concept Modeling (NCM), a two-stage parallel text generation framework that beats or matches strong diffusion baselines on different tasks and datasets while generating 9–31× faster. NCM pairs a multiscale residual VQ tokenizer, which represents a sequence as a hierarchy of discrete codes, with a transformer that predicts that hierarchy coarse to fine, generating positions within a level in parallel for one forward evaluation per level. Weights and tokenized datasets for XSum, WMT14 De–En, Sudoku (easy, medium, hard), LM1B (small, medium, large) and TinyStories are hosted in the NCM Hugging Face collection, with each released model consisting of a frozen tokenizer and a next-concept generator.", "body_md": "**Fast, Parallel Coarse-to-Fine Text Generation**\n\nNext-Concept Modeling (NCM) is a two-stage framework for parallel text generation. A multiscale residual VQ tokenizer represents a sequence as a hierarchy of discrete codes, and a transformer predicts that hierarchy from coarse to fine. Positions within a level are generated in parallel, so generation requires one forward evaluation per level.\n\nNCM generates coarse to fine: each level predicts a longer sequence in parallel, and decoding every level shows a sample being refined from a rough sketch to the full output in a few steps.\n\nNCM beats or matches strong diffusion baselines on different tasks & datasets while generating 9-31× faster.\n\nWeights and tokenized datasets are hosted in the [NCM Hugging Face collection](https://huggingface.co/collections/hazyresearch/ncm). Each released model consists of a frozen tokenizer and a next-concept generator.\n\n| Task | Model | Tokenizer | Generator | Config | Data | \n|---|---|---|---|---|---|\n| **XSum** | – | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/xsum/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/xsum/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/xsum/config.yaml) | [test set](https://huggingface.co/datasets/hazyresearch/ncm-datasets/tree/main/xsum) | \n| **WMT14 De–En** | – | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/wmt14/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/wmt14/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/wmt14/config.yaml) | [test set](https://huggingface.co/datasets/hazyresearch/ncm-datasets/tree/main/wmt14) | \n| **Sudoku** | easy | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/easy/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/easy/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/easy/config.yaml) | [test boards](https://huggingface.co/datasets/hazyresearch/ncm-datasets/tree/main/sudoku) | \n|  | medium | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/medium/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/medium/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/medium/config.yaml) |  | \n|  | hard | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/hard/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/hard/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/sudoku/hard/config.yaml) |  | \n| **LM1B** | small | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/small/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/small/config.yaml) | [tokenized text](https://huggingface.co/datasets/hazyresearch/ncm-datasets/tree/main/lm1b) | \n|  | medium |  | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/medium/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/medium/config.yaml) |  | \n|  | large |  | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/large/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/lm1b/large/config.yaml) |  | \n| **TinyStories** | – | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/tinystories/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/tinystories/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/tinystories/config.yaml) | [tokenized text](https://huggingface.co/datasets/hazyresearch/ncm-datasets/tree/main/tinystories) | \n| **OpenWebText** | – | [tokenizer.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/owt/tokenizer.pt) | [generator.pt](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/owt/generator.pt) | [config.yaml](https://huggingface.co/hazyresearch/ncm-checkpoints/blob/main/owt/config.yaml) | [tokenized text](https://huggingface.co/datasets/hazyresearch/ncm-datasets/tree/main/owt) | \n\n```\ngit clone https://github.com/HazyResearch/ncm.git\ncd ncm\npip install -r requirements.txt\n```\n\nPython 3.10 or newer and a CUDA-capable PyTorch installation are recommended.\n\nDownload the checkpoints and evaluation inputs:\n\n```\nhf download hazyresearch/ncm-checkpoints --local-dir artifacts\nhf download hazyresearch/ncm-datasets --repo-type dataset --local-dir data\n```\n\nThen run:\n\n```\npython evaluate.py --config config/eval/<task>.yaml --checkpoint-dir artifacts/<task> --data-dir data/<task>\n# <task> is one of xsum, wmt14, sudoku-easy, sudoku-medium or sudoku-hard\n\npython evaluate.py --config config/eval/<dataset>.yaml --checkpoint-dir artifacts/<dataset>\n# <dataset> is tinystories, owt or lm1b-<size> with <size> one of small, medium or large\n```\n\nThis runs one generation shard per visible GPU, merges them, and prints ROUGE-1/2/L and generative perplexity for XSum; cased and lowercased sacreBLEU, chrF and length ratio for WMT14; solved, cell and valid-grid rates for Sudoku; and generative perplexity under GPT-2 large with unigram entropy, over 5 seeds of 256 unconditional samples, for TinyStories, OpenWebText and LM1B, the latter under the FLM scoring protocol. Add `--cfg <scale>` for classifier-free guidance on XSum and WMT14; the guided WMT14 row uses `--cfg 1.0`.\n\n- `evaluate.py` : evaluation entry point\n- `scripts/` : per-GPU generation shard and the merge that scores it\n- `config/eval/` : one config per released checkpoint, identical to the`config.yaml` shipped with it\n- `models/` ,`tokenization/` : generator and tokenizer implementations\n\n```\n@misc{kumbong2026nextconcept,\n      title={Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation},\n      author={Hermann Kumbong and Ishan S. Khare and Iddah Mlauzi and Andrew Woen and Charles Ding and E. Kelly Buchanan and Simran Arora and Azalia Mirhoseini and Christopher Ré},\n      year={2026},\n      eprint={2610.14162},\n      archivePrefix={arXiv},\n      primaryClass={cs.CL},\n      url={https://arxiv.org/abs/2610.14162},\n}\n```\n\nReleased under the [MIT license](https://github.com/HazyResearch/ncm/blob/main/LICENSE).", "url": "https://wpnews.pro/news/next-concept-modeling-9-31x-faster-than-diffusion-baselines", "canonical_source": "https://github.com/HazyResearch/ncm", "published_at": "2026-10-18 20:38:43+00:00", "updated_at": "2026-10-18 20:48:35.629084+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "large-language-models", "ai-research", "natural-language-processing"], "entities": ["HazyResearch", "Next-Concept Modeling", "Hugging Face", "XSum", "WMT14 De–En", "LM1B", "TinyStories"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/next-concept-modeling-9-31x-faster-than-diffusion-baselines", "markdown": "https://wpnews.pro/news/next-concept-modeling-9-31x-faster-than-diffusion-baselines.md", "text": "https://wpnews.pro/news/next-concept-modeling-9-31x-faster-than-diffusion-baselines.txt", "jsonld": "https://wpnews.pro/news/next-concept-modeling-9-31x-faster-than-diffusion-baselines.jsonld"}}