{"slug": "pace-periodic-and-channel-aligned-encoding-of-four-bit-recurrent-states", "title": "PACE: Periodic and Channel-Aligned Encoding of Four-Bit Recurrent States", "summary": "Researchers present PACE, a method for encoding four-bit recurrent states in linear-attention language models, where an inference system stores one copy of the fixed-size state per concurrently decoded sequence. Storing that state at lower precision lets more sequences share an accelerator, and PACE's periodic and channel-aligned encoding targets the shortcomings of existing state quantization approaches. The work matters because it could raise decoding throughput for linear-attention models by fitting more sequences onto the same hardware.", "body_md": "Linear-attention language models keep their context in a recurrent state of fixed size, where an inference system stores one copy of this state for every sequence it decodes at the same time. Storing the state at lower precision therefore lets more sequences share an accelerator. Existing state quan", "url": "https://wpnews.pro/news/pace-periodic-and-channel-aligned-encoding-of-four-bit-recurrent-states", "canonical_source": "https://aiflash.com/news/137261/", "published_at": "2026-10-22 06:30:32+00:00", "updated_at": "2026-10-22 06:42:16.856407+00:00", "lang": "en", "topics": ["large-language-models", "machine-learning", "ai-research", "ai-infrastructure"], "entities": ["PACE"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/pace-periodic-and-channel-aligned-encoding-of-four-bit-recurrent-states", "markdown": "https://wpnews.pro/news/pace-periodic-and-channel-aligned-encoding-of-four-bit-recurrent-states.md", "text": "https://wpnews.pro/news/pace-periodic-and-channel-aligned-encoding-of-four-bit-recurrent-states.txt", "jsonld": "https://wpnews.pro/news/pace-periodic-and-channel-aligned-encoding-of-four-bit-recurrent-states.jsonld"}}