BOS Summary: The First Token Matters A new arXiv paper (2611.23508v1) introduces BOS Summary, a training-free inference-time method that lets the beginning-of-sequence (BOS) token aggregate all visual and textual input tokens at a single transformer layer during prefill, so later tokens access an input-specific representation instead of an empty one. Across multiple vision-language and language model families and eight multimodal and text-only benchmarks, BOS Summary improves over direct and Chain-of-Thought prompting and outperforms recent attention-sink intervention methods on multi-step reasoning tasks, with no additional parameters, auxiliary modules, or decoding-time overhead. Mechanistic analysis shows the change weakens BOS sink dominance and redistributes attention toward content-bearing prompt tokens. arXiv:2611.23508v1 Announce Type: new Abstract: Large vision-language models LVLMs and language models LLMs often exhibit attention sinks, whereby particular positions, such as the beginning-of-sequence BOS token, receive a disproportionate share of attention. Under standard causal masking, however, the BOS query attends only to itself, so the representation that later tokens repeatedly access carries no information about the input. We introduce BOS Summary, a training-free inference-time method that repurposes this persistent pathway to carry input context. At a single transformer layer during prefill, BOS Summary relaxes the causal constraint for the BOS query row alone, letting BOS aggregate all visual and textual input tokens into a self-derived context representation while every other token retains standard causal attention. The enriched representation then remains accessible to the model throughout decoding, with no additional parameters, auxiliary modules, or decoding-time overhead. Across multiple VLM and LLM families and eight multimodal and text-only benchmarks, BOS Summary improves over direct and Chain-of-Thought prompting and outperforms recent sink-intervention methods on multi-step reasoning tasks. A mechanistic analysis shows that making BOS input-specific also weakens its sink dominance and redistributes attention toward content-bearing prompt tokens, indicating that changing what a sink carries reshapes how later layers allocate attention.