04:00
2026-07-22
arxiv.org
large-language-models
A Better Start for Language Models: Domain-Conditional Position Offsets
A new method called domain-conditional position offsets reduces the cold-start penalty in autoregressive language models by adding a single learned vector to the embedding activation at the first sequ…