Latent Lattice Language Models A 406M-parameter Lattice of Latents model from MIT and Adobe lowered validation perplexity to 14.40 versus 15.41 for a parameter-matched Transformer when both were trained on 20B FineWeb-Edu tokens, the researchers report. The Lattice adds per-layer horizontal latent streams that persist across tokens and condition the vertical residual stream's attention, KV-cache writes, MLP computation and decoding; combined with hyper-connections and input residuals it reached 13.61 perplexity, against 14.22 for a Transformer with the same enhancements. The approach also improved perplexity on Gated DeltaNet, Mamba-2, Triadic GDN and GDN–Mamba-2 hybrids at every tested native state size, with Lattice-GDN and Lattice-Triadic-GDN variants beating pure baselines that had 4× larger native states.