ARC-Easy

A study at 120B scale finds that inserting constitutional content during midtraining produces durable alignment gains, with constitutionally midtrained models outperforming a control on alignment gene…

Researchers introduce the Prism Transformer, a new architecture that progressively increases head counts across layers to create a hierarchical attention processing structure. This design improves per…