Scaling machine learning models is more complex than simply increasing size, requiring careful engineering to avoid pitfalls, according to a technical essay by Beren Millidge. The author explains that…
Reinforcement learning (RL) for large language models (LLMs) achieves rapid performance gains despite being information-theoretically inefficient compared to pretraining, according to a speculative an…
Beren, an AI alignment researcher, proposes replacing fixed moral targets or unconditional obedience with a 'metaplastic constitutional' outer-alignment mechanism that preserves the institutions and s…
A note by Beren argues that decentralization in AI systems offers informational and exploration benefits beyond coordination failures, such as variance for evolutionary robustness, Hayekian local know…