Kimi.ai released the model weights and a technical report for K3, a 2.8-trillion-parameter mixture-of-experts (MoE) model with native visual understanding and a 1 million-token context window, on July…
The EvalEval Coalition has launched a unified, open data format and public dataset for AI evaluation results, aiming to address fragmentation and enable trust and comparability across frameworks. The …
A researcher at EleutherAI has built a mathematical model to forecast loss of control to AI, finding that predictions are highly sensitive to poorly characterized parameters for 'leakage' (accidental …
Jack Dorsey's nonprofit Start Small has donated tens of millions of dollars to open-source AI projects and Bitcoin development, including $31 million to OpenSats and $5 million to Brink, signaling a l…
EleutherAI researcher Hailey Schoelkopf discussed the evolution of open-source AI, the distinction between open-source and open-weight models, and the importance of evaluation tools like the LM Evalua…
A 124M-parameter GPT-2 model trained from scratch on OpenWebText data using a custom deep learning library achieved a validation loss of 2.764 nats and a perplexity of 15.87 after 56,000 steps (27.5B …
A research project using k-sparse autoencoders found interpretable features in a small reasoning model, including features that appear to correspond to the model's reasoning process. The experiment an…
Google DeepMind's safety team conducts research on AI alignment, interpretability, and robustness, focusing on scalable oversight, reward modeling, and evaluation frameworks. The team operates within …
The Center for AI Safety (CAIS), a nonprofit organization focused on reducing societal-scale risks from artificial intelligence, conducts technical research on robustness, alignment, and systemic safe…
The Alignment Research Center (ARC) is a nonprofit research organization focused on aligning advanced AI systems with human values. ARC conducts theoretical and empirical research on eliciting latent …