Why Ilya Sutskever Says Pre-Training Is Over and Research Is Back
Ilya Sutskever, co-founder of Safe Superintelligence, argued at NeurIPS in December 2024 that the scaling era of AI pre-training is ending because high-quality human-generated data is finite, not beca…