When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling
A new study reveals that test-time scaling in language models, where models sample multiple answers to a question, hits a ceiling beyond which additional samples do not improve selection accuracy and can even degrade per…