23:42
2026-07-17
lesswrong.com
ai-research
Should we benchmark conceptual capabilities using judgment prediction tasks?
A researcher argues that judgment prediction tasks are poorly suited for benchmarking AI conceptual capabilities due to subjective noise and the difficulty of separating taste from capability. The pro…