The Leaderboard Model You Cannot Actually Deploy
A developer's independent test found that foundation models top TabArena's tabular leaderboard, beating tuned XGBoost 92.6% of the time, but the advantage vanishes when tree-based models receive all t…