Are Tabular Foundation Models Ready to Replace Gradient Boosting Models?
Tabular foundation models (TFMs) such as TabPFN from PriorLabs and TabFM from Google are now outperforming gradient-boosted trees like XGBoost, CatBoost, and LightGBM on the TabArena benchmark, challe…