NVIDIA Releases Kumo Tabular: Open Tabular Foundation Models That Predict New Rows in a Single Forward Pass

NVIDIA released Kumo Tabular, a family of tabular foundation models in Small, Medium, and Large sizes spanning roughly 28M to 215M parameters that predict new rows in a single forward pass with no training, hyperparameter tuning, or feature engineering. The weights ship under the OpenMDW-1.1 license permitting commercial use, the structured-data-models (SDM) library code is Apache-2.0 and requires Python 3.11+ and PyTorch 2.7+, and NVIDIA reports Kumo Tabular ranks first overall on TabArena with an Elo of 1950 and runs 17x faster than LimiX-2 on a single RTX 6000 Pro.

NVIDIA https://www.nvidia.com/ has released Kumo Tabular https://huggingface.co/nvidia/Kumo-Tabular , a new family of tabular foundation models TFMs for classification and regression. If you have followed TabPFN https://github.com/PriorLabs/TabPFN or TabICL https://github.com/soda-inria/tabicl , the setup will look familiar. The model takes labeled rows as context and predicts new rows in one forward pass. There is no training, no hyperparameter tuning, and no feature engineering. Kumo Tabular comes in Small, Medium, and Large versions, spanning about 28M to 215M parameters. It runs through NVIDIA’s open-source structured-data-models https://github.com/NVIDIA/structured-data-models SDM library. Is it deployable? Yes. Weights ship under the OpenMDW-1.1 https://openmdw.ai/license/1-1/ license, which permits commercial use. The SDM code is Apache-2.0, and it needs Python 3.11+ and PyTorch 2.7+ https://nvidia.github.io/structured-data-models/install.html , with examples targeting a CUDA GPU. What the SDM Library Adds SDM is a GPU-native library for structured-data foundation models and preprocessing. Besides Kumo Tabular, it ships https://nvidia.github.io/structured-data-models/api/models.html TabICLv2, Google’s TabFM https://research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/ , and KumoRelational for multi-table data. All models share one in-context learning interface built on a TableTensor container. The library also handles preprocessing, ensembling, and many-class prediction. How Kumo Tabular Works Kumo Tabular is a Transformer built around the structure of a table. It uses column, row, and in-context attention, as introduced in TabICL and TabPFN. The pipeline has 3 stages: - Cell embedding: Numerical and categorical values pass through learned Fourier features, with separate weights per type. Missing values need no imputation. - Row embedding: Column attention uses induced self-attention, so cost grows linearly with rows. Row attention, with rotary positions, learns feature interactions. 4 learnable CLS tokens compress each row. - In-context learning: A final Transformer runs over row embeddings. Context rows attend to each other, while query rows attend only to context rows. Because the context never sees the queries, its keys and values are computed once and reused. The head outputs class probabilities, or 999 quantiles for regression. That gives a point prediction plus an uncertainty estimate. One more detail matters at scale. Softmax attention spreads thin as the number of keys grows. Kumo Tabular scales each query by a temperature that grows with the log of the key count. The coefficient is learned per attention head, so attention stays sharp on larger tables. Trained Only on Artificial Tables Kumo Tabular is pretrained entirely on synthetic tables sampled from Structural Causal Models SCMs . A random causal graph links hidden variables through linear maps, small neural networks, trees, or Gaussian processes. The generator also injects messy, real-world patterns: missing values, high-cardinality categories, heavy-tailed targets, and conflicting duplicate rows. Training ran in 3 stages, similar to TabICLv2. Context grew from 1,024 rows to 60,000 rows, with up to 100 columns. Small, Medium, and Large saw about 35M, 71M, and 137M artificial tables. Classification and regression are trained as separate models. NVIDIA says the training recipe and data generators will be released soon. Benchmarks With default settings, Kumo Tabular ranks first overall on TabArena https://github.com/autogluon/tabarena with an Elo of 1950. NVIDIA team reports it runs 17x faster than LimiX-2 https://github.com/limix-ldm-ai/LimiX on a single RTX 6000 Pro. All 3 sizes sit on the accuracy and inference-time Pareto front. - BeyondArena: First place, with an Elo of 1418 and an Improvability score of 7.78%. - TALENT https://github.com/LAMDA-Tabular/TALENT : Top overall ranking, with average ranks of 6.67 accuracy , 3.98 log-loss , and 4.22 RMSE . - ScoringBench https://github.com/jonaslandsgesell/ScoringBench : Large and Medium rank first and second on average rank. Kumo Tabular vs Its Closest Competitors | Feature | Kumo Tabular | TabICLv2 https://github.com/soda-inria/tabicl | TabPFN-3 https://docs.priorlabs.ai/models | LimiX-2 https://huggingface.co/stable-ai/LimiX-2 | TabFM https://nvidia.github.io/structured-data-models/api/generated/sdm.models.TabFM | |---|---|---|---|---|---| | Developer | NVIDIA | Inria SODA | Prior Labs | Stable AI | Google Research | | Parameters | ~28M to 215M 3 sizes | 27.55M cls , 28.54M reg | Not listed in docs | 400M | ~1.64B | | Tasks | Classification, regression | Classification, regression | Classification, regression | Classification, regression, imputation | Classification, regression | | Native classes per pass | 10 ECOC for more | 10 hierarchical for more | 160 | Not specified | 10 hard limit | | Weights license | OpenMDW-1.1 | BSD-3-Clause | TABPFN-3 License v1.0 | StableAI LimiX Non-Commercial | TabFM Non-Commercial v1.0 | | Commercial use of weights | Yes | Yes | Paid license required | No | No | | Runs in NVIDIA SDM | Yes | Yes | No | No | Yes | Sources: NVIDIA blog https://huggingface.co/blog/nvidia/kumo-tabular , SDM model docs https://nvidia.github.io/structured-data-models/api/models.html , Prior Labs docs https://docs.priorlabs.ai/models , LimiX GitHub https://github.com/limix-ldm-ai/LimiX , TabICLv2 paper https://arxiv.org/abs/2602.11139 . Checked September 30, 2026. The license row is the real differentiator. TabPFN-3, LimiX-2, and TabFM weights carry non-commercial terms. Kumo Tabular and TabICLv2 are the permissive options, and Kumo Tabular leads the benchmarks NVIDIA reports. Getting Started Install the library and pass a DataFrame through TableTensor , following the model card https://huggingface.co/nvidia/Kumo-Tabular : python pip install structured-data-models from sklearn.datasets import load breast cancer import sdm df = load breast cancer as frame=True .frame table = sdm.TableTensor.from pandas df=df, stypes=sdm.infer stypes df, overrides={"target": "categorical"} , device="cuda", model = sdm.models.KumoTabular task="classification", device="cuda" probs = model x context=table :300 .drop columns "target" , y context=table :300, "target" , x query=table 300: .drop columns "target" , num estimators=8, The size argument accepts "small" , "medium" , or "large" , and defaults to large https://nvidia.github.io/structured-data-models/api/generated/sdm.models.KumoTabular.html . Key Takeaways - NVIDIA’s Kumo Tabular predicts new table rows in 1 forward pass, with no training. - 3 sizes span about 28M to 215M parameters, pretrained only on synthetic tables. - NVIDIA reports first place on TabArena Elo 1950 , BeyondArena, TALENT, and ScoringBench. - OpenMDW-1.1 weights allow commercial use, unlike TabPFN-3, LimiX-2, and TabFM. - It runs through NVIDIA’s GPU-native SDM library alongside TabICLv2, TabFM, and KumoRelational. Check out the Model on HF https://huggingface.co/nvidia/Kumo-Tabular , GitHub Repo https://github.com/NVIDIA/structured-data-models and Technical details https://huggingface.co/blog/nvidia/kumo-tabular . All credit goes to the researcher of this project. Also, feel free to follow us on Twitter https://x.com/intent/follow?screen name=marktechpost and don’t forget to join our 150k+ML SubReddit https://www.reddit.com/r/machinelearningnews/ and Subscribe to our Newsletter https://magic.beehiiv.com/v1/f5e63dd4-5653-4f09-83e2-321a8b1ba526?email={{email}} . Wait are you on telegram? now you can join us on telegram as well. https://t.me/machinelearningresearchnews Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us https://forms.gle/MJjjVDPS7whH8Ngs6 Asif Razzaq is the CEO of Marktechpost AI Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.