Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
TabFM is a 400M-parameter foundation model that casts tabular classification and regression as in-context learning, trained entirely on synthetic tables generated from structural causal models. By eliminating the need for per-dataset tree fitting or costly AutoML searches, it provides calibrated zero-shot predictions in a single forward pass. Evaluated across 51 TabArena datasets, zero-shot TabFM outperforms tuned AutoML baselines and ranks first among tabular foundation models, with performance scaling further through LLM-guided feature engineering and multi-view ensembling.
Zero-shot in-context inference trained strictly on synthetic causal graphs can outperform fully tuned AutoML pipelines across diverse real-world tabular benchmarks.
Tabular machine learning typically relies on per-dataset workflows, fitting tree ensembles or running AutoML searches from scratch for every task. We present TabFM, a 400M-parameter tabular foundation model that formulates supervised tabular prediction as in-context learning. TabFM produces calibrated zero-shot predictions in a single forward pass without task-specific tuning. Trained entirely on synthetic tables generated from structural causal models, TabFM learns general tabular representations that transfer zero-shot to real-world tasks. Across all 51 benchmark datasets in TabArena (38 classification and 13 regression), zero-shot TabFM ranks first among default tabular foundation models and outperforms tuned AutoML pipelines. Two extensions over the same frozen weights improve performance further on both tracks: multi-view feature expansion with ensembling and post-hoc calibration (TabFM+), and LLM-guided, dataset-specific data processing and feature engineering (TabFM-Auto).