What it is
TabPFN is a transformer foundation model for tabular data that outperforms all previous methods on datasets of up to 10,000 samples by a wide margin while using far less training time. In 2.8 seconds it beat an ensemble of the strongest baselines that had been tuned for 4 hours. The model is itself learned across millions of synthetic datasets and also supports fine-tuning, data generation, and density estimation.
Why it matters
Gradient-boosted trees have dominated tabular data, the format behind most scientific and business prediction, for two decades. A foundation model that surpasses them on small data changes the default tool for a huge class of problems.
Underlined numbers link to their source. Every metric and quoted figure is listed under Sources and data below.
Filed undertabular data, foundation model, machine learning, TabPFN, transformers