Search papers, labs, and topics across Lattice.
FlexTab introduces a novel encoder-decoder architecture designed for in-context learning on tabular data, featuring a task-agnostic encoder paired with multiple task-specific decoders. This architecture generates target-agnostic row embeddings, allowing for flexibility across various downstream tasks, including classification, regression, anomaly detection, clustering, entity matching, and entity classification. The results reveal that FlexTab achieves state-of-the-art performance in several tasks while maintaining competitiveness against specialized models in relational settings, showcasing its potential as a versatile backbone for tabular data tasks.
FlexTab's unique architecture enables a single encoder to effectively tackle diverse tabular tasks, achieving state-of-the-art results without task-specific entanglement.
We introduce FlexTab, a flexible encoder-decoder architecture for in-context learning on tabular data that pairs a single, task-agnostic encoder with a suite of task-specific decoders. Unlike existing tabular in-context learners, which entangle feature representations with a specific prediction target, our design produces \textit{target-agnostic} row embeddings that can be leveraged across a wide range of downstream tasks within a table-native in-context learning setup. We demonstrate this flexibility on six distinct problems: classification, regression, anomaly detection, clustering, entity matching, and entity classification in relational databases. Both the encoder and the task-specific decoders are trained on a large corpus of real-world, unlabeled tables. FlexTab achieves state-of-the-art performance on classification, regression, anomaly detection and entity matching, while remaining competitive with specialized models on entity classification in a relational setting. These results demonstrate that a single shared encoder, paired with task-specific decoders, can serve as an effective general-purpose backbone for diverse tabular prediction problems. The inference code and checkpoints will be made publicly available at https://github.com/SAP-samples/flextab.
