Search papers, labs, and topics across Lattice.
This paper introduces SkillTFM, a training-free adaptation system for tabular foundation models (TFMs) that shifts the focus from parameter updates to the evolution of agentic skills through a gated mechanism. By utilizing a verifiable skill bank that identifies task structures and model failure patterns, SkillTFM effectively retrieves and extends reusable skills without the need for additional labeled data or costly fine-tuning. The approach significantly enhances performance in boundary settings, achieving an AUC improvement of 0.128–0.142 and elevating nonlinear-boundary AUC from 0.699 to 0.898 across various TFM backbones.
SkillTFM achieves a remarkable AUC boost of up to 0.142 without any training, redefining how we adapt tabular models in the face of distribution shifts.
Tabular data are ubiquitous in real-world applications and are crucial for data-driven prediction and decision-making across science, industry, finance, healthcare, and public services. Tabular foundation models (TFMs) have emerged as a promising paradigm for general-purpose tabular learning, offering reusable predictors across diverse datasets and substantially reducing the need for task-specific training, tuning, and model development. However, their practical deployment remains constrained by distribution shifts, heterogeneous feature semantics, and task-specific patterns that are difficult to capture without costly fine-tuning or additional labeled data. To this end, we propose SkillTFM, a training-free system that shifts TFM adaptation from parameter updates to the gated evolution of agentic skills. The core of SkillTFM is a verifiable and extensible skill bank that couples boundary evidence identification with gated skill evolution: the former characterizes task structure and base-model failure patterns, whereas the latter retrieves and extends reusable skills subject to explicit validation. Across simulated boundary settings and real-world electricity-price forecasting, SkillTFM improves AUC by 0.128--0.142, raises nonlinear-boundary AUC from 0.699 to 0.898. Furthermore, experiments across TFM backbones demonstrate the effectiveness and generality of SkillTFM.
Tsinghua AI