Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper evaluates a classification pipeline that integrates Equiangular Tight Frame (ETF) preprocessing with a tabular foundation model for in-context inference across seven modalities, including vision and text. The approach is systematically tested on 95 datasets, revealing that while it does not outperform specialized models, it achieves competitive performance with significantly faster processing times—ranging from 4 to 200 times quicker than traditional fine-tuning methods. Additionally, the method ensures well-calibrated probabilities for predictions, providing a reliable confidence signal for practitioners in deployment scenarios.
Achieving competitive performance across seven modalities while running 4 to 200 times faster than traditional fine-tuning methods could revolutionize model deployment efficiency.
We present a single classification pipeline that combines an Equiangular Tight Frame (ETF) preprocessing stage with a tabular foundation model for in-context inference, applied identically across modalities once data is mapped to fixed vector representations. We evaluate it on 95 datasets spanning seven signal modalities -- vision, audio, speech, text, molecular, time-series, and tabular. The main methodological contribution is to fix the comparison object: throughout the paper, performance is judged against the strongest lightweight tuned baseline on the same frozen features, while oracle selection, deployed selection, and specialized fine-tuning are reported separately. The pipeline is broadly competitive with strong lightweight tuned baselines on the same frozen features. It does not match the very best specialized models or heavily tuned pipelines on every task, but it stays close, and it runs much faster -- typically 4 to 200 times faster than full backbone fine-tuning, often at comparable quality. We describe how to deploy the pipeline in practice: when to apply ETF preprocessing, how to stop its training without a validation split, how to set up the in-context classifier, and how to calibrate the resulting probabilities. The calibration step is non-cosmetic: TabICL produces well-calibrated probabilities by construction, ETF preprocessing initially disrupts that calibration, and the post-hoc rescaling restores it -- yielding a per-prediction confidence signal that practitioners can use as a trust threshold for confidence-gated deployment. We also report where the pipeline should not be expected to help, and how to identify those cases in advance.