Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TEmBed-T, a comprehensive benchmark for evaluating table-level embeddings across multiple tasks, addressing the gap in understanding how different embedding methods perform in diverse applications. The authors extend the existing TEmBed framework to include a broader range of tasks beyond table retrieval, allowing for a more nuanced analysis of embedding effectiveness. Their empirical study reveals that no single embedding model consistently outperforms others across all tasks, highlighting the complexity of table-level representation learning.
No single table-level embedding model excels across all tasks, challenging the notion that retrieval performance alone defines quality.
Tabular data is the dominant structured-data modality, and learning table representations has become a core research direction. Table-level embeddings in particular underpin a wide range of applications, including table retrieval, data lake discovery, and table classification. Despite their importance, there is still limited understanding of how different embedding approaches behave across tasks, making systematic evaluation and analysis essential. In this work, we introduce a systematic evaluation of table-level embeddings that captures several complementary properties required for downstream effectiveness. We realize this evaluation by extending TEmBed, a recently proposed testbed for tabular embeddings, whose table-level coverage is currently limited to a single retrieval task. An empirical study over the TEmBed model pool confirms that no single model excels across all tasks, demonstrating that table-level embedding quality cannot be reduced to retrieval alone.