Search papers, labs, and topics across Lattice.
This paper introduces Task-Conditional Flow Matching (TCFM), a novel framework for adapting multilingual text embeddings that tailors optimization strategies to specific task requirements. By selectively applying Flow Matching for translation tasks and employing task-aligned objectives for retrieval, classification, and pair-classification tasks, TCFM achieves significant improvements in embedding quality. Evaluated on the Indic Massive Text Embedding Benchmark, TCFM sets a new state-of-the-art performance while ensuring robust generalization across different embedding model families.
Task-Conditional Flow Matching redefines multilingual embedding adaptation by tailoring optimization strategies to task-specific needs, achieving unprecedented improvements in embedding quality.
Multilingual text embedding models are commonly adapted using a single training objective across diverse tasks, despite different tasks requiring fundamentally different optimization strategies. We introduce Task-Conditional Flow Matching (TCFM), a multilingual embedding adaptation framework that selectively applies Flow Matching to translation tasks while optimizing retrieval, classification, and pair-classification tasks with objectives better aligned to their learning dynamics. TCFM further combines teacher-guided representation preservation with a three-stage curriculum to enable stable adaptation. Evaluated on the Indic Massive Text Embedding Benchmark, TCFM establishes a new state-of-the-art, consistently improving embedding quality across a diverse set of multilingual tasks and generalizing across embedding model families. We will publicly release the codebase and datasets upon acceptance of the paper.
