Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Time-Reparameterized Cumulative Intensity Extrapolation (TR-CIE) sampler, which enhances discrete flow matching (DFM) sampling quality under constraints of limited function evaluations (NFE). By employing a schedule-based time reparameterization and a cumulative-intensity extrapolation updating rule, TR-CIE effectively mitigates stiffness and improves the approximation of cumulative intensities without requiring additional model evaluations. Experimental results across synthetic tasks and benchmarks in text generation and text-to-image synthesis show significant improvements in sampling quality compared to traditional $τ$-leaping methods.
TR-CIE achieves superior sampling quality under limited evaluations, transforming the landscape of discrete flow matching.
Discrete flow matching (DFM) provides a principled framework for generative modeling on discrete state spaces via continuous-time Markov chain dynamics. In practice, sampling for DFM commonly employs discretizations such as $τ$-leaping, yet efficient sampling methods under a limited number of function evaluations (NFE) remain less studied. To address this gap, we propose the Time-Reparameterized Cumulative Intensity Extrapolation (TR-CIE) sampler, which aims to improve sampling quality when function evaluations are restricted. TR-CIE consists of two components. First, a schedule-based time reparameterization rescales the time grid according to the noise schedule. Under standard factorized DFM rate parameterizations, this transformation of variables absorbs the schedule-dependent growth term and mitigates stiffness near the terminal sampling stage. Second, we introduce a cumulative-intensity extrapolation updating rule. By reusing cached model outputs from the previous step as a history term, this improves the approximation of stepwise cumulative intensities on the resulting non-uniform time grid. We provide a theoretical analysis that bounds the local approximation error of cumulative intensities and establishes convergence results. The resulting sampler requires one NFE per step and introduces no additional model evaluations compared to the standard $τ$-leaping sampler. Extensive experiments on synthetic tasks, text generation, and text-to-image benchmarks demonstrate that our method improves sampling quality under limited NFE.