Search papers, labs, and topics across Lattice.
This paper introduces xPress, a causal refinement method for block-diffusion drafters that addresses the limitations of independently sampled marginals in speculative decoding. By enabling parallel refinement of the entire diffusion block, xPress restores causal dependencies that are typically lost in single-pass token generation, leading to improved acceptance lengths and decoding throughput. Experimental results on the Qwen3-8B model demonstrate that xPress increases acceptance length by an average of 30% and enhances end-to-end decoding throughput by approximately 1.3 times compared to the original dFlash method.
xPress boosts acceptance lengths by 30% and decoding throughput by 1.3 times, transforming how block-diffusion drafters handle causal dependencies.
Block-diffusion drafters like dFlash generate an entire block of draft tokens in a single forward pass, drastically reducing the overhead of multiple-token drafting in speculative decoding. The crucial final step of the single-pass discrete denoising process involves using the logit distribution at each position to sample conditionally independent tokens. The resulting draft is thus a set of per-position marginals, rather than a joint distribution: no draft token is guaranteed to depend on its predecessors. Such independently sampled marginals tend to produce sequences with tokens that are individually likely, but jointly improbable under the target model's distribution, which verifies each token conditionally. This can cause early rejection and limits acceptance length. To address this, we propose xPress as a means to restore the missing causality in diffusion drafters. xPress is a lightweight causal refiner that reconciles the whole diffusion block at once through parallel refinement, restoring and propagating causal dependencies across the draft without a token-by-token loop. On Qwen3-8B, across seven math, code, and chat benchmarks, xPress raises acceptance length by about 30% on average (up to +56%) and its end-to-end decoding throughput by about 1.3 on average (up to 1.7) compared to the original dFlash diffusion drafter.
