Ekaterina Alimaskina

Two residual streams in diffusion language models halve the performance gains of adding a second stream by enabling distinct read and write routing patterns.

Self-generated QA pairs can introduce significant biases, leading to fragile learning dynamics that may undermine model performance.

Aggressive 2-bit inference can backfire, leading to longer reasoning traces and accuracy drops, but targeted recovery methods can reverse this trend dramatically.