Suren Kazarian

Two residual streams in diffusion language models halve the performance gains of adding a second stream by enabling distinct read and write routing patterns.