Search papers, labs, and topics across Lattice.
This paper introduces Subspace Signal Routing (SSR), a novel approach for merging Low-Rank Adaptations (LoRAs) in diffusion models that mitigates parameter interference by routing internal signals rather than merging parameters directly. By constructing a unified subspace and employing an inverse correlation matrix to decorrelate mixed signals, SSR ensures that task-specific signals are effectively directed into their respective subspaces. The method is theoretically grounded in Ordinary Least Squares (OLS) principles and demonstrates superior performance over existing techniques while maintaining efficiency in memory and computation.
SSR not only resolves destructive parameter collisions in LoRA merging but also guarantees mathematical optimality, setting a new standard for efficiency in diffusion model training.
Low-Rank Adaptation (LoRA) merging can efficiently combine diverse generative capabilities from multiple trained LoRAs for a diffusion model. However, existing LoRA merging techniques often suffer from severe parameter interference, causing destructive collisions in the shared parameter space. To address this, we propose Subspace Signal Routing (SSR), which resolves interference by routing internal signals instead of performing parameter-space merge. Specifically, SSR first constructs a unified subspace by concatenating candidate LoRAs along the rank dimension. Next, SSR employs an inverse correlation matrix to decorrelate mixed signals within this space. Finally, a directional guide matrix steers these purified signals into their respective task-specific subspaces. We provide a rigorous theoretical analysis proving that SSR aligns with the Ordinary Least Squares (OLS) solution, thereby ensuring mathematical optimality. We utilize the additivity of sufficient statistics to design a streaming algorithm. This enables on-the-fly updates that significantly reduce memory overhead and computation time. Extensive experiments validate that SSR significantly outperforms state-of-the-art methods while maintaining comparable efficiency. Code is available at https://github.com/nagara214/SSR-Merge.
