Megan Lee

C𝐅i)\mathbf{f}_{\text{out}}=\text{BatchNorm}\left(\frac{1}{C}\sum_{i=1}^{C}\mathbf{F}_{i}\right) (19) Gated Linear Unit (GLU) Fusion: A gating mechanism that learns to suppress noise and control information flow. The gating mechanism can learn to suppress noisy or irrelevant feature dimensions while preserving informative ones, acting as a learned noise filter. 𝐜=𝐱s+𝐱t\mathbf{c}=\mathbf{x}_{s}+\mathbf{x}_{t} (20) 𝐠=σ​(𝐖g​[𝐱s∥𝐱t]+𝐛g)∈ℝB×D\mathbf{g}=\sigma\left(\mathbf{W}_{g}[\mathbf{x}_{s}\|\mathbf{x}_{t}]+\mathbf{b}_{g}\right)\in\mathbb{R}^{B\times D} (21) 𝐟out=BatchNorm​(𝐜⊙𝐠)\mathbf{f}_{\text{out}}=\text{BatchNorm}(\mathbf{c}\odot\mathbf{g}) (22) where σ\sigma is the sigmoid function, ⊙\odot denotes element-wise multiplication, and 𝐖g∈ℝD×2​D\mathbf{W}_{g}\in\mathbb{R}^{D\times