Wooseok Song

Attention probability is a deceptive metric for transformer sparsification—model degradation across multi-view vision transformers is universally governed by directional drift in the residual stream rather than lost attention mass.

This paper proposes a fully automated data generation pipeline that generates pointwise perceptual distance labels between image pairs without any human annotation, and demonstrates that the diffusion trajectory aligns well with the human visual system.