Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces MeRoPE, a novel Metric Rotary Position Embedding designed to enhance camera-controlled video generation by addressing the limitations of existing positional encodings that suffer from scale-dependent failures. By employing orthogonal rotation blocks and mapping metric displacements into multi-frequency rotary phases, MeRoPE preserves feature norms and bounds attention logits, ensuring consistent performance across varying physical translation scales. Evaluated on the nuScenes and PanShot datasets, MeRoPE demonstrates superior camera control and improved alignment between generated camera motion and conditioning poses compared to previous methods.
MeRoPE achieves norm-preserving camera encoding that maintains consistent attention across diverse physical translation scales, outperforming existing methods in video generation tasks.
In camera-controlled video generation, geometry-aware positional encodings condition tokens on camera extrinsics and per-token viewing rays. Existing schemes, however, have a scale-dependent failure mode on real-world metric camera trajectories: homogeneous projective encodings cause attention logits and feature norms to grow unbounded with physical translation baselines. We propose MeRoPE (Metric Rotary Position Embedding), a norm-preserving relative camera encoding for attention. MeRoPE encodes relative orientations between calibrated viewing rays with orthogonal rotation blocks, maps raw metric displacements into multi-frequency rotary phases, and adds a disparity-anchored correspondence prior along the epipolar arc. This design strictly preserves feature norms, bounds pre-softmax attention logits regardless of the physical translation scale, and maintains exact invariance to global rigid coordinate changes. Across nuScenes and PanShot, which cover large-baseline trajectories and diverse camera optics, respectively, MeRoPE achieves stronger camera control than prior encodings, with the best consistency between generated camera motion and conditioning poses in both rotation and translation. Code will be made publicly available.