Search papers, labs, and topics across Lattice.
This paper introduces SVI360, a dual-branch framework specifically designed for omnidirectional video interpolation, addressing the limitations of existing methods that struggle with severe distortions near the poles of spherical videos. By reinforcing the equivariance of flow displacements between the original and rotated orthogonal views, SVI360 significantly enhances intermediate frame prediction. Experimental results demonstrate that SVI360 outperforms state-of-the-art techniques in interpolation quality across four public benchmarks while ensuring accurate optical flow.
SVI360 achieves superior omnidirectional video interpolation by effectively managing distortions that plague traditional methods, setting a new standard for immersive video applications.
This paper addresses the problem of omnidirectional video interpolation, which plays an essential role in applications such as virtual reality and immersive video enhancement. Existing video interpolation methods are not well-suited for spherical videos, as they have difficulty handling severe distortions close to the poles. To address this issue, we propose SVI360, a dual-branch framework that combines the image frame and its rotated orthogonal view to deal with these distortions. The core methodological aspect of the approach is to reinforce equivariance of the flow displacements between the original and orthogonal views to improve intermediate frame prediction. Experiments show that our method outperforms state-of-the-art approaches in interpolation quality while maintaining accurate optical flow in four different public benchmarks. Code and pre-trained models are available at: https://icb-vision-ai.github.io/video360_interpolation/