Search papers, labs, and topics across Lattice.
This paper introduces CamFlow+, a hybrid-basis framework for 2D camera motion estimation that integrates homography-derived physical bases, stochastic bases, and depth-translational bases to enhance flexibility and accuracy in challenging scenarios. By relaxing the single-plane constraint and incorporating a depth-aware smoothness term, CamFlow+ effectively addresses issues related to camera translation, depth variation, and local parallax. Experimental results demonstrate significant improvements in both sparse and dense camera-motion estimation, as well as enhanced video stabilization performance, achieving the highest preference rate in a user study.
CamFlow+ achieves superior 2D camera motion estimation and stabilization by seamlessly integrating multiple motion bases, outperforming traditional methods in complex environments.
Estimating 2D camera motion is fundamental to computer vision and computational photography. Existing homography-based methods work well for planar scenes or pure rotation, but struggle with camera translation, depth variation, and local parallax; local homography and mesh-based models improve flexibility but still rely on piecewise planar assumptions. We introduce CamFlow+, a hybrid-basis framework that represents 2D camera motion directly in dense-flow space. CamFlow+ combines homography-derived physical bases, stochastic bases sampled from homography flows, and depth-translational bases derived from depth and camera intrinsics, relaxing the single-plane constraint while preserving camera-motion regularity. A depth-aware smoothness term further regularizes translation-induced parallax in continuous-depth regions while preserving motion changes near depth boundaries. We evaluate CamFlow+ on GHOF-Cam, a camera-motion benchmark that masks out dynamic objects and ill-posed occlusion regions in an optical-flow benchmark to isolate camera-induced motion. Experiments show that CamFlow+ improves sparse and dense camera-motion estimation. In digital video stabilization, CamFlow+ also improves global and local stability, achieving the best top-1 preference rate in a blind user study. Code and datasets will be available on the project page: https://lhaippp.github.io/CamFlow+.
