Search papers, labs, and topics across Lattice.
This paper introduces an unsupervised online video stabilization framework that implements a classical three-stage stabilization pipeline with a multithreaded buffering mechanism. The approach addresses limitations of deep learning-based methods, such as reliance on paired datasets and poor controllability, by leveraging classical priors. The authors also introduce a new multimodal UAV aerial video dataset (UAV-Test) and demonstrate that their method outperforms state-of-the-art online stabilizers, achieving performance comparable to offline methods.
Ditch the paired data and deep learning: this unsupervised video stabilization method rivals offline techniques while running online, even on resource-constrained hardware.
We propose a new unsupervised framework for online video stabilization. Unlike methods based on deep learning that require paired stable and unstable datasets, our approach instantiates the classical stabilization pipeline with three stages and incorporates a multithreaded buffering mechanism. This design addresses three longstanding challenges in end-to-end learning: limited data, poor controllability, and inefficiency on hardware with constrained resources. Existing benchmarks focus mainly on handheld videos with a forward view in visible light, which restricts the applicability of stabilization to domains such as UAV nighttime remote sensing. To fill this gap, we introduce a new multimodal UAV aerial video dataset (UAV-Test). Experiments show that our method consistently outperforms state-of-the-art online stabilizers in both quantitative metrics and visual quality, while achieving performance comparable to offline methods.