Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for reconstructing high-fidelity neural radiance fields (NeRFs) from fast-flying drone footage by fusing asynchronous event streams with motion-blurred RGB images. The method jointly optimizes event-based visual-inertial odometry priors and NeRF parameters, leveraging the complementary nature of events and frames to overcome challenges posed by motion blur and noisy pose estimates. Experiments on both synthetic and real-world data demonstrate that the proposed approach achieves a performance gain of over 50% compared to state-of-the-art methods in reconstructing sharp radiance fields and preserving fine scene details under highly dynamic flight conditions.
By fusing asynchronous event streams with motion-blurred images, this method achieves a 50% performance boost in NeRF reconstruction for fast-flying drones, even when pose priors are unreliable.
Fast-flying aerial robots promise rapid inspection under limited battery constraints, with direct applications in infrastructure inspection, terrain exploration, and search and rescue. However, high speeds lead to severe motion blur in images and induce significant drift and noise in pose estimates, making dense 3D reconstruction with Neural Radiance Fields (NeRFs) particularly challenging due to their high sensitivity to such degradations. In this work, we present a unified framework that leverages asynchronous event streams alongside motion-blurred frames to reconstruct high-fidelity radiance fields from agile drone flights. By embedding event-image fusion into NeRF optimization and jointly refining event-based visual-inertial odometry priors using both event and frame modalities, our method recovers sharp radiance fields and accurate camera trajectories without ground-truth supervision. We validate our approach on both synthetic data and real-world sequences captured by a fast-flying drone. Despite highly dynamic drone flights, where RGB frames are severely degraded by motion blur and pose priors become unreliable, our method reconstructs high-fidelity radiance fields and preserves fine scene details, delivering a performance gain of over 50% on real-world data compared to state-of-the-art methods.
