Search papers, labs, and topics across Lattice.
JADE-GS introduces a novel approach to deblurring in fast-moving camera scenarios by leveraging event cameras to capture high-resolution motion signals. The method overcomes limitations of existing restoration techniques by integrating physics-based priors with learned networks through a pixel-adaptive routing gate, enabling bidirectional refinement between 2D and 3D representations. As a result, JADE-GS achieves superior perceptual quality on both synthetic and real-world benchmarks, outperforming existing methods in key metrics while maintaining efficient training and rendering times.
Achieving state-of-the-art perceptual quality in deblurring, JADE-GS outperforms traditional methods by effectively merging physics-based and learned priors.
When a camera moves fast during exposure, blur destroys the intra-exposure motion a 3D model needs to recover the sharp scene, while event cameras capture exactly this signal at microsecond resolution. Turning them into reliable 3D supervision faces two obstacles. First, the two restoration priors fail in opposite ways: physics-based event-integration priors preserve edges but accumulate drift; learned networks recover texture but distort boundaries. Second, existing pipelines run in one direction only, so raw event noise or the biases of fixed 2D pseudo-labels pass uncorrected into the geometry. JADE-GS addresses both: a pixel-adaptive routing gate fuses the complementary priors, and the resulting 2D restorer is coupled to a 3D Gaussian Splatting student in a bidirectional loop, where detached, multi-view-consistent renders and a physics-based reblurring constraint regularize the restorer, turning a fixed preprocessor into a geometry-aware predictor. Across synthetic and real benchmarks, JADE-GS attains the best perceptual quality, leading LPIPS and CLIP-IQA on both benchmarks with competitive PSNR and SSIM, and trainsin about one hour under 5 GB on a single consumer GPU while preserving real-time rendering.
