Search papers, labs, and topics across Lattice.
This paper explores the use of Neural Radiance Fields (NeRFs) for 3D reconstruction of gas plumes from Longwave Infrared (LWIR) Hyperspectral Images (HSI), addressing the challenge of limited image availability. They combine state-of-the-art hyperspectral and sparse-view NeRF techniques with a novel adaptive weighted MSE loss, trained on synthetic data generated using DIRSIG. The resulting NeRF model achieves a PSNR of 39.8 dB with as few as 30 training images and demonstrates effective gas plume detection in rendered images, achieving an AUC of 0.821.
NeRFs can now reconstruct 3D gas plumes from sparse hyperspectral LWIR imagery, opening the door to enhanced environmental monitoring and security applications.
Hyperspectral images (HSI) have many applications, ranging from environmental monitoring to national security, and can be used for material detection and identification. Longwave infrared (LWIR) HSI can be used for gas plume detection and analysis. Oftentimes, only a few images of a scene of interest are available and are analyzed individually. The ability to combine information from multiple images into a single, cohesive representation could enhance analysis by providing more context on the scene's geometry and spectral properties. Neural radiance fields (NeRFs) create a latent neural representation of volumetric scene properties that enable novel-view rendering and geometry reconstruction, offering a promising avenue for hyperspectral 3D scene reconstruction. We explore the possibility of using NeRFs to create 3D scene reconstructions from LWIR HSI and demonstrate that the model can be used for the basic downstream analysis task of gas plume detection. The physics-based DIRSIG software suite was used to generate a synthetic multi-view LWIR HSI dataset of a simple facility with a strong sulfur hexafluoride gas plume. Our method, built on the standard Mip-NeRF architecture, combines state-of-the-art methods for hyperspectral NeRFs and sparse-view NeRFs, along with a novel adaptive weighted MSE loss. Our final NeRF method requires around 50% fewer training images than the standard Mip-NeRF and achieves an average PSNR of 39.8 dB with as few as 30 training images. Gas plume detection applied to NeRF-rendered test images using the adaptive coherence estimator achieves an average AUC of 0.821 when compared with detection masks generated from ground-truth test images.
