Search papers, labs, and topics across Lattice.
The paper introduces HSI-SC-NeRF, a novel stationary-camera multi-channel NeRF framework, to enable high-throughput hyperspectral 3D reconstruction for agricultural produce inspection. It addresses the limitations of traditional methods by using a stationary hyperspectral camera and a rotating object within a custom imaging chamber, estimating object poses via ArUco markers. The method jointly optimizes reconstruction across all hyperspectral bands using a composite spectral loss and a two-stage training protocol, achieving high spatial reconstruction accuracy and spectral fidelity.
Unlock high-throughput, accurate 3D hyperspectral imaging for agriculture with a stationary camera NeRF, sidestepping complex hardware setups.
Advances in hyperspectral imaging (HSI) and 3D reconstruction have enabled accurate, high-throughput characterization of agricultural produce quality and plant phenotypes, both essential for advancing agricultural sustainability and breeding programs. HSI captures detailed biochemical features of produce, while 3D geometric data substantially improves morphological analysis. However, integrating these two modalities at scale remains challenging, as conventional approaches involve complex hardware setups incompatible with automated phenotyping systems. Recent advances in neural radiance fields (NeRF) offer computationally efficient 3D reconstruction but typically require moving-camera setups, limiting throughput and reproducibility in standard indoor agricultural environments. To address these challenges, we introduce HSI-SC-NeRF, a stationary-camera multi-channel NeRF framework for high-throughput hyperspectral 3D reconstruction targeting postharvest inspection of agricultural produce. Multi-view hyperspectral data is captured using a stationary camera while the object rotates within a custom-built Teflon imaging chamber providing diffuse, uniform illumination. Object poses are estimated via ArUco calibration markers and transformed to the camera frame of reference through simulated pose transformations, enabling standard NeRF training on stationary-camera data. A multi-channel NeRF formulation optimizes reconstruction across all hyperspectral bands jointly using a composite spectral loss, supported by a two-stage training protocol that decouples geometric initialization from radiometric refinement. Experiments on three agricultural produce samples demonstrate high spatial reconstruction accuracy and strong spectral fidelity across the visible and near-infrared spectrum, confirming the suitability of HSI-SC-NeRF for integration into automated agricultural workflows.
