Search papers, labs, and topics across Lattice.
The paper introduces Lumosaic, a hyperspectral video system that uses a narrowband LED array and a coded-exposure-pixel (CEP) camera to jointly encode scene information across space, time, and wavelength. By actively synchronizing illumination and per-pixel exposure, Lumosaic improves photon utilization and spectral fidelity in dynamic scenes compared to passive snapshot methods. The system achieves 31-channel hyperspectral video (400-700 nm) at 30 fps and VGA resolution, reconstructed using a learning-based pipeline.
Hyperspectral video, previously limited by motion artifacts and poor photon utilization, now achieves real-time capture and improved fidelity thanks to active illumination and coded-exposure pixels.
We present Lumosaic, a compact active hyperspectral video system designed for real-time capture of dynamic scenes. Our approach combines a narrowband LED array with a coded-exposure-pixel (CEP) camera capable of high-speed, per-pixel exposure control, enabling joint encoding of scene information across space, time, and wavelength within each video frame. Unlike passive snapshot systems that divide light across multiple spectral channels simultaneously and assume no motion during a frame's exposure, Lumosaic actively synchronizes illumination and pixel-wise exposure, improving photon utilization and preserving spectral fidelity under motion. A learning-based reconstruction pipeline then recovers 31-channel hyperspectral (400-700 nm) video at 30 fps and VGA resolution, producing temporally coherent and spectrally accurate reconstructions. Experiments on synthetic and real data demonstrate that Lumosaic significantly improves reconstruction fidelity and temporal stability over existing snapshot hyperspectral imaging systems, enabling robust hyperspectral video across diverse materials and motion conditions.
UW