Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a modular unified architecture for demosaicing pixel-bin image sensors, addressing the challenges posed by their larger inter-color separation compared to traditional Bayer color filter arrays. The proposed method enhances image quality while being lightweight and extensible, allowing for efficient deployment on resource-constrained devices. A key innovation is the inclusion of a learning-free CFA-identification module that accurately detects the CFA type of raw data, facilitating plug-and-play operation across different sensor types.
Achieving superior image quality with a single, lightweight architecture for diverse pixel-bin sensors could revolutionize smartphone camera technology.
Pixel-bin image sensors are becoming the default choice for smartphone cameras due to their resolution vs light-gathering trade-off. However, their larger inter-color separation compared to the Bayer color filter array (CFA) makes them challenging to demosaic. Furthermore, existing deep learning-based demosaicing methods are CFA-specific, requiring multiple individual models that take up precious onboard resources and demand larger development and maintenance efforts. In this work, we propose a modular unified architecture for demosaicing various pixel-bin sensors that provides higher image quality while being extensible and lightweight. Additionally, to enable plug-and-play operation, we introduce a learning-free CFA-identification module to detect the CFA type of raw data accurately.