Search papers, labs, and topics across Lattice.
This study benchmarks two strategies for image restoration in the context of image signal processors (ISPs): pre-ISP restoration in the RAW domain and post-ISP restoration in the sRGB domain. The analysis spans multiple smartphone devices, learned ISPs, and various degradation types, revealing that the RAW restoration approach generally outperforms standard RGB restoration models. However, RGB models that are specifically trained with ISP transformations yield the highest overall performance, emphasizing the importance of aligning restoration methods with the imaging pipeline.
RAW restoration consistently beats generic RGB models, but ISP-aware RGB models take the crown for best performance.
Modern cameras transform RAW sensor measurements into sRGB images through an image signal processor (ISP). We benchmark two placements for blind restoration around a fixed ISP: (A) pre-ISP restoration in the RAW domain and (B) post-ISP restoration in the sRGB domain. The benchmark covers four smartphone device groups, two learned ISPs, three degradation regimes--noise, blur, and joint noise and blur--, and several representative RAW and RGB restoration models. Our results show that placement alone does not determine performance. The RAW restoration strategy outperforms the best generic RGB restoration models. However, RGB restoration models trained considering the ISP transformations, achieve the best overall performance. Our novel benchmark demonstrates that the image reconstruction performance strongly depends on the alignment between the restoration model and the target imaging pipeline. We consequently recommend reporting restoration placement and ISP-aware supervision as key experimental factors. Our code is available at https://github.com/mv-lab/AISP
