Search papers, labs, and topics across Lattice.
This paper introduces HVPNet, a bio-inspired network designed for salient and camouflaged object detection that simplifies the modeling process by mimicking the human visual system. By utilizing a Retinal Integration Module (RIM) for effective multimodal feature integration and a cortical decoder (CD) for hierarchical processing, HVPNet achieves a significant accuracy-efficiency trade-off across multiple tasks and datasets. The results demonstrate that HVPNet outperforms complex models while maintaining a smaller parameter scale, highlighting the potential of bio-inspired approaches in computer vision.
HVPNet achieves superior detection performance with a fraction of the complexity, challenging the notion that bigger models are always better.
In recent years, most research on multimodal salient object detection (SOD) and camouflaged object detection (COD) typically aims to improve performance through complex cross-modal feature fusion and decoding structures. However, this approach leads to an excessively large model parameter scale and often fails to deliver satisfactory detection performance due to structural redundancy. In contrast, the human visual process is able to efficiently perform salient and camouflaged object identification without such complex structures. This contrast raises an important question: Can we draw conceptual inspiration from the human visual process to achieve a simpler modeling strategy, and still realize accurate and efficient object detection? To answer this question, we propose HVPNet, a simple yet general bio-inspired computational architecture. Drawing on the multi-layered information integration of the retina as a conceptual metaphor, we designed a Retinal Integration Module (RIM), which effectively integrates multimodal features through a level-specific multi-stage integration strategy. To fully exploit these features, we further design a cortical decoder (CD) that breaks down the decoding process into low- and high-level visual stages, abstracting the hierarchical processing in the human visual cortex. Benefiting from these designs, HVPNet can readily extend to seven tasks across four modalities. Without bells and whistles, it establishes an excellent accuracy-efficiency trade-off across 22 datasets spanning these seven tasks. Our code is available at https://github.com/jiaweiXu1029/HVPNet.
