Search papers, labs, and topics across Lattice.
This paper introduces FlexDepth, a family of self-supervised monocular depth estimation models designed to enhance performance in complex driving environments by employing a two-stage static-dynamic decoupled training strategy. The approach allows for independent confidence assessment of static backgrounds and dynamic objects, while a Scale-Driven Decoder (SDD) facilitates efficient feature fusion tailored to varying scales. Experimental results show that FlexDepth achieves state-of-the-art performance across multiple scales with minimal computational overhead, making it suitable for real-time applications on resource-constrained automotive devices.
FlexDepth achieves state-of-the-art monocular depth estimation in complex driving scenarios with minimal computational requirements, making it a game-changer for real-time automotive perception.
Self-Supervised Monocular Depth Estimation (MDE) has garnered attention in recent years due to its independence from ground truth. However, most existing models are limited to a single scale and exhibit considerable performance degradation in complex driving environments. Networks specifically designed to handle dynamic traffic participants tend to be overly complex, hindering their deployment on resource-constrained automotive edge devices. To address these limitations and move towards robust driving perception, we propose FlexDepth, a scale-driven and flexible family of self-supervised MDE models tailored for challenging road scenarios. FlexDepth employs a two-stage static-dynamic decoupled training strategy, enabling the independent assessment of confidence for both static backgrounds and dynamic road objects. Furthermore, it introduces a meticulously designed Scale-Driven Decoder (SDD) to dynamically select components based on scale size, facilitating efficient feature fusion and the output of high-precision depth maps. Extensive experiments on standard driving benchmarks demonstrate that without any auxiliary information, our model achieves state-of-the-art performance across arbitrary scales with minimal computational overhead. Our smallest model, Flex-Nano, requires only 0.7 GFLOPs and achieves 37.6 FPS on mobile platforms, ensuring reliable real-time perception while maintaining excellent zero-shot generalization.Our source code is avalible: https://github.com/startnew/flexdepth
