Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DDStereo, a Dual-Decoder Stereo Transformer designed to tackle the challenges of real-time performance and open-set generalization in stereo 3D object detection. By employing two lightweight decoder branches for open-set foreground detection and 3D attribute regression, DDStereo achieves a significant improvement in inference speed while maintaining state-of-the-art accuracy. Experimental results on public benchmarks demonstrate that DDStereo not only outperforms existing stereo 3D detectors but also matches the real-time performance of monocular methods for the first time.
DDStereo achieves real-time stereo 3D object detection with open-set generalization, outperforming traditional methods in both speed and accuracy.
Stereo-based 3D object detection still faces two critical safety challenges: real-time performance and open-set generalization. Existing stereo 3D methods typically achieve twice the accuracy of monocular methods but suffer from significantly lower inference speeds, making them unsuitable for real-time applications. Meanwhile, recent advances in open-world detection have introduced open-set and open-vocabulary algorithms in monocular 2D and 3D settings, yet stereo-based open-set detection remains largely unexplored. To bridge this gap, we propose DDStereo, a novel Dual-Decoder Stereo Transformer for real-time open-set 3D object detection. DDStereo features two lightweight decoder branches: one for open-set foreground 2D detection and the other for 3D attribute regression. These decoders share object-level queries to achieve unified target-level alignment. To enhance inference efficiency, we designed a compact disparity feature extractor and a streamlined decoder architecture. Experiments on public stereo 3D benchmarks demonstrate that DDStereo achieves state-of-the-art accuracy under both closed-set and open-set protocols. Notably, our method surpasses existing stereo 3D detectors in inference speed and, for the first time, achieves real-time performance comparable to monocular approaches.