Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a turbo-inference strategy that enhances object detection and instance segmentation by iteratively leveraging the complementary information between the two tasks. The authors developed two novel modules, the turbo-detection head and turbo-segmentation head, which create a closed-loop communication system that improves both detection and segmentation performance without requiring model retraining. Experimental results on COCO, iFLYTEK, and Cityscapes datasets show significant improvements in accuracy for both tasks, albeit with a slight increase in computational cost.
Iteratively linking detection and segmentation tasks can boost accuracy in both domains without the need for retraining, challenging conventional paradigms in instance segmentation.
Object detection and instance segmentation tasks are closely related. Existing top-down instance segmentation methods usually follow a detect-then-segment paradigm, where an initial detector is used to recognize and localize objects with bounding boxes, followed by the segmentation of an instance mask within each bounding box. In such methods, the detection accuracy directly influences the subsequent segmentation performance. However, previous research has seldom explored the impact of the instance segmentation task on object detection. In this paper, we present a turbo-inference strategy for the top-down methods that leverages the complementary information between detection and segmentation tasks iteratively. Specifically we design two modules: turbo-detection head and turbo-segmentation head, which facilitate communication between the tasks. The two modules form a closed loop that interlaces the detection and segmentation results without retraining the model. Comprehensive experiments on the COCO, iFLYTEK, and Cityscapes datasets demonstrate that our method substantially enhances both detection and segmentation accuracies with a certain increase in computational cost. The proposed method represents a tradeoff between prediction accuracy and inference speed. Codes are available at https://github.com/zhaozhen2333/Turbo-Learning.git.
Tsinghua AI