Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to visual instance segmentation by training a neural network to compute signed distance functions (SDFs) instead of relying on traditional anchor-based methods. By predicting distance maps at each pixel to the nearest object contour in various directions, the method overcomes the limitations of predefined bounding boxes, leading to improved segmentation performance on the COCO dataset. The results demonstrate a significant increase in foreground intersection over union (IoU) compared to the state-of-the-art YOLACT method, highlighting the potential of SDFs in capturing complex object shapes.
Moving beyond anchor boxes, this method leverages signed distance functions to achieve superior instance segmentation performance, particularly for irregularly shaped objects.
Visual instance segmentation is a challenging problem and becomes even more difficult if objects of interest varies unconstrained in shape. Some objects are well described by a rectangle, however, this is hardly always the case. Consider for instance long, slender objects such as ropes. Anchor-based approaches classify predefined bounding boxes as either negative or positive and thus provide a limited set of shapes that can be handled. Defining anchor-boxes that fit well to all possible shapes leads to an infeasible number of prior boxes. We explore a different approach and propose to train a neural network to compute distance maps along different directions. The network is trained at each pixel to predict the distance to the closest object contour in a given direction. By pooling the distance maps we obtain an approximation to the signed distance function (SDF). The SDF may then be thresholded in order to obtain a foreground-background segmentation. We compare this segmentation to foreground segmentations obtained from the state-of-the-art instance segmentation method YOLACT. On the COCO dataset, our segmentation yields a higher performance in terms of foreground intersection over union (IoU). However, while the distance maps contain information on the individual instances, it is not straightforward to map them to the full instance segmentation. We still believe that this idea is a promising research direction for instance segmentation, as it better captures the different shapes found in the real world.
