Search papers, labs, and topics across Lattice.
The paper introduces a novel detect-segment-identify pipeline for Holstein-Friesian cattle re-identification (Re-ID) in dense crowds, addressing the limitations of existing YOLO-based methods that fail when cows group closely. The pipeline leverages Open-Vocabulary Weight-free Localisation and the Segment Anything Model (SAM) for pre-processing, followed by Re-ID networks. Evaluation on a newly published CCTV dataset from a working dairy farm demonstrates a 98.93% detection accuracy and 94.82% Re-ID accuracy, significantly outperforming oriented bounding box and SAM species detection baselines.
Cows in a crowd? This new pipeline uses SAM and contrastive learning to achieve 94.82% re-identification accuracy, blowing away previous methods.
Holstein-Friesian detection and re-identification (Re-ID) methods capture individuals well when targets are spatially separate. However, existing approaches, including YOLO-based species detection, break down when cows group closely together. This is particularly prevalent for species which have outline-breaking coat patterns. To boost both effectiveness and transferability in this setting, we propose a new detect-segment-identify pipeline that leverages the Open-Vocabulary Weight-free Localisation and the Segment Anything models as pre-processing stages alongside Re-ID networks. To evaluate our approach, we publish a collection of nine days CCTV data filmed on a working dairy farm. Our methodology overcomes detection breakdown in dense animal groupings, resulting in a 98.93% accuracy. This significantly outperforms current oriented bounding box-driven, as well as SAM species detection baselines with accuracy improvements of 47.52% and 27.13%, respectively. We show that unsupervised contrastive learning can build on this to yield 94.82% Re-ID accuracy on our test data. Our work demonstrates that Re-ID in crowded scenarios is both practical as well as reliable in working farm settings with no manual intervention. Code and dataset are provided for reproducibility.
