Search papers, labs, and topics across Lattice.
This study benchmarks species recognition performance on the North America Camera Trap Images (NACTI) dataset, which is characterized by significant long-tailed class imbalance. By evaluating various Long-Tail Recognition (LTR) methodologies, including specialized loss functions and regularization techniques, the authors achieve a state-of-the-art Top-1 accuracy of 99.40% on the NACTI test split. Despite these advancements, the research reveals that current LTR optimizations still struggle with representational bottlenecks, particularly for rare classes under severe domain shifts, indicating limitations in generalization capabilities.
Achieving a remarkable 99.40% accuracy on a highly imbalanced dataset, this research uncovers critical gaps in long-tail recognition performance under domain shifts.
As with most ``in the wild'' collections of the natural world, the North America Camera Trap Images (NACTI) dataset exhibits long-tailed class imbalance, with the largest class covering over 50% of its 3.7M images. Building on the PyTorch Wildlife model, we systematically evaluate Long-Tail Recognition (LTR) methodologies to benchmark species recognition performance, including specialised loss functions and LTR-sensitive regularisation. Our optimised configuration achieves state-of-the-art 99.40% Top-1 accuracy on the NACTI test split, significantly outperforming standard baselines and previously reported top performances. To assess robustness under domain shifts (e.g., night-time captures, occlusion, motion-blur), we extend our evaluation across three independent reduced-bias test sets (including ENA-Detection, Caltech Camera Traps and Missouri Camera Traps). Across these out-of-distribution (OOD) evaluations, our LTR-enhanced model consistently demonstrates substantially stronger generalisation capabilities compared to standard cross-entropy approaches. However, qualitative and quantitative analyses underline that current LTR optimisations cannot fully overcome representational bottlenecks, resulting in catastrophic predictive breakdown for rare `Tail' classes under severe domain shift. For maximum reproducibility, all dataset splits, key code, and network weights are published with this paper at https://github.com/ZehuaLiuY/Species-Classification.
