Search papers, labs, and topics across Lattice.
NEEDL-Bench is introduced as a benchmark dataset for the automatic detection of Swiss Needle Cast (SNC) in Douglas-fir needles, comprising 3250 annotated microscopy images. This dataset addresses a critical gap in computer vision for ecological monitoring, enabling standardized severity measurements of SNC, which significantly impacts the productivity of this keystone species. Evaluation of various detection methods on NEEDL-Bench yielded a maximum F1 score of 0.8479, highlighting the potential for further advancements through tailored approaches rather than mere model scaling.
Despite the promise of larger models, the key to improving SNC detection lies in domain-specific inductive biases rather than scaling alone.
We present NEEDL-Bench, a microscopy detection benchmark for Swiss Needle Cast (SNC), a fungal disease of Douglas-fir trees. Douglas-fir is a keystone species of major ecological and economic importance as a softwood timber resource, and SNC affects productivity by forming sexual reproductive structures (pseudothecia) that emerge through the gas exchange pores (stomata) of the needles, thereby blocking gas exchange and compromising needle function. To date, there is no dataset for automatic computer vision detection of these structures, despite computer vision being well poised to standardize and viably scale severity measurements. To address this, we present NEEDL-Bench, a dataset of 3250 annotated images from 1082 Douglas-fir needles, annotated for both keypoints and bounding-box detectors. This dataset exhibits a challenging collection of features, including blur, poor object contrast, small objects of interest, and occlusions. To better capture both the nominal distribution of the data and the full breadth of rare structures, we present two distinct evaluation splits: either random sampling from the collected images or sequential sampling to maximize structural diversity. We evaluate multiple popular keypoint and bounding box methods for detection on this dataset as a baseline and observe a maximum F1 score of 0.8479, suggesting significant potential for gains from future development on this problem. Further, we find that larger models generally do not show commensurate gains in performance on this dataset, indicating that improvements on this problem will not come from scaling laws but rather from domain-specific inductive biases.