Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This work reveals that reported performance gains from integrating environmental sensor data with crop disease imagery are often artifacts of dataset construction, specifically session leakage. Analyzing two Korean datasets, the authors demonstrate that multimodal networks can predict disease by memorizing session identities due to shared sensor readings across images from the same collection session. An image-free classifier using only timestamps matches or exceeds sensor-driven predictions, highlighting the need for session-held-out evaluation in multimodal crop studies.
Most reported gains in crop disease classification from environmental sensors are illusory, driven by simple session memorization rather than genuine multimodal learning.
Integrating environmental sensor data with leaf imagery is widely reported to boost crop disease classification accuracy. In this work, we reveal that these reported gains are often artifacts of dataset construction: because a single sensor reading is shared across many images collected in a single session (one farm on one date), multimodal networks can predict disease simply by memorizing session identities. Analyzing two widely used Korean datasets, the Crop Disease Diagnosis (CDD) benchmark and an AI Hub pest/disease dataset, we demonstrate that nearly all images share sensor values, with 91.9% of CDD test images having exact sensor duplicates in the training set. Remarkably, an image-free classifier given only timestamps matches or exceeds sensor-driven predictions across all seven evaluated crops, and matches the published macro-F1 of a state-of-the-art CDD fusion model. These results indicate that performance gains on standard random splits cannot be disentangled from session leakage. We propose that multimodal crop studies must evaluate on session-held-out splits and report performance against sensor-free date-time baselines to ensure genuine generalization.