Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study systematically benchmarks training-free token merging techniques, specifically ToMe and Mutual Pair Merging, in Vision Transformers (ViTs) for wheat phenotyping tasks such as growth-stage classification, wheat-head detection, and organ segmentation. The findings reveal that while classification tasks exhibit high merge-tolerance, detection and segmentation tasks face significant challenges due to their complex structures and runtime constraints. Notably, the research emphasizes the importance of profiling deployment value based on target runtime rather than solely relying on token count for performance assessment.
Classification tasks in wheat phenotyping can leverage token merging for significant efficiency gains, but detection and segmentation reveal hidden complexities that challenge this approach.
Vision-based wheat phenotyping requires repeated measurements under deployment constraints, from growth-stage recognition to wheat-head counting and organ segmentation. Plain Vision Transformers (ViTs) provide a common architecture for these tasks, but quadratic attention limits high-throughput and edge inference. Training-free token merging is attractive because it can be inserted into trained models without retraining. We provide a systematic benchmark of ToMe and Mutual Pair Merging across growth-stage classification, wheat-head detection, and wheat-organ segmentation, measuring task quality, throughput, token count, and peak GPU memory, with additional Raspberry Pi 5 measurements. The benchmark reveals a clear hierarchy: classification is highly merge-tolerant, while detection and segmentation are constrained by repeated instances, thin organs, dense boundaries, reconstruction, and runtime overhead. Optimized attention backends can erase apparent speedups, so deployment value must be profiled on the target runtime rather than inferred from token count.