Search papers, labs, and topics across Lattice.
This paper introduces a multimodal robotic AI framework that combines 3D skeleton extraction with language-guided reasoning to enhance plant root phenotyping. Utilizing an unsupervised skeleton extraction network based on Weighted Laplacian Contraction (W-LBC), the authors generate high-fidelity structural representations from dense point clouds, allowing for the computation of key morphological descriptors. The integration of these geometric features with a fine-tuned GPT model enables the generation of biologically consistent explanations of root growth patterns across 12 diverse plant species, demonstrating a novel approach to explainable robotic analysis in agriculture.
Bridging the gap between quantitative root morphology and semantic interpretation, this framework enables AI to provide biologically meaningful insights into plant growth across diverse species.
Plant root phenotyping is fundamental to understanding below-ground structures, optimizing crop management, and improving agricultural sustainability. This paper presents a multimodal robotic AI framework that integrates 3D skeleton extraction with language-guided reasoning for interpretable and data-efficient root analysis. We develop an unsupervised skeleton extraction network based on Weighted Laplacian Contraction (W-LBC) to generate high-fidelity structural representations from dense point clouds captured by robotic 3D sensing platforms. Quantitative morphological descriptors, including root count, length, branching angle, and density, are computed from the reconstructed skeleton graph to capture geometric and topological characteristics. Building on these features, we introduce an Evidence-First language modeling framework that fine-tunes GPT as an interactive analytical chatbot using automatically generated instruction--response pairs. Each training sample provides measurable evidence before natural-language reasoning, enabling the model to ground interpretation in quantitative morphology. Through supervised fine-tuning, GPT associates numerical structure with semantic meaning, producing biologically consistent explanations of growth patterns and adaptive traits. Experiments show that the structure-guided framework achieves robust, interpretable reasoning across 12 plant species with diverse root architectures. By integrating unsupervised 3D geometric perception with large-scale language understanding, our approach bridges quantitative analysis and semantic interpretation, establishing a unified paradigm for explainable robotic plant root phenotyping.