Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
MorphoOrgaAgent is a multi-agent framework designed to eliminate the manual annotation and programming bottlenecks inherent to 3D organoid morphology analysis by translating natural language queries into automated end-to-end biological workflows. The system leverages a TaskUnderstandingAgent to parse user requirements, pairs domain-specific Cellpose geometric cues with text prompts to steer SAM3 for zero-shot instance segmentation, and uses a ReportAgent to calculate quantitative metrics and format structured analytical reports. Evaluated on the newly introduced MorphoOrgaVQA benchmark, the system achieves zero-shot morphological measurements closely mirroring ground truth without requiring user-written code.
Natural language instructions can now drive zero-shot 3D organoid phenotyping by fusing Cellpose geometric priors with SAM3 inside an autonomous multi-agent framework.
Organoids are three-dimensional tissue models whose morphology provides important insights into tumor development, disease progression, and drug testing. Extracting these morphological features relies heavily on manual segmentation, which is time-consuming and labor-intensive. Furthermore, performing quantitative statistical analysis typically requires custom coding skills and a mathematical background, presenting a major barrier for experimental biologists. To address these challenges, we introduce MorphoOrgaAgent, a multi-agent framework that achieves zero-shot organoid segmentation, automated data analysis, and report generation based on natural language input. The framework consists mainly of three core components: a TaskUnderstandingAgent that identifies requested measurements and visualization types; a hybrid segmentation module that combines Cellpose-derived geometric prompts with text prompts to guide SAM3 for zero-shot organoid instance segmentation; and a ReportAgent that computes quantitative metrics and compiles them alongside generated visualizations into a structured report. We further introduce MorphoOrgaVQA, a benchmark designed for quantitative evaluation of agent systems in organoid morphology analysis. Experimental results demonstrate that MorphoOrgaAgent handles both explicit and descriptive user requests, produces measurements closely matching ground truth, and generates complete analysis reports without requiring manual programming. The complete source code and MorphoOrgaVQA benchmark are publicly available at https://github.com/peng-lab/MorphoOrgaAgent.