Search papers, labs, and topics across Lattice.
This paper introduces HEART, a heterogeneous multi-LLM framework that addresses the limitations of traditional LLM-based planners in robotic task planning by decomposing complex instructions into atomic reasoning tasks. By leveraging role-specialized expert agents and enforcing feasibility and constraint checks, HEART generates physically executable plans that outperform single-LLM and rule-based approaches. Experimental results across household benchmarks reveal a significant improvement in plan success rates, showcasing the effectiveness of collaborative reasoning among specialized agents in real-world scenarios.
Heterogeneous LLM collaboration boosts robotic task planning success rates by ensuring plans are both feasible and efficient.
Large Language Models (LLMs) can reason over complex instructions but often fail to satisfy the physical and spatial constraints required for robotic task planning. Recent LLM-based planners directly translate text into action sequences, yet they lack structured reasoning about feasibility, reachability, and logical order, resulting in invalid or incomplete plans. We present a heterogeneous multi-LLM framework that decomposes instructions into atomic reasoning tasks and allocates them to role-specialized expert agents under a token budget for real-world computational and communicational constraints. By combining role-oriented reasoning from heterogeneous agents followed by constraint-driven plan synthesis, HEART validates capability, reachability, and constraint conditions before planning and helps produce physically executable plans while maintaining efficiency. Experiments across different household benchmarks show that HEART consistently improves plan success compared to single-LLM and rule-based planners, demonstrating that heterogeneous LLM collaboration enables robust and scalable robotic task planning under resource constraints.
