Search papers, labs, and topics across Lattice.
The authors introduce EQA-Decision, a large-scale embodied question answering dataset comprising over four million question-answer pairs designed to evaluate static scene understanding, spatial reasoning, task dynamics, and instant decision-making. They also present RoboDecision, a baseline model, to provide a unified framework for evaluating perception, reasoning, and action in embodied environments. Experiments demonstrate that EQA-Decision effectively benchmarks and enhances vision-language model (VLM) capabilities in spatial and interaction reasoning.
Existing embodied QA benchmarks focus on narrow reasoning skills; EQA-Decision finally offers a unified, large-scale dataset spanning static scene understanding, spatial reasoning, task dynamics, and instant decision-making.
Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each focusing on a limited subset of reasoning skills such as spatial understanding or procedural reasoning, without offering a unified large-scale framework for comprehensive evaluation. We present EQA-Decision, a large-scale embodied QA dataset that systematically covers four complementary dimensions of embodied reasoning: static scene construction, spatial understanding, task dynamics reasoning, and instant decision. The dataset contains over four million question-answer pairs with hierarchical annotations across diverse embodied scenarios. In addition, we develop RoboDecision, a strong baseline model aligned with the EQA-Decision Benchmark, providing a unified framework that jointly evaluates perception, reasoning, and action-level decision-making in embodied environments. Results demonstrate that EQA-Decision effectively benchmarks and enhances VLM capabilities in spatial and interaction reasoning, providing a solid foundation for advancing embodied intelligence research.
