Search papers, labs, and topics across Lattice.
ACE-Brain-0, a multimodal LLM, is introduced to unify spatial reasoning, autonomous driving, and embodied manipulation by leveraging spatial intelligence as a shared scaffold across diverse embodiments. The proposed Scaffold-Specialize-Reconcile (SSR) paradigm first establishes a shared spatial foundation, cultivates domain-specialized experts, and then harmonizes them through data-free model merging, further enhanced by Group Relative Policy Optimization (GRPO). Experiments show ACE-Brain-0 achieves competitive or state-of-the-art performance across 24 spatial and embodiment-related benchmarks.
Spatial reasoning could be the secret sauce for building generalist embodied agents that can drive, manipulate objects, and fly drones, all within a single model.
Universal embodied intelligence demands robust generalization across heterogeneous embodiments, such as autonomous driving, robotics, and unmanned aerial vehicles (UAVs). However, existing embodied brain in training a unified model over diverse embodiments frequently triggers long-tail data, gradient interference, and catastrophic forgetting, making it notoriously difficult to balance universal generalization with domain-specific proficiency. In this report, we introduce ACE-Brain-0, a generalist foundation brain that unifies spatial reasoning, autonomous driving, and embodied manipulation within a single multimodal large language model~(MLLM). Our key insight is that spatial intelligence serves as a universal scaffold across diverse physical embodiments: although vehicles, robots, and UAVs differ drastically in morphology, they share a common need for modeling 3D mental space, making spatial cognition a natural, domain-agnostic foundation for cross-embodiment transfer. Building on this insight, we propose the Scaffold-Specialize-Reconcile~(SSR) paradigm, which first establishes a shared spatial foundation, then cultivates domain-specialized experts, and finally harmonizes them through data-free model merging. Furthermore, we adopt Group Relative Policy Optimization~(GRPO) to strengthen the model's comprehensive capability. Extensive experiments demonstrate that ACE-Brain-0 achieves competitive and even state-of-the-art performance across 24 spatial and embodiment-related benchmarks.
Amazon Science