Search papers, labs, and topics across Lattice.
This paper introduces Mimir, a neuro-symbolic memory system designed for embodied agents operating in interactive environments under partial observability. By separating world memory from task memory and employing a dynamic grounding module, Mimir effectively binds active goals to relevant world facts, significantly enhancing task execution. The system demonstrates substantial performance improvements across various benchmarks, achieving up to a 42.5% gain in task success rates compared to existing models.
Mimir achieves an impressive 86.0% success rate on long-horizon tasks, outperforming leading closed-source models by a significant margin.
Long-horizon embodied task requires agents to act under partial observability while preserving both scene belief and execution progress. Flat histories or implicit policy states may contain past observations, but they do not provide an explicit interface for deciding which world facts support the currently active goal. We introduce Mimir, a neuro-symbolic memory that separates world memory from task memory and dynamically grounds them before each action. World memory maintains object locations, object states, and perceptual evidence, while task memory maintains an ordered goal agenda, progress state, hand state, failures, and execution constraints. A grounding module binds the active goal to recalled world candidates, fills missing source locations, and attaches evidence before planning and embodiment-specific execution. Across tested backbones, Mimir consistently improves on different EB-ALFRED and EB-Habitat tasks, with maximum gains of 42.5% and average gains of 23.0%, respectively. Compared with the best results among prior agent and memory systems evaluated under the same backbone, Mimir improves the overall average success rate by 8.5%. Finally, on the EB-Habitat Long-horizon subset, Mimir achieves 86.0% success rate, substantially outperforming current closed-source models. Our code will be released soon.
