Search papers, labs, and topics across Lattice.
This paper introduces Imprint, an interaction-centric memory framework designed to enhance long-horizon egocentric question answering by treating memory as an online compression problem rather than relying on hierarchical textual summarization. By organizing incoming observations into structured Interaction Records and leveraging human memory principles, Imprint effectively retains and compresses relevant interactions, leading to improved retrieval efficiency. Evaluations on the EgoLifeQA benchmark show that Imprint significantly boosts QA accuracy from 31.0% to 35.8%, increases evidence-grounded answers by six times, and reduces memory footprint and retrieval latency substantially.
Memory compression can enhance long-horizon question answering, achieving a 6x increase in evidence-grounded answers while reducing memory usage by over two times.
Long-horizon egocentric question answering involves answering about events that have occurred hours or days in the past. This requires memory representations that remain both retrieval-effective and scalable over days or weeks of recording. Existing long-horizon egocentric QA methods construct memory as hierarchical textual summaries of observations. While effective for reducing memory size, summarization optimizes for descriptive compression rather than retrieval: repeated interactions are absorbed into coarse textual descriptions instead of being preserved as explicit, recurring memory units, making long-horizon evidence aggregation difficult. We propose Imprint, an interaction-centric memory framework that formulates long-horizon egocentric memory as an online memory compression problem rather than summarization. Incoming observations are first represented as structured Interaction Records and continuously organized into recurring interaction patterns. Using human memory consolidation signals of recurrence, recency, and distinctiveness, Imprint selectively retains and compresses interactions into a compact retrieval-oriented memory. We evaluate Imprint on EgoLifeQA, a seven-day egocentric benchmark containing questions that require reasoning over interactions occurring hours to days before the query. With the same LLM, Imprint improves QA accuracy from 31.0% to 35.8%, increases evidence-grounded answers by $6\times$ compared with EgoRAG, reduces memory footprint by $2.3\times$, and decreases retrieval latency by $11.8\times$. These results demonstrate that memory compression provides a scalable and retrieval-effective foundation for long-horizon egocentric question answering.
