Search papers, labs, and topics across Lattice.
This paper advocates for a shift in AI memory design from "extract then store" to "store then on-demand extract" to avoid information loss inherent in selective extraction. It further explores leveraging large probabilistic experience collections for deeper insights and improving experience collection efficiency through shared experiences. Simple experiments validate the potential of these alternative approaches, highlighting the need to address challenges hindering their exploration.
Ditching the "extract then store" paradigm could unlock artificial superintelligence by preserving raw experiences for flexible, on-demand use.
Driven by our mission of "uplifting the world with memory," this paper explores the design concept of "memory" that is essential for achieving artificial superintelligence (ASI). Rather than proposing novel methods, we focus on several alternative approaches whose potential benefits are widely imaginable, yet have remained largely unexplored. The currently dominant paradigm, which can be termed "extract then store," involves extracting information judged to be useful from experiences and saving only the extracted content. However, this approach inherently risks the loss of information, as some valuable knowledge particularly for different tasks may be discarded in the extraction process. In contrast, we emphasize the "store then on-demand extract" approach, which seeks to retain raw experiences and flexibly apply them to various tasks as needed, thus avoiding such information loss. In addition, we highlight two further approaches: discovering deeper insights from large collections of probabilistic experiences, and improving experience collection efficiency by sharing stored experiences. While these approaches seem intuitively effective, our simple experiments demonstrate that this is indeed the case. Finally, we discuss major challenges that have limited investigation into these promising directions and propose research topics to address them.
