Search papers, labs, and topics across Lattice.
This paper explores the use of machine learning to create adaptive and data-driven control policies within memory hierarchies. It introduces three ML-guided policies: Pythia (RL-based cache prefetcher), Hermes (perceptron-based off-chip cache predictor), and Sibyl (RL-based data placement for hybrid storage). Evaluations demonstrate that these ML-driven policies outperform human-designed policies while maintaining modest hardware overhead, showcasing the potential for intelligent, self-optimizing memory architectures.
ML-powered memory management policies can significantly outperform human-designed heuristics, unlocking performance and efficiency gains previously unattainable in memory subsystems.
Despite the data-rich environment in which memory systems of modern computing platforms operate, many state-of-the-art architectural policies employed in the memory system rely on static, human-designed heuristics that fail to truly adapt to the workload and system behavior via principled learning methodologies. In this article, we propose a fundamentally different design approach: using lightweight and practical machine learning (ML) methods to enable adaptive, data-driven control throughout the memory hierarchy. We present three ML-guided architectural policies: (1) Pythia, a reinforcement learning-based data prefetcher for on-chip caches, (2) Hermes, a perceptron learning-based off-chip predictor for multi-level cache hierarchies, and (3) Sibyl, a reinforcement learning-based data placement policy for hybrid storage systems. Our evaluation shows that Pythia, Hermes, and Sibyl significantly outperform the best-prior human-designed policies, while incurring modest hardware overheads. Collectively, this article demonstrates that integrating adaptive learning into memory subsystems can lead to intelligent, self-optimizing architectures that unlock performance and efficiency gains beyond what is possible with traditional human-designed approaches.
