Search papers, labs, and topics across Lattice.
This study introduces ArchAgent v2, an advanced framework for automating microarchitecture design specifically targeting multi-level data prefetching. By employing a cascaded evolutionary search and a hardware-realizability feedback loop, ArchAgent v2 effectively navigates the expansive design space, leading to the discovery of a three-level prefetcher that surpasses the performance of the previous champion solution. The resulting design achieves a 3.8% geometric mean IPC speedup over baseline configurations, showcasing the potential of automated agentic discovery in computer architecture.
ArchAgent v2 outperforms hand-designed solutions by achieving a 3.8% IPC speedup through innovative multi-level data prefetching strategies.
Agentic artificial intelligence has shown great promise in automating algorithm design, but scaling similar techniques to computer microarchitecture discovery remains challenging due to vast search spaces, strict hardware budgets, and long simulation times. In this work, we present ArchAgent v2, a framework which scales automated microarchitecture search to multi-level data prefetching. While the original ArchAgent successfully discovered single-level cache replacement policies in competition settings, it does not scale to multi-level prefetching where the design space and degrees of freedom are larger. To overcome this, we introduce two new additions to ArchAgent: a cascaded evolutionary search that subdivides the design space by sequentially evolving and freezing prefetchers at individual cache levels, and a hardware-realizability feedback loop that embeds real-time size-estimation directly into the evolution process. Evaluated under identical rules of the 4th Data Prefetching Championship (DPC4), ArchAgent v2 automatically designs a three-level prefetcher that outperforms the winning hand-designed solution, further demonstrating automated agentic discovery as a useful tool for computer architects. Our discovered policy achieves a 3.8\% geometric mean IPC speedup over the baseline overall and a 0.3\% improvement over the prior champion, BertiGO. On low-bandwidth single-core configurations, our policy yields a 4.6\% performance speedup compared to only 2.6\% for BertiGO. However, multi-core evolution still remains a significant challenge due to simulation latency impeding evolution speed. Finally, our profiling of an ArchAgent evolution of over 12,000 candidate designs provides key insights into how automated evolutionary agents explore and synthesize complex microarchitectural logic.
BAIR
DeepMind