Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of learned cache prefetchers by isolating the impact of admission policies from prediction models, using a matched control approach with a 257-parameter online MLP and a classical stride predictor. The findings reveal that while the neural model shows promise, its performance is comparable to that of the classical predictor under random traffic conditions and slower on regular streams. Importantly, the research highlights that the admission gate significantly enhances prefetching accuracy and reduces unnecessary prefetches, demonstrating that the gate's design is more critical than the choice of predictor itself.
The admission gate in cache prefetching outperforms the predictor, revealing that better proxies do not guarantee improved system performance.
Learned cache prefetchers are typically evaluated against classical predictors that always issue requests, confounding the prediction model with the admission policy. We disentangle these variables with matched controls: the same admission gate is applied to both a 257-parameter online MLP and a classical stride predictor. The neural advantage vanishes; the MLP is indistinguishable from gated stride on random traffic and slower on most regular streams. The gate itself is architecturally useful independent of the predictor: on twenty SPEC CPU2017 programs in native ChampSim, it removes 35% of prefetches and improves accuracy from 11% to 15%, but DRAM reads change by only 0.07% demonstrating that proxy metrics do not predict endpoint behavior. We prove gate-closed execution reproduces the no-prefetch baseline exactly. The gate matters more than the predictor, and better proxies do not imply better endpoints.
