Search papers, labs, and topics across Lattice.
This paper introduces LMS-AR, a Linux kernel module that regulates memory bandwidth in multi-core systems by utilizing an adaptive filtering technique to predict per-core bandwidth requirements. By allowing a master core to monitor and regulate bandwidth without being a dedicated controller, the approach effectively mitigates memory contention and enhances application performance. Experimental results show that LMS-AR significantly outperforms Memguard in reducing slowdown ratios associated with memory contention in multicore environments.
Memory bandwidth regulation can be effectively managed by a non-dedicated master core, leading to substantial performance improvements in multi-core systems.
Memory bandwidth contention in multi-core systems severely impacts application performance and quality-of-service (QoS) guarantees. Regulating the shared memory bandwidth mitigates the memory performance uncertainty thereby making it a manageable resource and improving trustworthiness of multi-core systems. In this work we propose a memory bandwidth regulation mechanism LMS-AR, i.e., LMS Prediction-based Adaptive Regulator within a Linux kernel module to distribute the memory bandwidth as a resource among the CPU cores. We describe a design in which both monitoring and regulation is enforced from outside by a master core - which is not a dedicated controller for regulation. This allows for plugging in computationally heavy prediction and regulation algorithms without interfering with the regulated core. An adaptive filtering technique was employed for prediction of per-core bandwidth requirement. We conducted several experiments with SPEC CPU 2017 benchmarks distributed across multiple cores. Our proposed approach demonstrated significant improvement over Memguard with respect to slowdown ratios caused due to memory contention. Our solution is hosted publicly at $\href{https://github.com/ss22ongithub/LMSAdaptiveRegulator}{https://github.com/ss22ongithub/LMSAdaptiveRegulator}$.