Search papers, labs, and topics across Lattice.
This paper investigates cache provisioning strategies that prioritize achieving specific Service-Level Objectives (SLOs) rather than merely maximizing hit rates at fixed capacities. By analyzing the minimum cache size and execution time necessary for different caching policies to meet defined targets, the authors identify a hybrid segmented policy that adapts to historical workload patterns. The results demonstrate that this approach significantly reduces both capacity requirements and processing costs in practical edge-cloud deployments.
Achieving SLOs in edge-cloud caching can be done with significantly lower capacity and cost through a novel hybrid segmented policy that adapts to workload patterns.
While traditional cache policy evaluations fix capacity - often at 0.1% of the dataset - and measure the resulting hit rate, practical edge-cloud deployments require balancing both storage and computational overhead as billed resources. Consequently, system operators frequently focus on a different objective: determining the minimum cache size needed to satisfy a specific Service-Level Objective (SLO) hit-rate. This paper explores this SLO-centric paradigm by analyzing the minimum capacity and execution time each policy requires to hit a defined target. Additionally, we show that dynamically adjusting the segment ratio in segmented policies based on historical workload patterns enhances efficiency. Through evaluations across real-world and synthetic traces, we present a novel hybrid segmented policy that reduces capacity requirements while keeping processing costs low.
