Search papers, labs, and topics across Lattice.
This paper introduces PLB, a priority-aware load balancer designed to optimize resource allocation in replicated databases under fixed capacity constraints. By strategically assigning client sessions to database replicas based on user priority, PLB effectively enhances performance for high-priority users while controlling degradation for lower-priority sessions. Evaluation results show that PLB maintains over 70% CPU utilization and reduces high-priority latency by an average of 12% compared to traditional round-robin methods, demonstrating significant improvements in resource efficiency and user experience.
PLB achieves over 70% resource utilization while reducing high-priority latency by 12% compared to conventional load balancing methods, even under fixed resource constraints.
Priority-differentiated services are a standard way for applications to offer different levels of performance, but database systems still often treat all sessions the same way. When database capacity is fixed, meaning replicas cannot be added on demand, and the workload becomes contended, this creates a difficult trade-off between over-provisioning resources and letting lower-priority users experience much larger slowdowns. In such settings, we propose enforcing priority by controlling how client sessions are assigned to database replicas. We present PLB, a priority-aware load balancer implemented as a JDBC driver that enforces priority differentiation through replica assignment under fixed resources. PLB partitions replicas by user group, premium versus freemium, and uses load-based borrowing so that higher-priority users can use idle capacity when available, while degradation for lower-priority users remains controlled. We evaluate PLB on a replicated read-only cluster under OLAP workloads. Compared with static dedicated per-priority partitions, PLB keeps utilization above about 70% in settings where fixed partitions can reduce cluster-wide CPU utilization to about 35%, while maintaining latencies close to those of the best dedicated allocation. Compared with a fully shared round-robin pool, PLB lowers high-priority median latency by about 12% on average, with improvements of up to 28%, while keeping the low-priority median overhead around 11% and overall median latency close to round-robin.
