Search papers, labs, and topics across Lattice.
This paper introduces a constrained multi-objective proximal policy optimization (C-MOPPO) algorithm to jointly optimize federated training and inference in federated edge learning (FEEL) environments. The approach addresses the NP-hard problem of maximizing inference accuracy while minimizing latency and energy consumption on resource-constrained edge devices by formulating it as a multi-objective Markov decision process (MOMDP). Experiments demonstrate that C-MOPPO achieves better trade-offs among objectives compared to baseline methods.
Resource-constrained edge devices can achieve Pareto-optimal trade-offs between inference accuracy, latency, and energy consumption in federated learning by using a constrained multi-objective reinforcement learning approach.
Federated edge learning (FEEL) has recently emerged as a promising paradigm for achieving edge intelligence (EI) via enabling collaborative model training across edge devices while protecting data privacy. In this paper, we put forth an online optimization framework that jointly manages federated training and inference on resource-constrained edge devices. We introduce a tandem-queue-inspired conversion mechanism that bridges inference requests and training data, and further incorporate both data and model freshness into the accuracy formulation to capture temporal dynamics in real-world environments. To maximize inference accuracy while minimizing latency and energy consumption, the mode selections, communication, and computation resource allocations of edge devices are jointly optimized. We formulate this optimization as a multi-objective optimization problem, which is NP-hard and further complicated by the online setting. To address these challenges, we transform the problem into a multi-objective Markov decision process (MOMDP) and develop a \underline{c}onstrained \underline{m}ulti-\underline{o}bjective \underline{p}roximal \underline{p}olicy \underline{o}ptimization (C-MOPPO) algorithm. Specifically, C-MOPPO first learns a set of policies with different preferences across three objectives, then leverages constrained policy optimization to enrich the Pareto front and obtain high-quality, dense solutions. Extensive experiments demonstrate that C-MOPPO achieves well-balanced trade-offs among objectives and significantly outperforms baselines under various system configurations.
