Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates constraint-aware aggregation methods for Federated Reinforcement Learning (FedRL) to enhance the coordination of distributed energy resources while ensuring safety. By introducing a penalty-based aggregation rule that balances local performance with estimated constraint violations, the authors show significant improvements in both safety and reward compared to standard FedAvg methods. Evaluations on the DairyGridEnv benchmark and real-world datasets reveal that their approach effectively reduces constraint violations while maintaining communication efficiency.
A penalty-based aggregation strategy can enhance safety in federated reinforcement learning without compromising performance or requiring complex optimizations.
Federated Reinforcement Learning (FedRL) enables coordination of distributed energy resources without sharing raw local data, but standard aggregation methods such as FedAvg do not account for system-level constraints, often leading to unsafe global behavior. In this work, we study constraint-aware aggregation for federated reinforcement learning in distributed energy coordination. We propose aggregation rules that incorporate both local performance and estimated constraint violation into the server-side update. Among these, a simple penalty-based rule, $w_i \propto R_i - αV_i$, consistently provides the most reliable trade-off between reward and safety, without requiring dual optimization or modifications to local training. \textcolor{black}{We evaluate our approach on DairyGridEnv, a benchmark modeling multiple farms coordinating battery storage under stochastic demand and a shared grid capacity constraint, and further assess robustness using real load-driven demand profiles from Finland and the German FIELD dataset. Across multiple seeds, penalty-based aggregation substantially reduces violations while improving reward relative to FedAvg in both synthetic and real load-driven settings.} A combined reward-violation scheme exposes a tunable trade-off via $λ$, but is less stable. These results demonstrate that lightweight aggregation strategies can substantially improve empirical safety in federated reinforcement learning while preserving standard communication protocols.