Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a Full Compression Pipeline (FCP) for federated learning (FL) that integrates pruning, quantization, and Huffman encoding to reduce communication and computational overhead. The FCP is evaluated using a unified model cost metric that accounts for both communication and computation. Results show that FCP achieves significant compression (11x reduction in model size) with minimal accuracy loss (2% drop) and faster training (60% speedup) compared to uncompressed FL baselines.
Compressing federated learning models with pruning, quantization, and Huffman coding yields an 11x reduction in model size and 60% faster training with only a 2% accuracy drop.
Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, thereby preserving privacy. However, FL often suffers from significant communication and computational overhead, limiting its scalability and sustainability. In this work, we introduce a Full Compression Pipeline (FCP) for FL in communication-constrained environments. FCP integrates three complementary deep compression techniques (pruning, quantization, and Huffman encoding) into a unified end-to-end framework. By compressing local models and communication payloads, FCP substantially reduces transmission costs and resource consumption while maintaining competitive accuracy. To quantify its impact, we develop an evaluation framework that captures both communication and computation overheads as a unified model cost, allowing a holistic assessment of efficiency trade-offs. The pipeline is evaluated in an independent and identically distributed (IID) and non-IID data setting. In one representative scenario, training a ResNet-12 model on the CIFAR-10 dataset with ten clients and a 2 Mbps bandwidth, the FCP achieves more than 11$\times$ reduction in model size, with only a 2% drop in accuracy compared to the uncompressed baseline. This results in an FL training that is more than 60% faster.