Search papers, labs, and topics across Lattice.
This paper introduces Giskard, a novel protocol that simultaneously addresses confidentiality and Byzantine resilience in decentralized learning by organizing participants into a tree structure of committees. By employing a coordinate-wise approximate median calculated through a committee-adapted distributed binary search, Giskard significantly reduces communication complexity while maintaining model utility even in the presence of up to 25% Byzantine participants. The theoretical security and confidentiality properties of Giskard, along with extensive experimental validation involving up to one million participants, demonstrate its effectiveness compared to existing solutions.
Giskard achieves robust and confidential decentralized learning with significantly lower communication overhead, even in the face of substantial Byzantine interference.
Dealing simultaneously with confidentiality and Byzantine behaviors in decentralized learning is a challenging problem. Indeed, in decentralized learning, clients train a machine learning model while keeping their data locally and share their model parameters or gradients with a set of neighbors. While enforcing confidentiality calls for hiding the exchanged model parameters/gradients (e.g., by using cryptographic techniques), dealing with Byzantine contributions often requires inspecting the latter. Hence, most research works address these objectives separately. A recent line of work proposes to employ secure multi-party computation (MPC) to implement robust aggregators against model poisoning, thereby enforcing both confidentiality and Byzantine resilience. However, these solutions scale badly: they either require all-to-all communication between participants or delegate the entire computation to a small subset, whose computational and communication load grows proportionally with the size of the network. In this paper, we present Giskard, a protocol for confidential and Byzantine-robust decentralized aggregation. Giskard organizes $n$ parties into a tree of committees of size $O(\log n)$ and evaluates a coordinate-wise approximate median via a committee-adapted distributed binary search over the value domain, using BGW-style MPC within each committee. We assess Giskard both theoretically by proving its security and confidentiality properties and experimentally through extensive experiments involving up to one million participants. Compared to its closest competitors, Giskard reduces per-party communication complexity asymptotically while exhibiting comparable model utility under up to $n/4$ Byzantine parties.
