Search papers, labs, and topics across Lattice.
The paper introduces Learned Neighbor Trust (LNTrust), a decentralized learning approach that optimizes for collaborative deployment by learning which neighboring nodes to trust based on local validation data. LNTrust uses a learned trust function to gate auxiliary distillation during training and to define a deployment ensemble at inference. Experiments across various datasets and topologies demonstrate that LNTrust significantly improves deployed accuracy compared to output-only baselines while reducing communication overhead.
Stop training in isolation: LNTrust lets decentralized models learn *who* to trust during training, so they can collaborate effectively at deployment, boosting accuracy and cutting communication costs.
Many decentralized distillation methods are designed around training-time coordination, yet deploy each node in isolation even when more capable neighbors remain available at inference time. This is an incomplete objective for settings such as IoT, where devices are heterogeneous, data is scarce and skewed, and a node's strongest neighbors may far exceed its own local capacity. We study how nodes should train so that their predictions compose well at deployment, and how each node should learn whom to trust. Under a server-free, model-agnostic protocol where nodes exchange only queries and soft predictions, we propose Learned Neighbor Trust (LNTrust) wherein each node learns a compact trust function over its neighborhood from local validation evidence. This trust function gates auxiliary distillation during training and defines a deployment ensemble at inference, so that collaboration learned during training transfers directly to deployment. Across datasets and topologies, LNTrust improves deployed accuracy over the strongest output-only baseline by large margins while using significantly less communication than previous methods.
