Search papers, labs, and topics across Lattice.
This paper explores a decentralized collaborative learning framework for Tsetlin Machines (TMs) that utilizes consensus-based inference to integrate predictions from multiple agents without sharing raw data. The approach addresses the lack of research in distributed TM learning and allows for heterogeneous agents with varying data sources and computational capabilities to work together effectively. Experimental results show that the proposed decentralized method achieves classification accuracies comparable to centralized models, highlighting its potential in multi-modal sensing environments.
Decentralized Tsetlin Machines can achieve centralized model performance while preserving data privacy and accommodating heterogeneous agents.
Tsetlin Machine (TM) is a rule-based machine-learning algorithm comprising collectives of two-action Tsetlin Automata (TAs) that cooperatively form conjunctive logical clauses from Boolean inputs through stochastic feedback. Although few recent studies have examined TM Federated Learning, the broader area of distributed and decentralized TM learning has not received much attention in the existing literature and warrants further exploration. In this work, we propose a paradigm for decentralized collaborative learning under a vertical feature-partitioning setting among an ensemble of Tsetlin Machines using consensus-based inference. Within this decentralized paradigm, each agent maintains its own private TM model, and there is no exchange of raw data among agents. Inference combines individual agents model predictions into a global consensus. The paradigm accommodates heterogeneous TM-based agents with differing data acquisition means, local data distributions, or computational resources, thereby facilitating the integration and fusion of information in settings such as multi-modal sensing environments. Experiments conducted using two-dimensional grid and connected graph network topologies demonstrate that the classification accuracies achieved are comparable to those of centralized models.