Search papers, labs, and topics across Lattice.
This paper introduces a generative Markov model framework for modeling heterogeneous and complex distributed computing systems, addressing the need for a unified formal model. By factorizing the system state into high-dimensional variables and leveraging the sparse dependency structure, the framework enables efficient simulation, inference, and policy learning. A case study on collaborative AI inference illustrates that distributing computation across user devices alleviates bottlenecks associated with centralized scheduling, leading to reduced latency and resource consumption.
Distributing computation across user devices can significantly reduce latency and server resource consumption, challenging the traditional reliance on centralized scheduling in distributed systems.
Emerging distributed computing paradigms, such as the computing continuum, are inherently heterogeneous, stochastic, and complex. Efficiently and effectively utilizing all available resources across the continuum demands a unified formal model of the system. To address this gap, we propose a general framework for modeling distributed computing systems as a generative Markov model, factorized over a structured system state. In our model, the state decomposes into high-dimensional variables, each further factorized over its elements, reflecting the sparse dependency structure inherent to distributed systems. This yields a tractable model enabling simulation, inference, and policy learning over otherwise intractable system states, bridging distributed computing with Markov chain theory and reinforcement learning (RL). We demonstrate our framework through a case study of collaborative AI inference, in which a dedicated server combines resources with those volunteered by service users. Our results show that centralized scheduling becomes a bottleneck at scale, while distributing computation across user devices reduces both latency and server resource consumption. These findings highlight the value of adaptive decision-making in distributed computing systems and demonstrate the framework's utility for modeling, simulation, and optimization.
