Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a latent predictive state estimator (LPSE) designed for dynamic network monitoring and orchestration, addressing the need for rapid semantic interpretations of telemetry in changing cloud-edge environments. By converting variable-cardinality node telemetry into topology-adaptive representations and utilizing a semantic codebook for inference, the LPSE achieves significant improvements in response time and resource efficiency. Experimental results demonstrate that LPSE achieves 82.42% semantic prediction accuracy while reducing mean inference latency by 41 times and memory usage by 15 times compared to a 4B LLM endpoint.
Achieving 82.42% accuracy in semantic predictions while slashing inference latency by 41 times could revolutionize real-time network monitoring.
Closed-loop network monitoring and orchestration increasingly require semantic interpretations of live telemetry beyond raw counter collection. However, dynamic cloud-edge environments change both the active node set and the monitoring query at runtime, while control loops demand bounded millisecond-scale responses. We introduce a latent predictive state estimator (LPSE) for dynamic network monitoring and orchestration, built on latent predictive learning over streaming telemetry. The framework converts variable-cardinality node telemetry into topology-adaptive temporal representations, fuses them with monitoring questions, and returns bounded answers from a semantic codebook instead of autoregressive text generation. This design enables fixed-cost, single-pass inference while preserving semantic interpretability. By operating on permutation-invariant, slot-routed node representations keyed by stable identity, the model maintains a fixed input space and generalizes to node addition, removal, and reordering without retraining. Experimental results on a multi-node Kubernetes cluster show semantic prediction accuracy of 82.42% at approximately 41$\times$ lower mean inference latency and 15$\times$ smaller memory footprint compared with a deployable 4B LLM endpoint.