Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel method for optimizing streaming data systems in Machine Learning by decoupling inference from state persistence through a technique called probabilistic thinning. By selectively triggering durable state updates based on informative events, the approach significantly reduces latency and operational costs associated with high-frequency state updates, achieving up to 90% exclusion of events from the persistence path. The authors demonstrate that this method maintains unbiased time-based aggregations and improves downstream utility, all while relying solely on approximate statistics from disk-backed key-value stores, eliminating the need for complex control mechanisms.
Up to 90% of events can be excluded from state persistence without sacrificing accuracy or utility in streaming ML systems.
Streaming data systems increasingly underpin Machine Learning workflows that maintain large numbers of continuously updated aggregations. In production settings, each incoming event typically triggers read-modify-write operations to persistent storage, making high-frequency state updates a dominant source of latency, contention, and operational cost. In this work, we decouple inference from state persistence in streaming Machine Learning pipelines via probabilistic thinning: every event is scored, but durable state updates are selectively triggered by informative events. Unlike approaches that shed input or state, we show that persistence-path control is achievable without a high-frequency in-memory control plane or cross-worker coordination, relying exclusively on approximate statistics retrieved from disk-backed key-value stores. We model the resulting stochastic processes, derive bounds on filtering rates, and prove that common time-based aggregations remain unbiased under variance-aware formulations, preventing systemic error accumulation. We evaluate the approach in a controlled setting that isolates per-event costs, demonstrating substantial reductions in storage Input/Output and serialization overhead. Across experiments, up to 90% of events are excluded from the persistence path while preserving and in some cases improving downstream utility.