Search papers, labs, and topics across Lattice.
This paper explores online distributional prediction in non-stationary environments, focusing on the challenges posed by drift and adversarial corruption. The authors introduce a novel method that utilizes a latent cluster geometry to represent candidate probability distributions, allowing for effective posterior averaging through a Gibbs quasi-posterior approach. Their results demonstrate that the proposed restarted predictor achieves sublinear cumulative Wasserstein regret without relying on parametric assumptions about the data stream or corruption processes, highlighting its robustness in dynamic settings.
Achieving sublinear cumulative Wasserstein regret in online distributional prediction without any parametric model for drift or corruption is a game-changer for adaptive learning systems.
Online learning in non-stationary streams is often formulated as tracking a point estimate, but many applications require predicting the full data-generating distribution. We study online distributional prediction under drift and adversarial corruption. Our approach represents each candidate law through a latent cluster geometry: a variable-size configuration of centers that organizes probability mass and induces a predictive distribution. A Gibbs quasi-posterior over these configurations yields an online predictor by posterior averaging, and the resulting variable-dimensional posterior can be sampled with reversible-jump MCMC. The method therefore avoids specifying a parametric streaming law while retaining a structured latent space for uncertainty, regularization, and comparison. We evaluate performance by cumulative Wasserstein-1 regret against the time-varying true law. The analysis separates two effects: corruption perturbs the loss-based posterior update, whereas drift makes long-horizon posterior memory stale. We address the latter with a restarted variant that temporally localizes the same quasi-Bayesian update. The resulting high-probability bounds decompose into a PAC-Bayesian complexity term, a corruption-sensitive posterior perturbation term, and a dynamic optimal-transport term driven by \(A_T^{\mathrm{OT}}=\sum_{t=2}^T W_2^2(p_{t-1}^*,p_t^*)\). Under bounded support, stable latent geometry, predictive-map regularity, oracle realizability, localized restart windows, sublinear transport action, and sublinear corruption budget, the restarted predictor achieves sublinear cumulative Wasserstein regret. These guarantees require no parametric model for the stream, drift mechanism, or corruption process.
