Search papers, labs, and topics across Lattice.
This paper extends Kernel Mean Matching (KMM) for risk estimation under covariate shift to dependent sampling settings by introducing effective sample sizes derived from Bernstein inequalities for geometrically strongly mixing processes. The analysis quantifies finite-sample guarantees that disentangle overlap, dependence, and smoothness effects, revealing a tradeoff where smoother losses can increase dependence and reduce effective sample size. Applying this to prediction results in confidence intervals with improved coverage on real-world monitoring data.
Dependent sampling doesn't break KMM risk estimation; effective sample sizes derived from mixing properties provide robust finite-sample guarantees.
Kernel Mean Matching (KMM) estimates risk under covariate shift by reweighting labelled source samples so that their kernel mean embedding matches that of unlabeled target samples. Existing finite-sample guarantees are usually stated for independent samples, although many applications involve temporal, spatial, or clustered dependence. We give a finite-sample KMM analysis under dependent sampling by replacing nominal sample sizes with effective sample sizes in the concentration steps used by the classical proof. The approach uses Bernstein inequalities for geometrically strongly mixing processes and derives a model-based effective sample size. The resulting bound separates overlap, dependence, and smoothness effects with specific constants derived under a Gaussian process assumption. This analysis yields an additional tradeoff: smoother losses preserve more input dependence and therefore reduce effective sample size, while also reducing function complexity and empirical-to-population risk gaps. Applying the result to prediction yields confidence intervals that achieve near-nominal coverage in synthetic experiments and substantially reduce undercoverage on real monitoring data.