Search papers, labs, and topics across Lattice.
This paper investigates online convex optimization (OCO) with delayed feedback under a strict capacity constraint, where only a limited number of pending rounds can be tracked. By introducing a semi-clairvoyant model that allows learners to observe delay expirations online, the authors develop a novel "delayed and weighted" OCO framework that incorporates randomized tracking decisions and importance-weighted observations. The proposed Delayed-Weighted FTRL and its bandit variant yield the first regret guarantees for capacity-constrained OCO, demonstrating that a capacity of \(C = \Omega(\log T)\) can achieve standard delayed OCO rates, while also providing a graceful degradation of regret bounds under bandit feedback conditions.
Capacity constraints can be effectively managed in online convex optimization, allowing for standard regret rates to be achieved even with limited tracking resources.
Online learning with delayed feedback typically assumes that the learner can track all pending rounds until their feedback arrives. In practice, tracking resources are finite, and feedback from untracked rounds is permanently lost. In this paper, we study delayed online convex optimization (OCO) under a hard capacity constraint, where at most $C$ pending rounds can be tracked at any time. To model delay information, we introduce a semi-clairvoyant model that refines the clairvoyant assumption from prior work: rather than requiring delays to be known at prediction time, the learner observes delay expirations online, consistent with the classical unconstrained delayed setting. Our approach proceeds via a reduction to a novel ``delayed and weighted'' OCO problem, using a scheduler that randomizes tracking decisions and importance-weights the resulting observations. For this base problem, we propose and analyze Delayed-Weighted FTRL and its bandit analogue, establishing regret bounds that explicitly characterize the interaction between time-varying weights and delayed feedback. Combining these base learners with our schedulers yields the first regret guarantees for capacity-constrained OCO under convex and strongly convex losses, for both first-order and bandit feedback. For first-order feedback, capacity $C = 惟(\log T)$ suffices to recover standard delayed OCO rates up to logarithmic factors. For bandit feedback, the regret rates are modulated by powers of $(1 + 蟽_{\text{max}}/C)$, where $蟽_{\text{max}}$ is the maximum number of pending observations at any time. This allows the regret bound to degrade gracefully when $C < 蟽_{\text{max}}$, while remaining sublinear.
