Search papers, labs, and topics across Lattice.
This paper introduces Policy-Controlled Generalized Share (PCGS), a strictly online learning framework designed for non-stationary environments where the best expert switches over time. The key innovation is using a causal Transformer (PCGS-TF) as an adaptive update controller that maps weight vectors after observing loss, without altering the current decision. Experiments on synthetic and real-world datasets demonstrate that PCGS-TF achieves lower dynamic regret compared to existing methods, especially with larger expert pools and in non-stationary environments.
Transformers can now dynamically adapt expert weighting in online learning, achieving state-of-the-art dynamic regret in non-stationary environments.
Static regret to a single expert is often the wrong target for strictly online prediction under non-stationarity, where the best expert may switch repeatedly over time. We study Policy-Controlled Generalized Share (PCGS), a general strictly online framework in which the generalized-share recursion is fixed while the post-loss update controls are allowed to vary adaptively. Its principal instantiation in this paper is PCGS-TF, which uses a causal Transformer as an update controller: after round t finishes and the loss vector is observed, the Transformer outputs the controls that map w_t to w_{t+1} without altering the already committed decision w_t. Under admissible post-loss update controls, we obtain a pathwise weighted regret guarantee for general time-varying learning rates, and a standard dynamic-regret guarantee against any expert path with at most S switches under the constant-learning-rate specialization. Empirically, on a controlled synthetic suite with exact dynamic-programming switching-oracle evaluation, PCGS-TF attains the lowest mean dynamic regret in all seven non-stationary families, with its advantage increasing for larger expert pools. On a reproduced household-electricity benchmark, PCGS-TF also achieves the lowest normalized dynamic regret for S = 5, 10, and 20.
