Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Completion-Aware Cross-Fidelity Offline-to-Online (CACF-H2O) RL to address the simulator fidelity gap in hybrid offline-online RL for multi-line bus holding. The approach mitigates issues where policies trained on historical data fail to acquire new experiences and online simulators diverge from target dynamics, leading to suboptimal outcomes like reduced passenger time alongside incomplete journeys. CACF-H2O achieves improved performance by explicitly modeling and accounting for passenger journey completion within the cross-fidelity learning framework.
Hybrid RL for bus holding suffers when simulators misrepresent passenger journey completion, leading to worse outcomes than purely offline methods.
Exploratory reinforcement learning (RL) on an operating bus fleet is impractical,while policies trained only from historical data cannot acquire new experience. Hybrid Offline-and-Online (H2O) RL combines fixed target replay with simulator interaction, but the inexpensive online simulator can differ from the target in transition and event-duration dynamics. We study this cross-fidelity problem for multi-line bus holding and address a failure mode in which lower generalized passenger time coexists with incomplete passenger journeys.