Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CARLOS, a novel algorithm for continuous-time optimal stopping that leverages deep reinforcement learning to learn exercise rules at arbitrary time resolutions. By progressively refining a coarse time grid and employing an adaptive sampling strategy, CARLOS effectively improves timing-value estimates and enhances computational efficiency. Benchmark results indicate that CARLOS outperforms traditional Bermudan solvers and approaches the optimal American pricing bound, addressing significant limitations in existing simulation-based solvers.
CARLOS achieves optimal stopping prices that rival American options while maintaining computational efficiency, redefining expectations for simulation-based solvers.
Simulation based solvers for optimal stopping problems must discretize the stopping decision. Under classical dynamic programming, a coarse exercise grid with only a few stopping opportunities can materially undervalue the optimal expected reward, whereas on a very fine grid, approximation errors accumulate through the backward recursion. To remove this limitation, we develop a new reinforcement-learning inspired algorithm that enables us to learn the exercise rule at arbitrarily fine time resolution. Our CARLOS (Continuous-time Adaptive Reinforcement Learning for Optimal Stopping) algorithm utilizes an aggregate deep neural network (ADNN) to learn a joint space-time decision boundary. Starting from a coarse time grid, we progressively increase the frequency of stopping opportunities, while in parallel training the ADNN to refine its timing-value estimates. We moreover design an adaptive sampling strategy that gradually concentrates training effort near the stopping boundary. Benchmarked results show that CARLOS delivers higher prices than existing Bermudan solvers, approaching the American upper bound, and achieves high computational efficiency relative to non-RL comparators.