Search papers, labs, and topics across Lattice.
The paper introduces Multistage Conditional Compositional Optimization (MCCO), a new paradigm for decision-making under uncertainty that combines multistage stochastic programming and conditional stochastic optimization. MCCO minimizes nested conditional expectations and nonlinear cost functions, finding applications in areas like optimal stopping and distributionally robust contextual bandits. To combat the exponential scenario complexity of na茂ve nested sampling, the authors develop multilevel Monte Carlo techniques that achieve polynomial scenario complexity relative to desired accuracy.
Escaping the curse of dimensionality in multistage stochastic optimization is now possible: multilevel Monte Carlo methods can reduce scenario complexity from exponential to polynomial.
We introduce Multistage Conditional Compositional Optimization (MCCO) as a new paradigm for decision-making under uncertainty that combines aspects of multistage stochastic programming and conditional stochastic optimization. MCCO minimizes a nest of conditional expectations and nonlinear cost functions. It has numerous applications and arises, for example, in optimal stopping, linear-quadratic regulator problems, distributionally robust contextual bandits, as well as in problems involving dynamic risk measures. The na茂ve nested sampling approach for MCCO suffers from the curse of dimensionality familiar from scenario tree-based multistage stochastic programming, that is, its scenario complexity grows exponentially with the number of nests. We develop new multilevel Monte Carlo techniques for MCCO whose scenario complexity grows only polynomially with the desired accuracy.