Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a robust reinforcement learning framework for dynamic treatment regimes by modeling patients as hidden contexts within robust contextual Markov decision processes, thereby unifying generalization and robustness under model and measurement uncertainty. Applied to metastatic prostate cancer treatment simulation, the framework yields policies that significantly outperform existing methods, demonstrating robustness with minimal performance degradation even with biomarker inaccuracies and disease dynamic shifts. The resulting policies Pareto-dominate existing approaches across varied scenarios, highlighting the efficacy of robust RL for reliable adaptive treatment learning.
Robust RL policies for adaptive cancer therapy achieve superior performance and generalization by treating patients as hidden contexts, outperforming existing methods even with noisy biomarkers and shifting disease dynamics.
We develop a robust reinforcement learning (RL) framework for learning adaptive treatment policies that generalize across patients and remain reliable under errors in the measured biomarker and shifts in the disease dynamics. By modeling the patient as a hidden context, we address generalization and robustness in a unified manner through robust contextual Markov decision processes. Applying our framework to adaptive therapy for metastatic prostate cancer in a simulator calibrated to clinical data, we obtain generalizable and robust policies that substantially outperform the existing adaptive therapy method. In particular, we attain robustness with almost no loss of performance when the biomarker is accurate and the disease evolves as anticipated, and find that the resulting policy Pareto-dominates the existing method across a diverse array of scenarios. Our findings suggest that robust RL holds great promise as a principled methodology for learning reliable adaptive treatment policies.