Reliable Off-Policy Learning for Dosage Combinations
It addresses a critical challenge in personalized medicine, such as cancer therapy, by providing a first-of-its-kind method for reliable dosage combination optimization, which is incremental in improving over existing independent modeling approaches.
The paper tackles the problem of estimating joint effects of multiple continuous treatments for personalized medicine, proposing a novel method that ensures reliable off-policy learning and demonstrates effectiveness through extensive evaluation.
Decision-making in personalized medicine such as cancer therapy or critical care must often make choices for dosage combinations, i.e., multiple continuous treatments. Existing work for this task has modeled the effect of multiple treatments independently, while estimating the joint effect has received little attention but comes with non-trivial challenges. In this paper, we propose a novel method for reliable off-policy learning for dosage combinations. Our method proceeds along three steps: (1) We develop a tailored neural network that estimates the individualized dose-response function while accounting for the joint effect of multiple dependent dosages. (2) We estimate the generalized propensity score using conditional normalizing flows in order to detect regions with limited overlap in the shared covariate-treatment space. (3) We present a gradient-based learning algorithm to find the optimal, individualized dosage combinations. Here, we ensure reliable estimation of the policy value by avoiding regions with limited overlap. We finally perform an extensive evaluation of our method to show its effectiveness. To the best of our knowledge, ours is the first work to provide a method for reliable off-policy learning for optimal dosage combinations.