Diabetes Lifestyle Medicine Treatment Assistance Using Reinforcement Learning
This addresses the shortage of trained professionals for diabetes lifestyle medicine, though it appears incremental as an application of existing RL methods to this domain.
The researchers tackled the problem of personalized lifestyle prescriptions for Type 2 diabetes by developing an offline contextual bandit model that learns from NHANES data on 119,555 participants, and it generated prescriptions validated against those from three certified physicians.
Type 2 diabetes prevention and treatment can benefit from personalized lifestyle prescriptions. However, the delivery of personalized lifestyle medicine prescriptions is limited by the shortage of trained professionals and the variability in physicians' expertise. We propose an offline contextual bandit approach that learns individualized lifestyle prescriptions from the aggregated NHANES profiles of 119,555 participants by minimizing the Magni glucose risk-reward function. The model encodes patient status and generates lifestyle medicine prescriptions, which are trained using a mixed-action Soft Actor-Critic algorithm. The task is treated as a single-step contextual bandit. The model is validated against lifestyle medicine prescriptions issued by three certified physicians from Xiangya Hospital. These results demonstrate that offline mixed-action SAC can generate risk-aware lifestyle medicine prescriptions from cross-sectional NHANES data, warranting prospective clinical validation.