The Patient/Industry Trade-off in Medical Artificial Intelligence
This work tackles the challenge of balancing patient and industry interests in medical AI for researchers and clinicians, but it is incremental as it builds on existing critiques without introducing new technical methods.
The paper addresses the trade-off between patient benefits and industry interests in medical AI, highlighting that current research often lacks clinically relevant metrics, validation through trials, and stakeholder involvement, which hampers clinical integration. It proposes improved transparency, selective industry partnerships, and prioritizing healthcare benefits to bridge this gap.
Artificial intelligence (AI) in healthcare has led to many promising developments; however, increasingly, AI research is funded by the private sector leading to potential trade-offs between benefits to patients and benefits to industry. Health AI practitioners should prioritize successful adaptation into clinical practice in order to provide meaningful benefits to patients, but translation usually requires collaboration with industry. We discuss three features of AI studies that hamper the integration of AI into clinical practice from the perspective of researchers and clinicians. These include lack of clinically relevant metrics, lack of clinical trials and longitudinal studies to validate results, and lack of patient and physician involvement in the development process. For partnerships between industry and health research to be sustainable, a balance must be established between patient and industry benefit. We propose three approaches for addressing this gap: improved transparency and explainability of AI models, fostering relationships with industry partners that have a reputation for centering patient benefit in their practices, and prioritization of overall healthcare benefits. With these priorities, we can sooner realize meaningful AI technologies used by clinicians where mutua