PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring
This provides a foundational resource for researchers in driver monitoring and smart-cockpit systems, though it is incremental as it focuses on dataset creation rather than novel algorithmic breakthroughs.
The authors tackled the lack of comprehensive datasets for remote physiological measurement in driving scenarios by introducing PhysDrive, a large-scale multimodal dataset with data from 48 drivers, six synchronized ground truths, and coverage of various driving conditions, establishing benchmarks that show deep-learning methods achieve up to 95% accuracy in heart rate estimation.
Robust and unobtrusive in-vehicle physiological monitoring is crucial for ensuring driving safety and user experience. While remote physiological measurement (RPM) offers a promising non-invasive solution, its translation to real-world driving scenarios is critically constrained by the scarcity of comprehensive datasets. Existing resources are often limited in scale, modality diversity, the breadth of biometric annotations, and the range of captured conditions, thereby omitting inherent real-world challenges in driving. Here, we present PhysDrive, the first large-scale multimodal dataset for contactless in-vehicle physiological sensing with dedicated consideration on various modality settings and driving factors. PhysDrive collects data from 48 drivers, including synchronized RGB, near-infrared camera, and raw mmWave radar data, accompanied with six synchronized ground truths (ECG, BVP, Respiration, HR, RR, and SpO2). It covers a wide spectrum of naturalistic driving conditions, including driver motions, dynamic natural light, vehicle types, and road conditions. We extensively evaluate both signal-processing and deep-learning methods on PhysDrive, establishing a comprehensive benchmark across all modalities, and release full open-source code with compatibility for mainstream public toolboxes. We envision PhysDrive will serve as a foundational resource and accelerate research on multimodal driver monitoring and smart-cockpit systems.