CVApr 11, 2024

Resolve Domain Conflicts for Generalizable Remote Physiological Measurement

arXiv:2404.07855v117 citationsh-index: 9Has CodeMM
Originality Incremental advance
AI Analysis

This work addresses generalizability issues in rPPG for applications like healthcare and emotion analysis, but it is incremental as it builds on existing methods by focusing on domain conflicts.

The paper tackled the problem of domain conflicts in remote photoplethysmography (rPPG) for physiological measurement, such as label and attribute conflicts across datasets, and introduced the DOHA framework, which significantly improved performance under multiple protocols.

Remote photoplethysmography (rPPG) technology has become increasingly popular due to its non-invasive monitoring of various physiological indicators, making it widely applicable in multimedia interaction, healthcare, and emotion analysis. Existing rPPG methods utilize multiple datasets for training to enhance the generalizability of models. However, they often overlook the underlying conflict issues across different datasets, such as (1) label conflict resulting from different phase delays between physiological signal labels and face videos at the instance level, and (2) attribute conflict stemming from distribution shifts caused by head movements, illumination changes, skin types, etc. To address this, we introduce the DOmain-HArmonious framework (DOHA). Specifically, we first propose a harmonious phase strategy to eliminate uncertain phase delays and preserve the temporal variation of physiological signals. Next, we design a harmonious hyperplane optimization that reduces irrelevant attribute shifts and encourages the model's optimization towards a global solution that fits more valid scenarios. Our experiments demonstrate that DOHA significantly improves the performance of existing methods under multiple protocols. Our code is available at https://github.com/SWY666/rPPG-DOHA.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes