RARR : Robust Real-World Activity Recognition with Vibration by Scavenging Near-Surface Audio Online
This work addresses remote monitoring for dementia patients living alone, offering a privacy-preserving and scalable solution, though it is incremental in improving model generalizability with limited data.
The paper tackles the problem of robust real-world activity recognition for remote dementia care by using structural vibration sensors, achieving accurate monitoring with very limited labeled data through a framework that adapts synthesized audio data for pretraining and fine-tuning.
One in four people dementia live alone, leading family members to take on caregiving roles from a distance. Many researchers have developed remote monitoring solutions to lessen caregiving needs; however, limitations remain including privacy preserving solutions, activity recognition, and model generalizability to new users and environments. Structural vibration sensor systems are unobtrusive solutions that have been proven to accurately monitor human information, such as identification and activity recognition, in controlled settings by sensing surface vibrations generated by activities. However, when deploying in an end user's home, current solutions require a substantial amount of labeled data for accurate activity recognition. Our scalable solution adapts synthesized data from near-surface acoustic audio to pretrain a model and allows fine tuning with very limited data in order to create a robust framework for daily routine tracking.