SMART: Scene-motion-aware human action recognition framework for mental disorder groupZengyuan Lai, Jiarui Yang, Songpengcheng Xia et al.
Patients with mental disorders often exhibit risky abnormal actions, such as climbing walls or hitting windows, necessitating intelligent video behavior monitoring for smart healthcare with the rising Internet of Things (IoT) technology. However, the development of vision-based Human Action Recognition (HAR) for these actions is hindered by the lack of specialized algorithms and datasets. In this paper, we innovatively propose to build a vision-based HAR dataset including abnormal actions often occurring in the mental disorder group and then introduce a novel Scene-Motion-aware Action Recognition Technology framework, named SMART, consisting of two technical modules. First, we propose a scene perception module to extract human motion trajectory and human-scene interaction features, which introduces additional scene information for a supplementary semantic representation of the above actions. Second, the multi-stage fusion module fuses the skeleton motion, motion trajectory, and human-scene interaction features, enhancing the semantic association between the skeleton motion and the above supplementary representation, thus generating a comprehensive representation with both human motion and scene information. The effectiveness of our proposed method has been validated on our self-collected HAR dataset (MentalHAD), achieving 94.9% and 93.1% accuracy in un-seen subjects and scenes and outperforming state-of-the-art approaches by 6.5% and 13.2%, respectively. The demonstrated subject- and scene- generalizability makes it possible for SMART's migration to practical deployment in smart healthcare systems for mental disorder patients in medical settings. The code and dataset will be released publicly for further research: https://github.com/Inowlzy/SMART.git.
6.4LGNov 12, 2024
Suite-IN: Aggregating Motion Features from Apple Suite for Robust Inertial NavigationLan Sun, Songpengcheng Xia, Junyuan Deng et al.
With the rapid development of wearable technology, devices like smartphones, smartwatches, and headphones equipped with IMUs have become essential for applications such as pedestrian positioning. However, traditional pedestrian dead reckoning (PDR) methods struggle with diverse motion patterns, while recent data-driven approaches, though improving accuracy, often lack robustness due to reliance on a single device.In our work, we attempt to enhance the positioning performance using the low-cost commodity IMUs embedded in the wearable devices. We propose a multi-device deep learning framework named Suite-IN, aggregating motion data from Apple Suite for inertial navigation. Motion data captured by sensors on different body parts contains both local and global motion information, making it essential to reduce the negative effects of localized movements and extract global motion representations from multiple devices.
1.2NAJul 20, 2010
Quantifying Uncertainties in Complex SystemsJiarui Yang, Jinqiao Duan
Uncertainties are abundant in complex systems. Mathematical models for these systems thus contain random effects or noises. The models are often in the form of stochastic differential equations, with some parameters to be determined by observations. The stochastic differential equations may be driven by Brownian motion, fractional Brownian motion or Lévy motion. After a brief overview of recent advances in estimating parameters in stochastic differential equations, various numerical algorithms for computing parameters are implemented. The numerical simulation results are shown to be consistent with theoretical analysis. Moreover, for fractional Brownian motion and $α-$stable Lévy motion, several algorithms are reviewed and implemented to numerically estimate the Hurst parameter $H$ and characteristic exponent $α$.