Sit-to-Stand Analysis in the Wild using Silhouettes for Longitudinal Health Monitoring
This enables longitudinal health monitoring for patients, such as those recovering from hip or knee replacement, though it is incremental as it builds on existing silhouette-based methods.
The paper tackles the problem of automated Sit-to-Stand analysis for health monitoring in free-living environments, achieving 94.4% accuracy in coarse localisation and a 0.026 m/s error in speed measurement to track patient recovery after surgery.
We present the first fully automated Sit-to-Stand or Stand-to-Sit (StS) analysis framework for long-term monitoring of patients in free-living environments using video silhouettes. Our method adopts a coarse-to-fine time localisation approach, where a deep learning classifier identifies possible StS sequences from silhouettes, and a smart peak detection stage provides fine localisation based on 3D bounding boxes. We tested our method on data from real homes of participants and monitored patients undergoing total hip or knee replacement. Our results show 94.4% overall accuracy in the coarse localisation and an error of 0.026 m/s in the speed of ascent measurement, highlighting important trends in the recuperation of patients who underwent surgery.