Damon Berry

Rashmi Bakshi, Jane Courtney, Damon Berry et al.

The process of hand washing, according to the WHO, is divided into stages with clearly defined two handed dynamic gestures. In this paper, videos of hand washing experts are segmented and analyzed with the goal of extracting their corresponding features. These features can be further processed in software to classify particular hand movements, determine whether the stages have been successfully completed by the user and also assess the quality of washing. Having identified the important features, a 3D gesture tracker, the Leap Motion Controller (LEAP), was used to track and detect the hand features associated with these stages. With the help of sequential programming and threshold values, the hand features were combined together to detect the initiation and completion of a sample WHO Stage 2 (Rub hands Palm to Palm). The LEAP provides accurate raw positional data for tracking single hand gestures and two hands in separation but suffers from occlusion when hands are in contact. Other than hand hygiene the approaches shown here can be applied in other biomedical applications requiring close hand gesture analysis.

Rashmi Bakshi, Jane Courtney, Damon Berry et al.

The process of hand washing involves complex hand movements. There are six principal sequential steps for washing hands as per the World Health Organisation (WHO) guidelines. In this work, a detailed description of an aluminium rig construction for creating a robust hand-washing dataset is discussed. The preliminary results with the help of image processing and computer vision algorithms for hand pose extraction and feature detection such as Harris detector, Shi-Tomasi and SIFT are demonstrated. The hand hygiene pose- Rub hands palm to palm was captured as an input image for running all the experiments. The future work will focus upon processing the video recordings of hand movements captured and applying deep-learning solutions for the classification of hand-hygiene stages.

Matteo Zallio, Paula Kelly, Barry Cryan et al.

Our environment, whether at work, in public spaces, or at home, is becoming more connected, and increasingly responsive. Meal preparation even when it involves simply heating ready-made food can be perceived as a complex process for people with disabilities. This research aimed to prototype, using a co-Design approach a Community Supported Appliance (CSA) by developing a Domain Specific Language (DSL), precisely created for a semi-automated cooking process. The DSL was shaped and expressed in the idiom of the users and allowed the CSA to support independence for users while performing daily cooking activities.

Matteo Zallio, John McGrory, Damon Berry

The global introduction of affordable Internet of Things (IoT) devices offers an opportunity to empower a large variety of users with different needs. However, many off-the-shelf digital products are still not widely adopted by people who are hesitant technology users or by older adults, notwithstanding that the design and user-interaction of these devices is recognized to be user-friendly. In view of the potential of IoT-based devices, how can we reduce the obstacles of a cohort with low digital literacy and technology anxiety and enable them to be equal participants in the digitalized world? This article shows the method and results achieved in a community-stakeholder workshop, developed through the participatory design methodology, aiming at brainstorming problems and scenarios through a focus group and a structured survey. The research activity focused on understanding factors to increase the usability of off-the-shelf IoT devices for hesitant users and identify strategies for improving digital literacy and reducing technology anxiety. A notable result was a series of feedback items pointing to the importance of creating learning resources to support individuals with different abilities, age, gender expression, to better adopt off-the-shelf IoT-based solutions.