2.0LGSep 14, 2023
Learning Beyond Similarities: Incorporating Dissimilarities between Positive Pairs in Self-Supervised Time Series LearningAdrian Atienza, Jakob Bardram, Sadasivan Puthusserypady
By identifying similarities between successive inputs, Self-Supervised Learning (SSL) methods for time series analysis have demonstrated their effectiveness in encoding the inherent static characteristics of temporal data. However, an exclusive emphasis on similarities might result in representations that overlook the dynamic attributes critical for modeling cardiovascular diseases within a confined subject cohort. Introducing Distilled Encoding Beyond Similarities (DEBS), this paper pioneers an SSL approach that transcends mere similarities by integrating dissimilarities among positive pairs. The framework is applied to electrocardiogram (ECG) signals, leading to a notable enhancement of +10\% in the detection accuracy of Atrial Fibrillation (AFib) across diverse subjects. DEBS underscores the potential of attaining a more refined representation by encoding the dynamic characteristics of time series data, tapping into dissimilarities during the optimization process. Broadly, the strategy delineated in this study holds the promise of unearthing novel avenues for advancing SSL methodologies tailored to temporal data.
1.2SPJul 24, 2024
An Efficient and Flexible Deep Learning Method for Signal Delineation via Keypoints EstimationAdrian Atienza, Jakob Bardram, Sadasivan Puthusserypady
Deep Learning (DL) methods have been used for electrocardiogram (ECG) processing in a wide variety of tasks, demonstrating good performance compared with traditional signal processing algorithms. These methods offer an efficient framework with a limited need for apriori data pre-processing and feature engineering. While several studies use this approach for ECG signal delineation, a significant gap persists between the expected and the actual outcome. Existing methods rely on a sample-to-sample classifier. However, the clinical expected outcome consists of a set of onset, offset, and peak for the different waves that compose each R-R interval. To align the actual with the expected output, it is necessary to incorporate post-processing algorithms. This counteracts two of the main advantages of DL models, since these algorithms are based on assumptions and slow down the method's performance. In this paper, we present Keypoint Estimation for Electrocardiogram Delineation (KEED), a novel DL model designed for keypoint estimation, which organically offers an output aligned with clinical expectations. By standing apart from the conventional sample-to-sample classifier, we achieve two benefits: (i) Eliminate the need for additional post-processing, and (ii) Establish a flexible framework that allows the adjustment of the threshold value considering the sensitivity-specificity tradeoff regarding the particular clinical requirements. The proposed method's performance is compared with state-of-the-art (SOTA) signal processing methods. Remarkably, KEED significantly outperforms despite being optimized with an extremely limited annotated data. In addition, KEED decreases the inference time by a factor ranging from 52x to 703x.
2.3SPMay 21, 2024
NERULA: A Dual-Pathway Self-Supervised Learning Framework for Electrocardiogram Signal AnalysisGouthamaan Manimaran, Sadasivan Puthusserypady, Helena Domínguez et al.
Electrocardiogram (ECG) signals are critical for diagnosing heart conditions and capturing detailed cardiac patterns. As wearable single-lead ECG devices become more common, efficient analysis methods are essential. We present NERULA (Non-contrastive ECG and Reconstruction Unsupervised Learning Algorithm), a self-supervised framework designed for single-lead ECG signals. NERULA's dual-pathway architecture combines ECG reconstruction and non-contrastive learning to extract detailed cardiac features. Our 50% masking strategy, using both masked and inverse-masked signals, enhances model robustness against real-world incomplete or corrupted data. The non-contrastive pathway aligns representations of masked and inverse-masked signals, while the reconstruction pathway comprehends and reconstructs missing features. We show that combining generative and discriminative paths into the training spectrum leads to better results by outperforming state-of-the-art self-supervised learning benchmarks in various tasks, demonstrating superior performance in ECG analysis, including arrhythmia classification, gender classification, age regression, and human activity recognition. NERULA's dual-pathway design offers a robust, efficient solution for comprehensive ECG signal interpretation.
4.1LGMar 4, 2025
Leveraging Self-Supervised Learning Methods for Remote Screening of Subjects with Paroxysmal Atrial FibrillationAdrian Atienza, Gouthamaan Manimaran, Sadasivan Puthusserypady et al.
The integration of Artificial Intelligence (AI) into clinical research has great potential to reveal patterns that are difficult for humans to detect, creating impactful connections between inputs and clinical outcomes. However, these methods often require large amounts of labeled data, which can be difficult to obtain in healthcare due to strict privacy laws and the need for experts to annotate data. This requirement creates a bottleneck when investigating unexplored clinical questions. This study explores the application of Self-Supervised Learning (SSL) as a way to obtain preliminary results from clinical studies with limited sized cohorts. To assess our approach, we focus on an underexplored clinical task: screening subjects for Paroxysmal Atrial Fibrillation (P-AF) using remote monitoring, single-lead ECG signals captured during normal sinus rhythm. We evaluate state-of-the-art SSL methods alongside supervised learning approaches, where SSL outperforms supervised learning in this task of interest. More importantly, it prevents misleading conclusions that may arise from poor performance in the latter paradigm when dealing with limited cohort settings.
2.3SPMay 12, 2023
Subject-based Non-contrastive Self-Supervised Learning for ECG Signal ProcessingAdrian Atienza, Jakob Bardram, Sadasivan Puthusserypady
Extracting information from the electrocardiography (ECG) signal is an essential step in the design of digital health technologies in cardiology. In recent years, several machine learning (ML) algorithms for automatic extraction of information in ECG have been proposed. Supervised learning methods have successfully been used to identify specific aspects in the signal, like detection of rhythm disorders (arrhythmias). Self-supervised learning (SSL) methods, on the other hand, can be used to extract all the features contained in the data. The model is optimized without any specific goal and learns from the data itself. By adapting state-of-the-art computer vision methodologies to the signal processing domain, a few SSL approaches have been reported recently for ECG processing. However, such SSL methods require either data augmentation or negative pairs, which limits the method to only look for similarities between two ECG inputs, either two versions of the same signal or two signals from the same subject. This leads to models that are very effective at extracting characteristics that are stable in a subject, such as gender or age. But they are not successful at capturing changes within the ECG recording that can explain dynamic aspects, like different arrhythmias or different sleep stages. In this work, we introduce the first SSL method that uses neither data augmentation nor negative pairs for understanding ECG signals, and still, achieves comparable quality representations. As a result, it is possible to design a SSL method that not only captures similarities between two inputs, but also captures dissimilarities for a complete understanding of the data. In addition, a model based on transformer blocks is presented, which produces better results than a model based on convolutional layers (XResNet50) with almost the same number of parameters.
The CARP Mobile Sensing Framework -- A Cross-platform, Reactive, Programming Framework and Runtime Environment for Digital PhenotypingJakob E. Bardram
Mobile sensing - i.e., the ability to unobtrusively collect sensor data from built-in phone sensors - has long been a core research topic in Ubicomp. A number of technological platforms for mobile sensing have been presented over the years and a lot of knowledge on how to facilitate mobile sensing has been accumulated. This paper presents the CARP Mobile Sensing (CAMS) framework, which is a modern cross-platform (Android / iOS) software architecture providing a reactive and unified programming model that emphasizes extensibility, maintainability, and adaptability. Moreover, the CAMS framework supports sensing from wearable devices such as an electrocardiography (ECG) monitor, and configuring data transformers. The latter allows to transform collected data to a standardized data format and to implement privacy-preserving data transformations. The paper presents the design, architecture, implementation, and evaluation of CAMS, and shows how the framework has been used in two real-world mobile sensing and mobile health (mHealth) applications. We conclude that CAMS provides a novel cross-platform application programming framework which has proved mature, stable, scalable, and flexible in the design of digital phenotyping and mHealth applications
3.0HCOct 10, 2018
The Hidden Cost of Window ManagementSteven Jeuris, Paolo Tell, Steven Houben et al.
Most window management systems support multitasking by allowing users to open, resize, position, and switch between application windows. Although multitasking has become a way of life for most knowledge workers, our current understanding of how users use window management features to switch between multiple tasks---which may comprise multiple application windows---is limited. In this paper, we present a study providing an in-depth analysis of how task switching is supported in Windows 7. As part of analysis, we developed an interface-agnostic classification of common task switching operations supported by window managers which can be used to quantify the time spent on each constituting action. Our study shows that task switching is a time intensive activity and highlights the dominant actions that contribute to task switch time. Furthermore, our classification highlights the specific operations that are optimized by more recent and experimental window managers and allows identifying opportunities for design that could further reduce the overhead of switching between tasks.