LGMar 27, 2024Code
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual LearningHuiyi Wang, Haodong Lu, Lina Yao et al.
Continual learning (CL) aims to continually accumulate knowledge from a non-stationary data stream without catastrophic forgetting of learned knowledge, requiring a balance between stability and adaptability. Relying on the generalizable representation in pre-trained models (PTMs), PTM-based CL methods perform effective continual adaptation on downstream tasks by adding learnable adapters or prompts upon the frozen PTMs. However, many existing PTM-based CL methods use restricted adaptation on a fixed set of these modules to avoid forgetting, suffering from limited CL ability. Periodically adding task-specific modules results in linear model growth rate and impaired knowledge reuse. We propose Self-Expansion of pre-trained models with Modularized Adaptation (SEMA), a novel approach to enhance the control of stability-plasticity balance in PTM-based CL. SEMA automatically decides to reuse or add adapter modules on demand in CL, depending on whether significant distribution shift that cannot be handled is detected at different representation levels. We design modular adapter consisting of a functional adapter and a representation descriptor. The representation descriptors are trained as a distribution shift indicator and used to trigger self-expansion signals. For better composing the adapters, an expandable weighting router is learned jointly for mixture of adapter outputs. SEMA enables better knowledge reuse and sub-linear expansion rate. Extensive experiments demonstrate the effectiveness of the proposed self-expansion method, achieving state-of-the-art performance compared to PTM-based CL methods without memory rehearsal. Code is available at https://github.com/huiyiwang01/SEMA-CL.
CYMay 17
Building Resilience to Misinformation: A Cross-National Development of the Digital Media and Information Literacy Scale (DMILS)Sijia Qian, Cuihua Shen, Huiyi Wang et al.
Amid growing concern about information quality and credibility in digital media environments, researchers and educators still lack a concise, comprehensive yet psychometrically sound instrument for tracking the competencies that help people navigate this landscape. This article develops the Digital Media and Information Literacy Scale (DMILS), a robust and multidimensional measure that distinguishes domain (digital vs. information/news), competency type (knowledge vs. skill), and is measured through both subjective and objective items. Through two empirical studies with three nationally matched samples in the United States and Singapore (N = 1,498), we developed an 18-item self-report battery and 16-item objective knowledge questions, showing strong structural, convergent, and predictive validity, along with a short form (8 self-report and 8 objective items). By offering a parsimonious yet multidimensional yardstick, DMILS enables rigorous evaluation of media literacy interventions and supplies a common metric for cross-national research, critical for building an information ecosystem resilient to mis- and disinformation.
SEDec 20, 2020
Market-level Analysis of Government-backed COVID-19 Contact Tracing AppsHuiyi Wang, Liu Wang, Haoyu Wang
To help curb the spread of the COVID-19 pandemic, governments and public health authorities around the world have launched a number of contact-tracing apps. Although contact tracing apps have received extensive attentions from the research community, no existing work has characterized the users' adoption of contact tracing apps from the app market level. In this work, we perform the first market-level analysis of contact tracing apps. We perform a longitudinal empirical study (over 4 months) of eight government-backed COVID-19 contact tracing apps in iOS app store. We first collect all the daily meta information (e.g., app updates, app rating, app comments, etc.) of these contact tracing apps from their launch to 2020-07-31. Then we characterize them from release practice, app popularity, and mobile users' feedback. Our study reveals various issues related to contact tracing apps from the users' perspective, hoping to help improve the quality of contact tracing apps and thus achieving a high level of adoption in the population.