Dan Lin

Ruoyu Wang, Chen Cai, Wenqian Wang et al.

Driver action recognition has significantly advanced in enhancing driver-vehicle interactions and ensuring driving safety by integrating multiple modalities, such as infrared and depth. Nevertheless, compared to RGB modality only, it is always laborious and costly to collect extensive data for all types of non-RGB modalities in car cabin environments. Therefore, previous works have suggested independently learning each non-RGB modality by fine-tuning a model pre-trained on RGB videos, but these methods are less effective in extracting informative features when faced with newly-incoming modalities due to large domain gaps. In contrast, we propose a Continual Cross-Modal Mapping Network (CM2-Net) to continually learn each newly-incoming modality with instructive prompts from the previously-learned modalities. Specifically, we have developed Accumulative Cross-modal Mapping Prompting (ACMP), to map the discriminative and informative features learned from previous modalities into the feature space of newly-incoming modalities. Then, when faced with newly-incoming modalities, these mapped features are able to provide effective prompts for which features should be extracted and prioritized. These prompts are accumulating throughout the continual learning process, thereby boosting further recognition performances. Extensive experiments conducted on the Drive&Act dataset demonstrate the performance superiority of CM2-Net on both uni- and multi-modal driver action recognition.

Wei Jiang, Adam Bowers, Dan Lin

Social networks, instant messages and file sharing systems are common communication means among friends, families, coworkers, etc. Due to concerns of personal privacy, identify thefts, data misuse, freedom of speech and government surveillance, online social or communication networks have provided various options for a user to guard or control his or her personal data. However, for most these services, user data are still accessible by the service providers, which can lead to both liability issues if data breach occurs at the server side and data misuse by the network administrators. To prevent service providers from accessing user data, secure end-to-end user communication is a must, like the one provided by WhatsApp. On the other hand, the services provided by such communication network can still be interfered by an authority. For a communication network to be stealthy, the following features are essential: (1) oblivious service, (2) complete user control and flexibility, and (3) lightweight. In this paper, we first discuss the features and benefits of a stealth communication network (SNET), and then we propose a theoretical framework that can be adopted to implement an SNET. By utilizing the framework and the existing publicly available cloud storage, we present the implementation details of an instance of SNET, named Secret-Share. Last but not least, we discuss the current limitations of Secret-Share and its potential extensions.