Shuai Ye

h-index6
2papers
149citations

2 Papers

1.5CVSep 13, 2023Code
Video Infringement Detection via Feature Disentanglement and Mutual Information Maximization

Zhenguang Liu, Xinyang Yu, Ruili Wang et al.

The self-media era provides us tremendous high quality videos. Unfortunately, frequent video copyright infringements are now seriously damaging the interests and enthusiasm of video creators. Identifying infringing videos is therefore a compelling task. Current state-of-the-art methods tend to simply feed high-dimensional mixed video features into deep neural networks and count on the networks to extract useful representations. Despite its simplicity, this paradigm heavily relies on the original entangled features and lacks constraints guaranteeing that useful task-relevant semantics are extracted from the features. In this paper, we seek to tackle the above challenges from two aspects: (1) We propose to disentangle an original high-dimensional feature into multiple sub-features, explicitly disentangling the feature into exclusive lower-dimensional components. We expect the sub-features to encode non-overlapping semantics of the original feature and remove redundant information. (2) On top of the disentangled sub-features, we further learn an auxiliary feature to enhance the sub-features. We theoretically analyzed the mutual information between the label and the disentangled features, arriving at a loss that maximizes the extraction of task-relevant information from the original feature. Extensive experiments on two large-scale benchmark datasets (i.e., SVD and VCSL) demonstrate that our method achieves 90.1% TOP-100 mAP on the large-scale SVD dataset and also sets the new state-of-the-art on the VCSL benchmark dataset. Our code and model have been released at https://github.com/yyyooooo/DMI/, hoping to contribute to the community.

2.3NAMay 24, 2016
Generalized multiscale finite element methods for space-time heterogeneous parabolic equations

Eric T. Chung, Yalchin Efendiev, Wing Tat Leung et al.

In this paper, we consider local multiscale model reduction for problems with multiple scales in space and time. We developed our approaches within the framework of the Generalized Multiscale Finite Element Method (GMsFEM) using space-time coarse cells. The main idea of GMsFEM is to construct a local snapshot space and a local spectral decomposition in the snapshot space. Previous research in developing multiscale spaces within GMsFEM focused on constructing multiscale spaces and relevant ingredients in space only. In this paper, our main objective is to develop a multiscale model reduction framework within GMsFEM that uses space-time coarse cells. We construct space-time snapshot and offline spaces. We compute these snapshot solutions by solving local problems. A complete snapshot space will use all possible boundary conditions; however, this can be very expensive. We propose using randomized boundary conditions and oversampling. We construct the local spectral decomposition based on our analysis, as presented in the paper. We present numerical results to confirm our theoretical findings and to show that using our proposed approaches, we can obtain an accurate solution with low dimensional coarse spaces. We remark that the proposed method is a significant extension compared to existing methods, which use coarse cells in space only because of (1) the parabolic nature of cell solutions, (2) extra degrees of freedom associated with space-time cells, and (3) local boundary conditions in space-time cells.