Deep Optics for Video Snapshot Compressive ImagingPing Wang, Lishun Wang, Xin Yuan
Video snapshot compressive imaging (SCI) aims to capture a sequence of video frames with only a single shot of a 2D detector, whose backbones rest in optical modulation patterns (also known as masks) and a computational reconstruction algorithm. Advanced deep learning algorithms and mature hardware are putting video SCI into practical applications. Yet, there are two clouds in the sunshine of SCI: i) low dynamic range as a victim of high temporal multiplexing, and ii) existing deep learning algorithms' degradation on real system. To address these challenges, this paper presents a deep optics framework to jointly optimize masks and a reconstruction network. Specifically, we first propose a new type of structural mask to realize motion-aware and full-dynamic-range measurement. Considering the motion awareness property in measurement domain, we develop an efficient network for video SCI reconstruction using Transformer to capture long-term temporal dependencies, dubbed Res2former. Moreover, sensor response is introduced into the forward model of video SCI to guarantee end-to-end model training close to real system. Finally, we implement the learned structural masks on a digital micro-mirror device. Experimental results on synthetic and real data validate the effectiveness of the proposed framework. We believe this is a milestone for real-world video SCI. The source code and data are available at https://github.com/pwangcs/DeepOpticsSCI.
1.4CVApr 18, 2021
An Improved Discriminative Optimization for 3D Rigid Point Cloud RegistrationJia Wang, Ping Wang, Biao Li et al.
The Discriminative Optimization (DO) algorithm has been proved much successful in 3D point cloud registration. In the original DO, the feature (descriptor) of two point cloud was defined as a histogram, and the element of histogram indicates the weights of scene points in "front" or "back" side of a model point. In this paper, we extended the histogram which indicate the sides from "front-back" to "front-back", "up-down", and "clockwise-anticlockwise". In addition, we reweighted the extended histogram according to the model points' distribution. We evaluated the proposed Improved DO on the Stanford Bunny and Oxford SensatUrban dataset, and compared it with six classical State-Of-The-Art point cloud registration algorithms. The experimental result demonstrates our algorithm achieves comparable performance in point registration accuracy and root-mean-sqart-error.
6.6CRMar 28, 2021
Privacy-Assured Outsourcing of Compressed Sensing Reconstruction Service in CloudPing Wang
Compressed sensing (CS), breaking the constriction of Shannon-Nyquist sampling theorem, is a very promising data acquisition technique in the era of multimedia big data. However, the high complexity of CS reconstruction algorithm is a big trouble for endusers who are hardly provided with great computing power. The combination of CS and cloud has the potential of freeing endusers from the resource constraint by cleverly transforming computational workload from the local cilent to the cloud platform. As a result, the low-complexity encoding virtue of CS is fully leveraged in the resource-constrained sensing devices but its highcomplexity decoding problem is effectively addressed in cloud. It seems to be perfect but privacy and security concerns are ignored. In this paper, a secure outsourcing scheme for CS reconstruction service is proposed. Experimental results and security analyses demonstrate that the proposed scheme can restrict malicious access, verify the integrity of the recovered data, and resist brute-force attack, ciphertext-only attack, and plaintext attack.