Xing Wei

Shaolei Yang, Shen Cheng, Mingbo Hong et al.

In this paper, we propose Neural Spectrum Decomposition, a generic decomposition framework for dataset distillation. Unlike previous methods, we consider the entire dataset as a high-dimensional observation that is low-rank across all dimensions. We aim to discover the low-rank representation of the entire dataset and perform distillation efficiently. Toward this end, we learn a set of spectrum tensors and transformation matrices, which, through simple matrix multiplication, reconstruct the data distribution. Specifically, a spectrum tensor can be mapped back to the image space by a transformation matrix, and efficient information sharing during the distillation learning process is achieved through pairwise combinations of different spectrum vectors and transformation matrices. Furthermore, we integrate a trajectory matching optimization method guided by a real distribution. Our experimental results demonstrate that our approach achieves state-of-the-art performance on benchmarks, including CIFAR10, CIFAR100, Tiny Imagenet, and ImageNet Subset. Our code are available at \url{https://github.com/slyang2021/NSD}.

Xing Wei, Chenyang Yang, Shengqian Han

Proactive tile-based video streaming can avoid motion-to-photon latency of wireless virtual reality (VR) by computing and delivering the predicted tiles to be requested before playback. All existing works either focus on designing predictors or allocating computing and communications resources. Yet to avoid the latency, the successively executed prediction, communication, and computing tasks should be accomplished within a predetermined time. Moreover, the quality of experience (QoE) of proactive VR streaming depends on the worst performance of the three tasks. In this paper, we jointly optimize the duration of the observation window for predicting tiles and the durations for computing and transmitting the predicted tiles, aimed at balancing the performance for three tasks to maximize the QoE given arbitrary predictor and configured resources. We obtain the closed-form optimal solution by decomposing the formulated problem equivalently into two subproblems. With the optimized durations, we find a resource-limited region where the QoE increases rapidly with configured resources, and a prediction-limited region where the QoE can be improved more efficiently with a better predictor. Simulation results using three existing predictors and a real dataset validate the analysis and demonstrate the gain from the joint optimization over non-optimized counterparts.