Relationship-aware Multivariate Sampling Strategy for Scientific Simulation Data
This work addresses the need for scalable post-hoc analyses of large multivariate scientific data, though it is incremental as it builds on existing univariate sampling methods.
The authors tackled the problem of sampling multivariate scientific simulation data to reduce storage while preserving variable relationships, proposing a strategy that uses principal component analysis and partitioning schemes, and demonstrated its efficacy on two real-world datasets with improved data reduction and analysis capabilities.
With the increasing computational power of current supercomputers, the size of data produced by scientific simulations is rapidly growing. To reduce the storage footprint and facilitate scalable post-hoc analyses of such scientific data sets, various data reduction/summarization methods have been proposed over the years. Different flavors of sampling algorithms exist to sample the high-resolution scientific data, while preserving important data properties required for subsequent analyses. However, most of these sampling algorithms are designed for univariate data and cater to post-hoc analyses of single variables. In this work, we propose a multivariate sampling strategy which preserves the original variable relationships and enables different multivariate analyses directly on the sampled data. Our proposed strategy utilizes principal component analysis to capture the variance of multivariate data and can be built on top of any existing state-of-the-art sampling algorithms for single variables. In addition, we also propose variants of different data partitioning schemes (regular and irregular) to efficiently model the local multivariate relationships. Using two real-world multivariate data sets, we demonstrate the efficacy of our proposed multivariate sampling strategy with respect to its data reduction capabilities as well as the ease of performing efficient post-hoc multivariate analyses.