Data Profiling for Change Rules
For database and data quality researchers, this work provides a novel dependency for trend analysis and causal relationships, but the improvement is incremental over existing methods.
The paper introduces Change Rules (CRs) to model sequential changes in ordered tuples, addressing limitations of existing data quality rules. CR-Miner achieves 40-50% average runtime improvement over baselines.
Understanding data change is critical towards understanding trends, normal vs. abnormal behaviours, recognizing patterns, and the causes of change. Existing database systems have limited support for change management, relying on statistics, triggers, and constraints. Data quality rules model sequential changes along a restricted set of attributes, quantify change among unordered tuples, and have limited ability to model the context under which attribute changes occur. In this paper, we introduce Change Rules (CRs) that quantify the sequential changes among ordered tuples in both the antecedent and consequent attributes. CRs aim to address the limitations of existing declarative dependencies to support trend analysis and causal relationships that trigger change among attributes. We propose CR-Miner, an automated algorithm for CR discovery that generates candidate change intervals in a level-wise manner. Experimental results show that CR-Miner achieves an average runtime improvement of 40-50% over existing baselines.