Pattern Discovery and Validation Using Scientific Research Methods
This work addresses the need for more rigorous pattern validation in fields relying on pattern analysis, though it is incremental as it adapts existing scientific methods to this domain.
The paper tackles the problem of ad-hoc pattern discovery and validation by proposing the handbook method, which applies scientific research methods like qualitative surveys and case studies, and demonstrates its usefulness through three exploratory studies.
Pattern discovery, the process of discovering previously unrecognized patterns, is often performed as an ad-hoc process with little resulting certainty in the quality of the proposed patterns. Pattern validation, the process of validating the accuracy of proposed patterns, remains dominated by the simple heuristic of "the rule of three". This article shows how to use established scientific research methods for the purpose of pattern discovery and validation. We present a specific approach, called the handbook method, that uses the qualitative survey, action research, and case study research for pattern discovery and evaluation, and we discuss the underlying principle of using scientific methods in general. We evaluate the handbook method using three exploratory studies and demonstrate its usefulness.