Ethical conceptual replication of visualization research considering sources of methodological bias and practical significance
This addresses methodological rigor and generalizability issues in visualization research, though it appears incremental as it builds on existing principles rather than introducing new ones.
The paper argues for emphasizing conceptual replication in visualization research to assess how established design principles hold across different contexts and users, focusing on practical significance and reducing methodological biases to lay groundwork for visualization meta-science.
General design principles for visualization have been relatively well-established based on a combination of cognitive and perceptual theory and empirical evaluations over the past 20 years. To determine how these principles hold up across use contexts and end-users, I argue that we should emphasize conceptual replication focused on determining practical significance and reducing methodological biases. This shift in thinking aims to determine how design principles interact with methodological approaches, laying the groundwork for visualization meta-science.