Clustering Residential Electricity Consumption Data to Create Archetypes that Capture Household Behaviour in South Africa
This work addresses the challenge of creating customer archetypes for energy planning in South Africa, offering a method that is incremental but improves transparency and accessibility for data scientists with limited domain expertise.
The paper tackled the problem of selecting useful clusters for residential electricity consumption data in South Africa by formalizing expert knowledge as external evaluation measures, enabling the reconstruction of expert-developed customer archetypes with a transparent and repeatable approach.
Clustering is frequently used in the energy domain to identify dominant electricity consumption patterns of households, which can be used to construct customer archetypes for long term energy planning. Selecting a useful set of clusters however requires extensive experimentation and domain knowledge. While internal clustering validation measures are well established in the electricity domain, they are limited for selecting useful clusters. Based on an application case study in South Africa, we present an approach for formalising implicit expert knowledge as external evaluation measures to create customer archetypes that capture variability in residential electricity consumption behaviour. By combining internal and external validation measures in a structured manner, we were able to evaluate clustering structures based on the utility they present for our application. We validate the selected clusters in a use case where we successfully reconstruct customer archetypes previously developed by experts. Our approach shows promise for transparent and repeatable cluster ranking and selection by data scientists, even if they have limited domain knowledge.