Geometric-k-means: A Bound Free Approach to Fast and Eco-Friendly k-means
This provides a more efficient and eco-friendly alternative for users of the widely used k-means algorithm, though it appears incremental as it builds on existing k-means methods.
The paper tackles the problem of improving the efficiency and energy consumption of the k-means algorithm by introducing Geometric-k-means, which uses geometric principles to accelerate computations without quality loss, resulting in significant runtime and distance computation reductions compared to traditional and state-of-the-art variants.
This paper introduces Geometric-k-means (or Gk-means for short), a novel approach that significantly enhances the efficiency and energy economy of the widely utilized k-means algorithm, which, despite its inception over five decades ago, remains a cornerstone in machine learning applications. The essence of Gk-means lies in its active utilization of geometric principles, specifically scalar projection, to significantly accelerate the algorithm without sacrificing solution quality. This geometric strategy enables a more discerning focus on data points that are most likely to influence cluster updates, which we call as high expressive data (HE). In contrast, low expressive data (LE), does not impact clustering outcome, is effectively bypassed, leading to considerable reductions in computational overhead. Experiments spanning synthetic, real-world and high-dimensional datasets, demonstrate Gk-means is significantly better than traditional and state of the art (SOTA) k-means variants in runtime and distance computations (DC). Moreover, Gk-means exhibits better resource efficiency, as evidenced by its reduced energy footprint, placing it as more sustainable alternative.