When Similarity Digest Meets Vector Management System: A Survey on Similarity Hash Function
This incremental work addresses the need for efficient similarity analysis in vector management systems, primarily for researchers and practitioners in data management.
The paper surveyed existing similarity hash functions to identify suitable ones for vector management systems, concluding that MinHash, Nilsimsa, and variants like SimHash and feature hashing are best for large-scale similarity analysis.
The booming vector manage system calls for feasible similarity hash function as a front-end to perform similarity analysis. In this paper, we make a systematical survey on the existent well-known similarity hash functions to tease out the satisfied ones. We conclude that the similarity hash function MinHash and Nilsimsa can be directly marshaled into the pipeline of similarity analysis using vector manage system. After that, we make a brief and empirical discussion on the performance, drawbacks of the these functions and highlight MinHash, the variant of SimHash and feature hashing are the best for vector management system for large-scale similarity analysis.