Thistle: A Vector Database in Rust
This work addresses latent knowledge search for start-ups and search engine companies, but it is incremental as it uses existing algorithms.
The authors tackled the problem of latent knowledge use in search queries by implementing Thistle, a fully functional vector database in Rust, and benchmarked it on the MS MARCO dataset to clarify the domain and Rust ML ecosystem.
We present Thistle, a fully functional vector database. Thistle is an entry into the domain of latent knowledge use in answering search queries, an ongoing research topic at both start-ups and search engine companies. We implement Thistle with several well-known algorithms, and benchmark results on the MS MARCO dataset. Results help clarify the latent knowledge domain as well as the growing Rust ML ecosystem.