Generate-then-Retrieve: Intent-Aware FAQ Retrieval in Product Search
This work addresses the challenge of providing efficient post-purchase support and informed decision-making for customers in e-commerce, representing an incremental improvement in domain-specific retrieval systems.
The paper tackled the problem of integrating FAQ retrieval into product search by proposing an intent-aware system that predicts when FAQs can answer user queries and rewrites queries into natural questions, resulting in a 13% improvement in Hit@1 and a 95% reduction in latency compared to baselines.
Customers interacting with product search engines are increasingly formulating information-seeking queries. Frequently Asked Question (FAQ) retrieval aims to retrieve common question-answer pairs for a user query with question intent. Integrating FAQ retrieval in product search can not only empower users to make more informed purchase decisions, but also enhance user retention through efficient post-purchase support. Determining when an FAQ entry can satisfy a user's information need within product search, without disrupting their shopping experience, represents an important challenge. We propose an intent-aware FAQ retrieval system consisting of (1) an intent classifier that predicts when a user's information need can be answered by an FAQ; (2) a reformulation model that rewrites a query into a natural question. Offline evaluation demonstrates that our approach improves Hit@1 by 13% on retrieving ground-truth FAQs, while reducing latency by 95% compared to baseline systems. These improvements are further validated by real user feedback, where 71% of displayed FAQs on top of product search results received explicit positive user feedback. Overall, our findings show promising directions for integrating FAQ retrieval into product search at scale.