Demo: TOSense -- What Did You Just Agree to?
This addresses information asymmetry and legal risks for users of online services, though it is incremental as it builds on existing methods like lightweight LLMs and automated evaluation.
The paper tackles the problem of users agreeing to lengthy and obscure Terms of Service (ToS) by proposing TOSense, a Chrome extension that allows users to ask questions about ToS in natural language and get concise answers in real time, achieving up to 44.5% accuracy in experiments on five major platforms.
Online services often require users to agree to lengthy and obscure Terms of Service (ToS), leading to information asymmetry and legal risks. This paper proposes TOSense-a Chrome extension that allows users to ask questions about ToS in natural language and get concise answers in real time. The system combines (i) a crawler "tos-crawl" that automatically extracts ToS content, and (ii) a lightweight large language model pipeline: MiniLM for semantic retrieval and BART-encoder for answer relevance verification. To avoid expensive manual annotation, we present a novel Question Answering Evaluation Pipeline (QEP) that generates synthetic questions and verifies the correctness of answers using clustered topic matching. Experiments on five major platforms, Apple, Google, X (formerly Twitter), Microsoft, and Netflix, show the effectiveness of TOSense (with up to 44.5% accuracy) across varying number of topic clusters. During the demonstration, we will showcase TOSense in action. Attendees will be able to experience seamless extraction, interactive question answering, and instant indexing of new sites.