DEFEND: A Large-scale 1M Dataset and Foundation Model for Tobacco Addiction Prevention
It provides regulatory bodies and public health researchers with tools for monitoring tobacco products, addressing a critical gap in public health oversight, though it is incremental as it builds on existing foundation model approaches.
The paper tackles the lack of large-scale datasets and monitoring systems for tobacco advertising by introducing Tobacco-1M, a dataset of one million images, and DEFEND, a foundation model that achieves 83.1% accuracy in product classification and 73.8% in visual question-answering, with 45.6% zero-shot accuracy on novel categories.
While tobacco advertising innovates at unprecedented speed, traditional surveillance methods remain frozen in time, especially in the context of social media. The lack of large-scale, comprehensive datasets and sophisticated monitoring systems has created a widening gap between industry advancement and public health oversight. This paper addresses this critical challenge by introducing Tobacco-1M, a comprehensive dataset of one million tobacco product images with hierarchical labels spanning 75 product categories, and DEFEND, a novel foundation model for tobacco product understanding. Our approach integrates a Feature Enhancement Module for rich multimodal representation learning, a Local-Global Visual Coherence mechanism for detailed feature discrimination, and an Enhanced Image-Text Alignment strategy for precise product characterization. Experimental results demonstrate DEFEND's superior performance, achieving 83.1% accuracy in product classification and 73.8% in visual question-answering tasks, outperforming existing methods by significant margins. Moreover, the model exhibits robust zero-shot learning capabilities with 45.6% accuracy on novel product categories. This work provides regulatory bodies and public health researchers with powerful tools for monitoring emerging tobacco products and marketing strategies, potentially revolutionizing approaches to tobacco control and public health surveillance.