Scraping the Shadows: Deep Learning Breakthroughs in Dark Web Intelligence
This addresses the challenge of efficiently combating illegal trade on darknet markets for law enforcement agencies, but it is incremental as it applies existing methods to a new domain.
The paper tackled the problem of automating data extraction from darknet markets to aid law enforcement by evaluating three state-of-the-art NER models, achieving up to 94% F1 score with fine-tuning.
Darknet markets (DNMs) facilitate the trade of illegal goods on a global scale. Gathering data on DNMs is critical to ensuring law enforcement agencies can effectively combat crime. Manually extracting data from DNMs is an error-prone and time-consuming task. Aiming to automate this process we develop a framework for extracting data from DNMs and evaluate the application of three state-of-the-art Named Entity Recognition (NER) models, ELMo-BiLSTM \citep{ShahEtAl2022}, UniversalNER \citep{ZhouEtAl2024}, and GLiNER \citep{ZaratianaEtAl2023}, at the task of extracting complex entities from DNM product listing pages. We propose a new annotated dataset, which we use to train, fine-tune, and evaluate the models. Our findings show that state-of-the-art NER models perform well in information extraction from DNMs, achieving 91% Precision, 96% Recall, and an F1 score of 94%. In addition, fine-tuning enhances model performance, with UniversalNER achieving the best performance.