Benchmarking Advanced Text Anonymisation Methods: A Comparative Study on Novel and Traditional Approaches
It provides a comparative guide for researchers selecting text anonymisation models, though it is incremental as it focuses on benchmarking existing methods.
This paper benchmarks transformer-based and large language models against traditional architectures for text anonymisation using the CoNLL-2003 dataset, showing that modern models capture contextual nuances well but some traditional methods still perform highly.
In the realm of data privacy, the ability to effectively anonymise text is paramount. With the proliferation of deep learning and, in particular, transformer architectures, there is a burgeoning interest in leveraging these advanced models for text anonymisation tasks. This paper presents a comprehensive benchmarking study comparing the performance of transformer-based models and Large Language Models(LLM) against traditional architectures for text anonymisation. Utilising the CoNLL-2003 dataset, known for its robustness and diversity, we evaluate several models. Our results showcase the strengths and weaknesses of each approach, offering a clear perspective on the efficacy of modern versus traditional methods. Notably, while modern models exhibit advanced capabilities in capturing con textual nuances, certain traditional architectures still keep high performance. This work aims to guide researchers in selecting the most suitable model for their anonymisation needs, while also shedding light on potential paths for future advancements in the field.