RN-F: A Novel Approach for Mitigating Contaminated Data in Large Language Models
This addresses reliability concerns in LLM applications by mitigating data contamination, though it appears incremental as it builds on existing detection methods.
The paper tackles the problem of data contamination in large language models by proposing RN-F, a novel framework for detecting contaminated data, which outperforms existing methods with up to 10.5% improvement in detection metrics.
Large Language Models (LLMs) have become foundational in modern artificial intelligence, powering a wide range of applications from code generation and virtual assistants to scientific research and enterprise automation. However, concerns about data contamination--where test data overlaps with training data--have raised serious questions about the reliability of these applications. Despite awareness of this issue, existing methods fall short in effectively identifying or mitigating contamination. In this paper, we propose Residual-Noise Fingerprinting (RN-F), a novel framework for detecting contaminated data in LLMs. RN-F is a single-pass, gradient-free detection method that leverages residual signal patterns without introducing additional floating-point operations. Our approach is lightweight, model-agnostic, and efficient. We evaluate RN-F on multiple LLMs across various contaminated datasets and show that it consistently outperforms existing state-of-the-art methods, achieving performance improvements of up to 10.5% in contamination detection metrics.