Investigating Training Data Detection in AI Coders
This work addresses privacy and intellectual property risks in software engineering by improving detection of non-compliant code use in AI models, representing an incremental advance in adapting existing methods to code-specific challenges.
The paper tackled the problem of detecting whether code outputs from CodeLLMs contain proprietary training data, by evaluating seven training data detection methods on code data and introducing a benchmark dataset called CodeSnitch with 9,000 samples. The study assessed performance across eight CodeLLMs and tested robustness under mutation strategies based on code clone detection taxonomy.
Recent advances in code large language models (CodeLLMs) have made them indispensable tools in modern software engineering. However, these models occasionally produce outputs that contain proprietary or sensitive code snippets, raising concerns about potential non-compliant use of training data, and posing risks to privacy and intellectual property. To ensure responsible and compliant deployment of CodeLLMs, training data detection (TDD) has become a critical task. While recent TDD methods have shown promise in natural language settings, their effectiveness on code data remains largely underexplored. This gap is particularly important given code's structured syntax and distinct similarity criteria compared to natural language. To address this, we conduct a comprehensive empirical study of seven state-of-the-art TDD methods on source code data, evaluating their performance across eight CodeLLMs. To support this evaluation, we introduce CodeSnitch, a function-level benchmark dataset comprising 9,000 code samples in three programming languages, each explicitly labeled as either included or excluded from CodeLLM training. Beyond evaluation on the original CodeSnitch, we design targeted mutation strategies to test the robustness of TDD methods under three distinct settings. These mutation strategies are grounded in the well-established Type-1 to Type-4 code clone detection taxonomy. Our study provides a systematic assessment of current TDD techniques for code and offers insights to guide the development of more effective and robust detection methods in the future.