CIDR: A Large-Scale Industrial Source Code Dataset for Software Engineering Research
For researchers in code intelligence and software engineering, this provides a unique resource of real-world industrial code, addressing the gap left by public open-source datasets.
The paper introduces CIDR, a large-scale dataset of 2,440 proprietary industrial software repositories from 12 partner organizations, totaling 373 million lines of code across 138 languages, to support software engineering research. The dataset is processed with a multi-stage pipeline including anonymization and quality selection.
We present Curated Industrial Developer Repository (CIDR), a large-scale dataset of real-world software repositories collected through direct collaboration with 12 industrial partner organizations. The dataset comprises 2,440 repositories spanning 138 programming languages and totalling 373 million lines of code, accompanied by structured per-repository metadata. Unlike existing code corpora derived from public open-source platforms, CIDR consists exclusively of proprietary production codebases contributed under formal data sharing agreements, covering application domains including enterprise web and mobile development, fintech, and custom software consultancy. All repositories were processed through a multi-stage pipeline encompassing structured partner onboarding, two-stage quality selection combining automated metadata filtering with manual code review, and a deterministic anonymization pipeline covering the full version control history. The dataset is intended to support research in code intelligence, software quality analysis, pre-training and fine-tuning of code language models, developer behaviour studies, and construction of agent evaluation benchmarks. Access is provided under a restricted commercial license; details are available at https://fermatix.ai/#Contact.