CLSEJun 27, 2023

Constructing Multilingual Code Search Dataset Using Neural Machine Translation

arXiv:2306.15604v1224 citationsh-index: 66
Originality Synthesis-oriented
AI Analysis

This work addresses the problem of limited multilingual query support in code search for developers and researchers, but it is incremental as it builds on existing datasets and methods.

The authors tackled the lack of multilingual natural language queries in code search datasets by creating a dataset in four natural and four programming languages using neural machine translation, and they found that models pre-trained with all language data performed best, with data size being more critical than translation quality.

Code search is a task to find programming codes that semantically match the given natural language queries. Even though some of the existing datasets for this task are multilingual on the programming language side, their query data are only in English. In this research, we create a multilingual code search dataset in four natural and four programming languages using a neural machine translation model. Using our dataset, we pre-train and fine-tune the Transformer-based models and then evaluate them on multiple code search test sets. Our results show that the model pre-trained with all natural and programming language data has performed best in most cases. By applying back-translation data filtering to our dataset, we demonstrate that the translation quality affects the model's performance to a certain extent, but the data size matters more.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes