Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code
It addresses the problem of improving software engineering tasks through AI for researchers and practitioners, but is incremental as it is a survey.
The paper surveys the application of deep learning in software engineering, focusing on pre-trained models of source code that have achieved state-of-the-art results across various tasks.
Recent years have seen the successful application of deep learning to software engineering (SE). In particular, the development and use of pre-trained models of source code has enabled state-of-the-art results to be achieved on a wide variety of SE tasks. This paper provides an overview of this rapidly advancing field of research and reflects on future research directions.