CodeSCAN: ScreenCast ANalysis for Video Programming Tutorials
This addresses the problem of searching within video programming tutorials for learners and developers, but it is incremental as it primarily provides a dataset and benchmarks without new methods.
The authors tackled the lack of large-scale datasets for analyzing programming screencast videos by introducing the CodeSCAN dataset, which includes 12,000 screenshots from Visual Studio Code with diverse programming languages, fonts, and themes, and they benchmarked performance on IDE element detection, color conversion, and OCR.
Programming tutorials in the form of coding screencasts play a crucial role in programming education, serving both novices and experienced developers. However, the video format of these tutorials presents a challenge due to the difficulty of searching for and within videos. Addressing the absence of large-scale and diverse datasets for screencast analysis, we introduce the CodeSCAN dataset. It comprises 12,000 screenshots captured from the Visual Studio Code environment during development, featuring 24 programming languages, 25 fonts, and over 90 distinct themes, in addition to diverse layout changes and realistic user interactions. Moreover, we conduct detailed quantitative and qualitative evaluations to benchmark the performance of Integrated Development Environment (IDE) element detection, color-to-black-and-white conversion, and Optical Character Recognition (OCR). We hope that our contributions facilitate more research in coding screencast analysis, and we make the source code for creating the dataset and the benchmark publicly available on this website.