pix2code: Generating Code from a Graphical User Interface Screenshot
This addresses the time-consuming task for developers of manually converting designs into code, though it is incremental as it applies existing deep learning methods to a new application.
The paper tackles the problem of automatically generating code from GUI screenshots, achieving over 77% accuracy across iOS, Android, and web platforms using deep learning.
Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies).