NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash Commands
It addresses the challenge of making command-line interfaces more accessible for users by automating translation from English, though it is incremental as it builds on existing NLP and code generation tasks.
The paper reports on the NeurIPS 2020 NLC2CMD Competition, which tackled the problem of translating natural language descriptions to Bash commands, resulting in a benchmark dataset and evaluation of various models from participants.
The NLC2CMD Competition hosted at NeurIPS 2020 aimed to bring the power of natural language processing to the command line. Participants were tasked with building models that can transform descriptions of command line tasks in English to their Bash syntax. This is a report on the competition with details of the task, metrics, data, attempted solutions, and lessons learned.