AI-Powered Commit Explorer (APCE)
This addresses the issue for developers and researchers by providing a tool to improve commit message quality, but it is incremental as it builds on existing LLM approaches.
The paper tackles the problem of low-quality commit messages in software development by introducing APCE, a tool that supports the use and evaluation of LLM-generated commit messages, offering features like prompt storage and automated evaluation mechanisms.
Commit messages in a version control system provide valuable information for developers regarding code changes in software systems. Commit messages can be the only source of information left for future developers describing what was changed and why. However, writing high-quality commit messages is often neglected in practice. Large Language Model (LLM) generated commit messages have emerged as a way to mitigate this issue. We introduce the AI-Powered Commit Explorer (APCE), a tool to support developers and researchers in the use and study of LLM-generated commit messages. APCE gives researchers the option to store different prompts for LLMs and provides an additional evaluation prompt that can further enhance the commit message provided by LLMs. APCE also provides researchers with a straightforward mechanism for automated and human evaluation of LLM-generated messages. Demo link https://youtu.be/zYrJ9s6sZvo