SEAIOct 16, 2024

Personality-Guided Code Generation Using Large Language Models

arXiv:2411.00006v26 citationsh-index: 11Has CodeACL
Originality Incremental advance
AI Analysis

This work addresses improving code generation for software developers by integrating personality traits, though it is incremental as it builds on existing prompting strategies.

The study tackled code generation by exploring how emulating personality traits appropriate to coding tasks affects large language model performance, finding that personality guidance significantly enhances accuracy with improvements up to 12.9% in pass rates across various models and datasets.

Code generation, the automatic creation of source code from natural language descriptions, has garnered significant attention due to its potential to streamline software development. Inspired by research that links task-personality alignment with improved development outcomes, we conduct an empirical study on personality-guided code generation using large language models (LLMs). Specifically, we investigate how emulating personality traits appropriate to the coding tasks affects LLM performance. We extensively evaluate this approach using seven widely adopted LLMs across four representative datasets. Our results show that personality guidance significantly enhances code generation accuracy, with improved pass rates in 23 out of 28 LLM-dataset combinations. Notably, in 11 cases, the improvement exceeds 5%, and in 5 instances, it surpasses 10%, with the highest gain reaching 12.9%. Additionally, personality guidance can be easily integrated with other prompting strategies to further boost performance. We open-source our code and data at https://github.com/IanWalls/Persona-Code.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes