Is Self-knowledge and Action Consistent or Not: Investigating Large Language Model's Personality
This addresses the problem of assessing human-like personality in AI for researchers and developers, but it is incremental as it builds on existing personality assessment methods.
The study investigated whether large language models (LLMs) have consistent personality traits by comparing their self-reported traits from questionnaires with their actual outputs in real-world scenarios, revealing a disjunction between self-knowledge and action.
In this study, we delve into the validity of conventional personality questionnaires in capturing the human-like personality traits of Large Language Models (LLMs). Our objective is to assess the congruence between the personality traits LLMs claim to possess and their demonstrated tendencies in real-world scenarios. By conducting an extensive examination of LLM outputs against observed human response patterns, we aim to understand the disjunction between self-knowledge and action in LLMs.