Who is GPT-3? An Exploration of Personality, Values and Demographics
This provides the first evidence of psychological assessment of GPT-3, adding to understanding of language models for social science and AI researchers.
The paper tackled the question of GPT-3's identity by assessing its personality, values, and demographics using validated measurement tools, finding that GPT-3 scores similarly to human samples in personality and values when provided with a model response memory.
Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.