Evaluating Psychological Safety of Large Language Models
This addresses the problem of hidden psychological risks in LLMs for developers and users, though it is incremental as it builds on existing safety evaluation methods.
The researchers systematically evaluated the psychological safety of large language models (LLMs) using personality and well-being tests, finding that models like InstructGPT, GPT-3.5, and GPT-4 scored higher than humans on dark personality traits despite safety fine-tuning, and demonstrated that fine-tuning Llama-2-chat-7B with direct preference optimization could reduce psychological toxicity.
In this work, we designed unbiased prompts to systematically evaluate the psychological safety of large language models (LLMs). First, we tested five different LLMs by using two personality tests: Short Dark Triad (SD-3) and Big Five Inventory (BFI). All models scored higher than the human average on SD-3, suggesting a relatively darker personality pattern. Despite being instruction fine-tuned with safety metrics to reduce toxicity, InstructGPT, GPT-3.5, and GPT-4 still showed dark personality patterns; these models scored higher than self-supervised GPT-3 on the Machiavellianism and narcissism traits on SD-3. Then, we evaluated the LLMs in the GPT series by using well-being tests to study the impact of fine-tuning with more training data. We observed a continuous increase in the well-being scores of GPT models. Following these observations, we showed that fine-tuning Llama-2-chat-7B with responses from BFI using direct preference optimization could effectively reduce the psychological toxicity of the model. Based on the findings, we recommended the application of systematic and comprehensive psychological metrics to further evaluate and improve the safety of LLMs.