Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs
This addresses the need for understanding therapeutic relationships in online counseling, which is crucial for millions seeking support, but the work is incremental as it adapts existing frameworks to a new context.
The paper tackled the problem of assessing therapeutic alliance in online text-based counseling by developing an automatic approach using large language models (LLMs), which demonstrated effectiveness in identifying the alliance and highlighted challenges counselors face in building strong online relationships.
Robust therapeutic relationships between counselors and clients are fundamental to counseling effectiveness. The assessment of therapeutic alliance is well-established in traditional face-to-face therapy but may not directly translate to text-based settings. With millions of individuals seeking support through online text-based counseling, understanding the relationship in such contexts is crucial. In this paper, we present an automatic approach using large language models (LLMs) to understand the development of therapeutic alliance in text-based counseling. We adapt a theoretically grounded framework specifically to the context of online text-based counseling and develop comprehensive guidelines for characterizing the alliance. We collect a comprehensive counseling dataset and conduct multiple expert evaluations on a subset based on this framework. Our LLM-based approach, combined with guidelines and simultaneous extraction of supportive evidence underlying its predictions, demonstrates effectiveness in identifying the therapeutic alliance. Through further LLM-based evaluations on additional conversations, our findings underscore the challenges counselors face in cultivating strong online relationships with clients. Furthermore, we demonstrate the potential of LLM-based feedback mechanisms to enhance counselors' ability to build relationships, supported by a small-scale proof-of-concept.