Mental health problems like depression and anxiety are difficult to identify in their early stages. According to the Stanford Natural Language Processing Research Group, in the US alone, 43.6 million adults (18.1%) experience mental illness each year. The longer the individual is without treatment, the worse is the impact on the health of the individual.

Fortunately, mental health conditions can often be treated with counseling and psychotherapy, and in recent years there has been rapid growth in the availability of these treatments thanks to technology-mediated counseling.

The Stanford Natural Language Processing Group used Natural language processing (NLP) to tag, parse, and even extract information from text. The goal of the project was to better understand how to conduct counseling sessions, which researchers have done through a large-scale study of crisis counseling conversations.

So far, most research on counseling has been small-scale and qualitative due to the difficulty of obtaining data. The Stanford Natural Language Processing Group partnered with a nonprofit organization that offers crisis counseling via text messages to apply techniques from data mining and NLP on a dataset of over 80,000 counseling sessions. In its analysis, the group searched for linguistic aspects of conversations that were correlated with the outcomes of the conversations (whether the person texting felt better afterward).

Stanford's NLP study was conducted on about 15,000 conversations (660,000 messages) that had a response to the follow-up question. On average, the conversations were 43 messages long with around 20 words per message. There are many questions that could be investigated with this data, but the researchers were most interested in learning what characterizes a successful conversation. Although a counseling session is free-from and without strict rules, it involves many choices that could make a difference in someone's life. To answer this question, researchers developed techniques to quantify aspects of the conversations and determine which ones were associated with successful counselors. There are five "strategies" researchers found more prevalent in successful counselors (i.e., those who have a higher rate of texters saying they felt better in the follow-up):

Adaptability: Successful counselors are aware of how the conversation is going and react accordingly.

Dealing with ambiguity: Successful counselors clarify situations by writing more, reflecting back to check to understand, and making their conversation partner feel more comfortable through affirmation.

Creativity: Successful counselors respond in a creative way, not using too generic or "templated" responses.

Making Progress: Successful counselors are quicker to get to know the main issue and are faster to move on to collaboratively solving the problem.

Change in Perspective: Researchers found that people in distress are more likely to be more positive, think about the future, and consider others when the counselors bring up these concepts. This kind of perspective change is associated with positive conversations, a finding that is consistent with psychological theories of depression.

According to researchers, "Although some of these are obvious in hindsight, this is to the best of our knowledge the first time someone has been able to perform a large-scale analysis of these strategies. We hope that this research will lead to a better understanding of how to provide quality counseling services."

Key Findings

At the beginning of the conversation, the language used in positive and negative conversations is quite similar, but then the distance in a language increases over time. This increase in distance is much larger for more successful counselors than less successful ones, suggesting they are more aware of when conversations are going poorly and adapt their counseling more in an attempt to remedy the situation.

The researchers also analyzed how counselors react to ambiguous situations. Ambiguity arises most at the beginning of conversations. They looked at the counselors' responses to the first long message by the texter (typically a response to a "Can you tell me more about what is going on?" question by the counselor). Based on counselor training materials, researchers hypothesized successful counselors would – write more themselves; use more check questions (statements that tell the conversation partner that you understand them while avoiding the introduction of any opinion or advice e.g., "that sounds like…"); check for suicidal thoughts; thank the texter for showing the courage to talk to them; use more hedges (mitigating words used to lessen the impact of an utterance; e.g., "maybe", "fairly"); and be less likely to respond with surprise (e.g., "oh, this sounds really awful"). The researchers found there to be statistically significant differences in all of these aspects except for showing surprise, suggesting these methods from counselor training do indeed help.

Interestingly, although more successful counselors tend to more often use structured responses like check questions, their responses also tended to be more unique. Researchers measured the uniqueness of responses by clustering counselor messages and then counting how many close neighbors the messages tended to have. Messages from more successful counselors tended to have fewer neighbors, suggesting they were being more creative or personalized in their responses. This tailoring of messages requires more effort from the counselor, which is consistent with the results in the above table showing that more successful counselors put in more effort in composing longer messages as well.

According to Stanford researchers, prior work on counseling suggests that certain perspectives are associated with depression, such as having a negative view of the future or being self-focused. They quantified the concept of perspective change by measuring the frequency of different word categories (provided by LIWC) over time in the conversation.

Texters start explaining their issues largely in terms of the past and present, but over time switch to talking about the future. Additionally, texters writing more about the future are more likely to feel better after the conversation. This suggests that changing the perspective from issues in the past towards the future is associated with a higher likelihood of successfully working through the crisis. The Stanford researchers also investigated whether counselors could instigate this perspective change, and found that texters were more likely to talk about the future if the counselor brought up the subject.

Conclusion of the Study

As NLP techniques become more effective and data becomes more available, it is becoming increasingly useful as a tool for investigating pressing issues that our societies face. The researchers think mental health is one such problem and they hope their research on counseling will inspire future work on the area, leading to new insights that could benefit treatments for mental illness. Such research could improve counselor training and lead to tools that help counselors be more successful.

*Based on the insights from The Stanford Natural Language Processing Group