What AI Can Bring to Suicide Prevention

by | Aug 21, 2023 | Articles, Suicide

Our society has become enthralled with Artificial Intelligence (AI), which is becoming an intrinsic
phrase in our zeitgeist. In the coming years, AI will embed itself into various professional fields. Although legal and policy measures may temper its impact, it is undeniable that our future will be enmeshed with AI. Embracing and collaborating with AI should be our primary focus. The medical realm has already witnessed the integration of AI into diagnostics and imaging, revolutionizing the healthcare landscape. (1). One sector of healthcare in need of a serious reexamination is the mental health field. We are in the midst of a global mental health crisis, exacerbated by the pandemic. The lockdowns altered our perception of meaning and led to a surge in mental health disorders, with suicide rates rising 4% in 2021 after a two-year decline (2). This shift has sparked a mental health epidemic, making it imperative to explore innovative solutions.

AI offers immense promise in suicide prevention efforts. By providing objective real-time assessments, personalized intervention strategies and resources, and improved prediction accuracy, AI could substantially enhance our ability to prevent suicides. Currently, there are a few AI applications already in practice for suicide risk assessment and intervention, yielding identifiable benefits and potential concerns. Considering the global rise in mental health issues along with fewer mental health experts practicing or experiencing burnout themselves (3), AI can offer both sympathy and knowledge for those seeking assistance in a severe crisis.

The Trevor Project, an organization focused on suicide prevention for LGBTQ youth, partnered
with Google.org to launch The Crisis Contact Simulator. This AI-powered training tool allows aspiring counselors to practice realistic conversations with LGBTQ youths in crisis, improving their skills and flexibility.

The platform aims to meet the increasing demand for digital mental health services, especially
during the pandemic, as suicide rates and the need for support have surged among LGBTQ youth.
Previously, instructor-led roles were the primary training method, but leveraging AI technology enables an increase in the number of trained counselors able to offer assistance and scheduling convenience. By embracing this AI-powered solution, The Trevor Project aims to reach and connect with Innovative Approaches in Suicide Risk Assessment and Intervention: Ethical challenges of
incorporating Artificial Intelligence. LGBTQIA+ youth in need of their support (4).

Voice DGP is a project focused on using voice as a biomarker of health to advance understanding
of various diseases. The group aims to create a diverse and ethically sourced voice database, linked to other health biomarkers, to fuel research in voice AI. By leveraging smartphone applications and
federated learning technology to protect data privacy, they seek to collect data from multiple
institutions and develop predictive models for screening, diagnosing, and treating diseases.
The project focuses on five disease categories: vocal pathologies, neurological and neurodegenerative disorders, mood and psychiatric disorders, respiratory disorders, and pediatric
diseases. Voice changes associated with these diseases, especially those in a psychotic episode facing suicidal ideation, will be analyzed to improve clinical care and contribute to the development of effective interventions (5).

Surprising findings include drafted and deleted suicide notes on the devices studied, potentially
impacting both military and general populations. While not predicting individual suicide attempts, data analysis may provide useful signals for heightened risk. The project gains support from family members who lend their loved ones’ devices, emphasizing suicide prevention and minimizing future loss (6).

Ethical considerations surrounding the use of AI in suicidal individuals must be thoughtfully
weighed. Principlism, a prominent and widely adopted methodological framework in healthcare ethics, establishes a moral theory comprising four prima facie norms: nonmaleficence, beneficence, autonomy, and justice. These principles serve as the cornerstone for making morally sound and well-balanced decisions in the complex realm of mental and physical health (7).

The principle of nonmaleficence anchors healthcare providers to their inherent duty of avoiding
harm and the moral imperative of never wronging or neglecting their patients—an oath taken by
physicians known as the Hippocratic Oath (7). Similarly, the principle of beneficence underscores a
profound ethos: to consistently treat patients with the fundamental creed of fostering their overall Innovative Approaches in Suicide Risk Assessment and Intervention: Ethical challenges of
incorporating Artificial Intelligence health and welfare. This commitment to ethical duties is especially crucial when addressing the needs of individuals facing existential moral crises, particularly in the sensitive domain of suicidal ideation.

It is within the nexus of empathy and clinical judgment that medical decisions find their grounding. However, as we contemplate integrating nonhuman entities, AI, into life-or-death situations, we encounter a pressing question: Can something nonhuman offer genuine compassion, and good healthcare outcomes? What ethical risks should be considered as we delve into the development
and implementation of AI technology in lieu of human medical professionals to save lives? Here,
beneficence assumes a paramount role, demanding that AI interventions be thoughtfully crafted to
provide authentic support and resources, with an unwavering focus on the user’s mental well-being
above all other objectives.

Regular and meticulous monitoring becomes the bedrock to prevent potential harm, requiring
ongoing evaluation of AI algorithms, biases to assure the efficacy of patient safety. In this intricate
landscape where ethics and technology converge, striking the delicate balance between AI innovation and human compassion stands as a pivotal pursuit. It is through this harmonious integration that we can invite AI into the conversation, while upholding the highest ethical standards to ensure the preservation of human lives.

In the realm of mental health, an individual grappling with suicidal thoughts seeks profound mediation, as these feelings define their very real, and very current existence. However, this complex subjectivity presents a challenge in providing medical guidance rooted in philosophy. Emerging AI applications designed to intervene in suicidal ideations appear and sound promising, yet they raise another vital question: Can we effectively partner with emotionless computers to offer objective interventions during moments of crisis?

The quantitative driven nature of AI may risk disregarding the subjective perspective of the
autonomous individual seeking crisis care, potentially overlooking the essential elements of personal
perspective, self-wholeness, and humanistic critical and experiential-based thinking. Such oversight may undermine the seekers’ sense of human connection, a fundamental aspect that can be lost when one experiences suicidal thoughts. To strike a balance, we must be mindful of preserving autonomy, respecting the individual’s right to decide on their mental health care. Instead of replacing human

AI tools should augment it, providing individuals with the assurance of a known human connection throughout their journey to healing. In certain bioethical discussions, human existence is viewed as the fundamental bedrock of vulnerability, as being inherently human can intensify susceptibility to harm and damage (ten Have, 15). This perspective raises concerns about how AI interacts with our corporeal existence and whether it leaves us vulnerable to potential exploitation by malicious actors. If hackers gain access to individual data or misuse AI systems to target those experiencing suicidal thoughts, they could prey on these vulnerable individuals.

The Black Box project presents another moral quandary, as obtaining informed consent for data
mining becomes complex when dealing with individuals who are no longer living. The project’s boundary is questioned in terms of respecting the autonomy of those who have not explicitly given consent, with family members making decisions on the decedent’s behalf. While the project’s potential to yield groundbreaking suicide interventions for veterans or scalable for public adaption is noteworthy, posthumous individuals have a right to maintain their health privacy.

Balancing potential harms and benefits becomes an ethical dilemma, underlining the need for
stringent data protection and confidentiality measures to safeguard the vulnerable, i.e. the dead.
Informed consent becomes critical, ensuring that users fully understand the capabilities and limitations of AI systems, enabling them to make informed choices about their involvement. Transparent communication about the role and limitations of AI is essential for accountability, building trust with users and the broader community, all while ensuring the protection of vulnerable individuals, patients, and those who have passed.

In conclusion, the integration of Artificial Intelligence (AI) in suicide prevention efforts holds vast
promise for addressing the global mental health crisis. As AI technology penetrates various professional fields, its potential in revolutionizing mental healthcare cannot be overlooked. Collaborating with AI and embracing its capabilities could significantly enhance our ability to prevent suicide. However, as we tread down this path, it is vital to consider the ethical implications and potential risks associated with relying on nonhuman entities to provide instructional guidance in life or death circumstances. Striking a delicate balance between AI innovation and human compassion becomes paramount in this pursuit. Augmenting human support with AI tools, rather than replacing it, ensures the preservation of autonomy and the preservation of the human connection vital in moments of crisis.

Furthermore, robust data protection measures and informed consent are essential to safeguard
the vulnerable from potential exploitation and uphold the highest ethical standards while harnessing the transformative potential of AI in suicide prevention.

~Kara Crew

Kara, with 15 years of experience in communications and marketing, currently manages health programs with the Los Angeles Public Health Department, notably contributing to COVID-19 efforts. Her roles with the Public Health department and degrees in Television & Film Production and Bioethics reflect her commitment to innovation and public welfare. Passionate about mental and behavioral health, she is excited to lend her philosophical voice to Breaking Taboo, and explore ethical considerations.


  1. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9955430/
  2. https://www.bmj.com/content/378/bmj.o2157.full
  3. https://www.cdc.gov/nchs/products/databriefs/db464.htm#:~:text=The%20total%20age%2Dadj
  4. https://www.thetrevorproject.org/blog/17307/
  5. https://bridge2ai.org/voice/
  6. https://stopsoldiersuicide.org/blackboxproject
  7. Beauchamp, Tom L., and Childress, James F. Principles of Biomedical Ethics. 7th ed.
    Oxford University Press, 2013
  8. Ten Have, Henk. Vulnerability: Challenging Bioethics. New York, NY. Routledge, 2016.
    pp. 1-19.

more related articles

Hope for Treatment-Resistant Depression

Depression is a common and often debilitating mood disorder that affects millions. It is a significant global public health problem, and in the United States, 8.4% of adults and 17% of adolescents had at least one major depressive episode in 2020, with many of these...

Toxic Masculinity: Causing depression in men

“Man up!” “Boys don’t cry!” “Don’t be such a girl!” Sound familiar?  These are just a few of the toxically masculine insults that are proliferating within our current culture and society.  Men experience these types of sentiments daily. What’s worse, is so...

Suicide: The Other Pandemic

For the majority of us, September marks the start of Autumn. A long-awaited season bringing brisk air, warm apple cider, and the beautiful turning of leaves. But we mustn’t forget. It is also a month dedicated to the cause of suicide awareness and prevention, hence,...

How To Support a Loved One Going Through Depression

With over 17 million American adults suffering from major depressive disorder (1), it’s not unlikely that you may know someone who is currently living with this condition. Although professional treatment is invaluable in helping depressed individuals recuperate and...

Is it Depression or ADHD? You Could Have Both

Both Depression and Attention Deficit / Hyperactivity Disorder (ADHD) are very commonin our population. The National Institute of Mental Health (NIMH, 2021) shows statistics that theprevalence of the current adult population in the United States with ADHD is 4.4%; for...

Bipolar 1 Vs Bipolar 2, What’s the Difference?

Bipolar disorder is a severe chronic mental illness that affects millions of Americans today. It is a complex disease with various symptoms that can cause a multitude of issues for those that live with it. What makes bipolar disorder even more complicated is the fact...

Why Are Women More Susceptible To Depression?

Extensive research has revealed that one in eight women develop depression at some point in their lives, which is twice the rate of cases compared to men. (1) But why is that? What makes women more vulnerable to this condition? Before explaining the significance of...

Too Close to Home: Filipino Suicide and Depression

Many Asian Americans, especially Filipino Americans, struggle with mental illnesses such as depression, anxiety, and suicide. In fact, young Filipina women experience greater suicide ideation (45.6%) compared to other minorities (Javier et. al 2018). However, despite...

Antidepressants: How Does It Treat Depression?

A Word on Pill Shaming             There are a number of reasons that prevent people from seeking, and ultimately receiving mental healthcare. Clearly, structural barriers contribute to these cases (i.e. some tangible lack of access to medicine). More subtle but no...

The Neuroscience of Depression

What is Depression?  One of the world’s leading causes of disability, depression is a mental illness that is frequently experienced with symptoms of dejected moods, disinterest, excessive self-criticism, and many others. Given the pervasiveness of depression as an...

Why is anxiety so paralyzing?

“Why is anxiety so paralyzing?” If there is such a thing as various degrees of literal, I would say there should be a spectrum to define how deeply a life has been interrupted, paused, and frozen still. In my experience, it can be so physically paralyzing you would...

4 Lesser Known (But Effective) Psychotherapies For Anxiety

What if I told you, anxiety was an epidemic. In fact, according to NAMI, “Anxiety disorders are the most common mental health concern in the United States. Over 40 million adults in the U.S. (19.1%) have an anxiety disorder.” Most people are treated with Cognitive...

3 Powerful Ways To Stop Anxiety Now

Let’s Get Started. Anxiety affects everyone on planet Earth, everywhere from San Jose, California to San Jose, Costa Rica. It’s a part of being alive. It’s part of the human experience. But, it doesn't have to be. At least, not to the extent it plagues most...

How to Cope with Anxiety During Covid-19

We are all living in a critical time right now. Whether we are one of the hundreds of thousands affected with COVID-19, a loved one of someone affected, a health professional at the front lines, or like the majority, at home or working an essential job, doing the most...

How Sleep Deprivation Can Increase Your Anxiety

Anxiety is a pervasive problem that can be difficult to diagnose and treat. People try everything from pharmaceutical remedies to therapy, natural remedies, supplements, meditation, and more. Some find relief from their anxiety, but others continue to struggle, no...

The Psychology of Addiction

  Addiction is described as a condition in which a person engages in the use of a substance or in a behavior for which the rewarding effects provide a compelling incentive to repeatedly pursue the behavior despite detrimental consequences. An addiction can...

Everything Can Be Addictive: Part 1

Blog Title: “Addicted” Means Everything After the death of my older brother who died from overdose to guaifenesin, also known as Mucinex, I was shocked and appalled to see how many people were uneducated as to what an addiction is, including the authorities and...

Rehab, Prison, or Death: Why Rehab Doesn’t Always Work

When you think of rehab, you probably think of those lavish centers advertised on day-time television or the late and great Amy Winehouse’s single Rehab, where she testifies she’ll never go back and there’s nothing she has to gain from sitting in therapy for 10 weeks....

Which is Better? Luxury Sober Living vs Government Funded Homes

Sober living homes are used for people who want to maintain abstinence from alcohol and drugs. It can be difficult to return to a home environment that is not drug and alcohol free. Sober livings create a supportive place for recovering addicts to live during their...

What is a Panic Attack?

What is a panic attack? How long do they last? Are they scary? A panic attack is psychological and is an overreaction of your adrenal system. A panic attack can happen within a moment’s notice. They occur because there is a sense of danger and your mind and body start...

How Does Attention and Imagery Ability Relate to Emotion?

It seems evident that the depth that individuals feel and emotionally respond toward stimuli ebbs and flows. Consider, for example, how a person experiences deep elation and joy when listening to their favorite song yet later experiences a dulled affective response...

Mental Health IS physical Health, Exercise Boosts both!

Mental Health IS health. I’ve always said that, because it’s the truth. We can’t separate the two. Just like physical health IS health, mental health is health. I could actually argue that mental health might be even more so, since every single function in our body...

Mental Health Disparities in the LGBTQI+ Community

Among the many health disparities, a glaring one is the higher rate of mental health disorders in people who identify as part of the LGBTQI+ community. Widespread social and political discrimination have caused disproportionately high rates of poverty, homelessness,...

May- Mental Health Awareness Month Multidimensional Awareness

May is Mental Health Awareness Month. Which means that there is a lot of extra focus on mental health, mental illness, and breaking the stigma surrounding these two very important topics. We use that word a lot- “awareness”, but so many people don’t fully understand...

Hope for Treatment-Resistant Depression

Depression is a common and often debilitating mood disorder that affects millions. It is a significant global public health problem, and in the United States, 8.4% of adults and 17% of adolescents had at least one major depressive episode in 2020, with many of these...

Toxic Masculinity: Causing depression in men

“Man up!” “Boys don’t cry!” “Don’t be such a girl!” Sound familiar?  These are just a few of the toxically masculine insults that are proliferating within our current culture and society.  Men experience these types of sentiments daily. What’s worse, is so...

“Self Love” in the East VS west

“Self Love” has become one of the catchiest concepts being thrown around in Western society, a terminology seemingly present now everywhere we look; on billboards, all across our social media feeds, in meditation practices and therapy practices. It is now a popular...

Suicide: The Other Pandemic

For the majority of us, September marks the start of Autumn. A long-awaited season bringing brisk air, warm apple cider, and the beautiful turning of leaves. But we mustn’t forget. It is also a month dedicated to the cause of suicide awareness and prevention, hence,...

Somatization and Asking for Help: How Asian Populations Respond to Psychological Stress

The intricate mechanisms of the body alone, are quite remarkable; but once we add the functionalities of the mind to the mix, the body often succumbs to the mind’s agency in decision- making, be it conscious or sub-conscious. Although quite awesome and intricate to...

Getting Comfortable Outside of Your Comfort Zone

If you struggle with anxiety, depression, or self-doubt, you’ve likely struggled with stepping outside of your comfort zone. It makes sense - comfort zones lack variability - they are familiar, they are controllable, they are, well, comfortable. While we all deserve...