Facebook’s New AI Technology Will Be Able To Detect Suicidal Posts — And Here’s What They’ll Do About It

Share
Ad failed to load

People share everything from major life announcements to what they're eating for dinner on social media, but what should happen if someone posts a status about feeling suicidal? One social media giant is trying to prevent tragedy through new technology. On Nov. 27, Facebook announced that it artificial intelligence technology will be used to detect posts that indicate a user is at risk for suicide. The software will scan posts for concerning language and report them to trained moderators, who will call first responders or send helpful resources to the person in crisis. This isn't Facebook's first suicide prevention effort — according to a Facebook spokesperson who spoke to Bustle on background, they've been working on suicide prevention tools for over 10 years. Last year, the company created a reporting center for people concerned that their Facebook friends could be in danger. Earlier this year, Facebook added suicide prevention tools to Facebook Live after several disturbing cases of users live-streaming their suicide attempts.

This new initiative seems to be yet another effort to help people experiencing mental distress and for people who want to help their friends. The Facebook spokesperson tells Bustle that the social media network is in a unique position to connect people with friends and organizations who can provide support. Guy Rosen, VP of product management at Facebook, said in a press release that the technology is part of an "ongoing effort to help build a safe community on and off Facebook." According to Rosen, the AI will use pattern recognition to pick up on suicidal ideation in posts and videos. Facebook is also adding more moderators to its Community Reports team to review reports of suicidal posts. "This ensures we can get the right resources to people in distress and, where appropriate, we can more quickly alert first responders," Rosen said in the release.

Ad failed to load

According to Rosen, the tool was developed with help from crisis hotlines and mental health organizations like the National Suicide Prevention Lifeline.

John Draper, director of the National Suicide Prevention Lifeline, tells Bustle that research has shown AI can help identify people who might be in crisis. "We’ve been advising Facebook on how to create a more supportive environment on their social platform so that people who need help can get it faster, which ultimately, can save lives,” he says.

Facebook founder and CEO Mark Zuckerberg released a statement about the new initiative. "With all the fear about how AI may be harmful in the future, it's good to remind ourselves how AI is actually helping save people's lives today," the statement reads.

Ad failed to load

He wrote that suicide is a leading cause of death for young adults and that tools like this one can help prevent unnecessary deaths. "There's a lot more we can do to improve this further. Today, these AI tools mostly use pattern recognition to identify signals — like comments asking if someone is okay — and then quickly report them to our teams working 24/7 around the world to get people help within minutes," Zuckerberg said. "In the future, AI will be able to understand more of the subtle nuances of language, and will be able to identify different issues beyond suicide as well, including quickly spotting more kinds of bullying and hate."

Even though Facebook's technology could save lives — according to Rosen, first responders have conducted more than 100 wellness checks this month thanks to Facebook — some people are still worried about privacy. Facebook told TechCrunch that users can't opt out of having their posts scanned, and people began to voice concern. One Twitter user compared the new technology to something out of dystopian TV show Black Mirror. Additionally, the AI won't be used in the European Union because of a law that forbids personal data analysis without a user's permission.

I can understand the hesitancy. I've dealt with suicidal ideation before, but I've never asked for help publicly. How would I have felt if Facebook automatically had a moderator message me? It's hard to say, but I can understand how this could feel like an invasion of privacy. It's also worth noting that many police officers aren't properly trained to help people with mental illness, and authorities interacting with suicidal people can result in the person who needs help getting killed. There's no easy solution, but Facebook seems to be trying to save lives, and it feels like a step in the right direction.

Ad failed to load
Must Reads

Everything Leaving & Coming To Netflix In March, So You Can Plan Your Next Marathon Now

Even though the groundhog saw his shadow — forecasting six more weeks of winter — a nice spring thaw is already on everyone's minds. Fortunately, Netflix has things squared away for March. Whether you're ready to cozy up in front of a fire or get you…
By Sophy Ziss

11 Thoughts That Mean You’re Not As Happy With Your Partner As You Might Think

Even if your current dating situation seems to be going well — you're hanging out, having fun, having sex, etc. — it's still possible that you might not be happy with your partner, and thus not truly happy in your relationship. This can be a gut feel…
By Carolyn Steber

25 Book Recommendations From Your Favorite TV Characters

Although the two may seem like natural enemies, the truth is, television and reading are a match made in bibliophile heaven. Not only are some of the best shows based on or inspired by literature, but whenever you turn on the tube you can be sure to …
By Sadie Trombetta

It Took Heather Graham YEARS To Make A Movie About Women Ditching Toxic Men. The Reason? Men.

They say you should write what you know. But in Hollywood, that age-old advice apparently needs an addendum: Write what you know — as long as men are into it. And for actor and newly minted director/screenwriter Heather Graham — a woman who swam thro…
By Kelsea Stahler

Bustle's Editors On Rachel McAdams + Parkland Survivors

Happy Thursday, everyone! I don't know about you, but I feel like February has gone by so so fast (wasn't January, like, yesterday?). This year is hurrying along, and with so much happening every day it's hard to keep up all the time. But, I've got a…
By Danielle Colin-Thome

7 Signs Your Energy Is Closed Off To Love, According To A Psychic

Finding love requires more than just the actions of going on dates or setting up an online dating profile. It also requires opening yourself up to love and giving off the vibe that you're open. You may not even realize it if you're energetically bloc…
By Suzannah Weiss

Target Just Launched A Gorgeous New Home Brand — And Most Pieces Are Under $30

Design lovers rejoice! Everyone's favorite store for pretty much everything is about to make all your daring decorating dreams come true. Today, Target's corporate blog issued a press release that provides a peek into Target's new homeware line, Opal…
By Callie Tansill-Suddath

17 Brilliant Ways To Support Parkland Survivors Wherever You Are

Following the massacre at Marjory Stoneman Douglas High School in Parkland, Florida, survivors are demanding Congress take action. A large group of students who survived the shooting are opposing politicians' "thoughts and prayers," arguing that inst…
By Sarah Beauchamp

Here's Where Your Next Trip Should Be, Based On Your Zodiac Sign

If you've been craving a vacation, now is a good time to take the plunge. According to data collected by travel site Expedia, late winters and early spring are pretty much the best times of the year to go on vacation. Based on average airfare ticket …
By Callie Tansill-Suddath

How This Quadriplegic Beauty Lover Beat Cancer & Became A Professional Makeup Artist

In 2010, one day before she was supposed to start cosmetology school, Steph Aiello was involved in a car crash that left her paralyzed from the waist down with limited ability to move her hands and one of her closest friends dead. She would spend the…
By Sara Tan

7 Common Marriage Rules That Aren't Good For Relationships

When it comes to marriage, everyone loves to give their two cents, and with all the warnings and advice floating around out there, no wonder people find marriage intimidating. Luckily, you don't always have to play by the rules, and there's some bad …
By Carina Wolff

The Infuriating Way Hollywood Movie Sets Are Designed To Make Life Harder For Women

Whitney Cummings is fed up — with the way Hollywood treats women, and in particular, the way the it treats female directors who have children. While the entertainment industry may be working hard to get more women behind the camera, Cummings wants to…
By Casey Cipriani

Why Uggs Are Never Going Away, Whether You Like Them Or Not

Uggs. The word alone can conjure up memories of teenage years, regrettable outfits, and undeniable comfort. But if, like me, you thought that you've already said goodbye to those fleece-lined tan boots, you can think again. It seems fashion has adopt…
By Lauren Sharkey

Netflix's New Romantic Movie Will Have You Crying Like It's 'The Fault In Our Stars'

Cancer movies are a heartbreaking staple of Hollywood and have been for decades. It's almost a law of nature: new year, new cancer movie. This year, it's Netflix's Irreplaceable You, a heartbreaking original about a longtime couple who get thrown for…
By Olivia Truffaut-Wong

I Got A Breast Reduction & It Was About So Much More Than The Size Of My Boobs

As a young teenager, I pretty much reached peak physical maturity overnight. One day I was wearing my first training bra a la Lizzie McGuire, and the next I was sweatily fumbling around a Victoria’s Secret with 32DD boobs, trying to summon up the cou…
By Sierra Taylor Horton

Adam Rippon and Mirai Nagasu Have Matching Tattoos & The Story Is So Cute

Olympic season gives people the feels. From those shipping Canadian ice dancing pair Tessa Virtue and Scott Moir to Shaun White's gold medal win on Tuesday, the feels are real. Now, there's another reason to get all up in your emotions. Adam Rippon a…
By Shea Simmons

A New Study Says Being In A Relationship Could Change Your Taste In Wine — Here's How

I’d be willing to bet that for many of you, a nice bottle of wine is awaiting you in your near future — and if you’re planning on sharing that bottle with a partner, there might be more to your choice than meets the eye: According to recent research,…
By Lucia Peters

Carrie Brownstein On Why Even The Obama Era Should Have Enraged You

An icy January morning soon after Hollywood's show of solidarity for the #MeToo movement at the Golden Globes and almost exactly one year into the Trump Administration feels like a momentous time to be sitting across from Carrie Brownstein. The Sleat…
By Samantha Rollins

Here’s What The Upcoming Year Of The Dog Means For Your Chinese Zodiac Sign

On Feb. 16 the world will celebrate the Chinese New Year, welcoming the Year of the Dog in like the good doggo it is — we hope. A new year means new zodiac predictions for the 365 days ahead. So, what does the Year of the Dog mean for your Chinese zo…
By Brittany Bennett

7 Signs You're Ready To Get Into A Relationship, According To Experts

It can be difficult to tell when you're ready to start dating again. Maybe you're coming off of a bad breakup, maybe you've just been focused on other things. And, ironically, one of the signs that you're ready to be in a relationship is that you're …
By Lea Rose Emery

The 15 Best Fiction Books Of February Feature Tons Of Extraordinary Women

When the cold winds of February blow in, there's nothing I want more than to hide under my covers with a good book. Luckily, there's more than a few fantastic new fiction books coming out this month, so the only tough decision you'll have to make is …
By Melissa Ragsdale