Facebook to detect and report potential suicide cases

Facebook Inc will expand its pattern recognition software to other countries after successful tests in the U.S. to detect users with suicidal intent, the world’s largest social media network said on Monday.

Facebook began testing the software in the United States in March, when the company started scanning the text of Facebook posts and comments for phrases that could be signals of an impending suicide.

Facebook has not disclosed many technical details of the program, but the company said its software searches for certain phrases that could be clues, such as the questions “Are you ok?” and “Can I help?”

If the software detects a potential suicide, it alerts a team of Facebook workers who specialize in handling such reports. The system suggests resources to the user or to friends of the person such as a telephone help line. Facebook workers sometimes call local authorities to intervene.

Guy Rosen, Facebook‘s vice president for product management, said the company was beginning to roll out the software outside the United States because the tests have been successful. During the past month, he said, first responders checked on people more than 100 times after Facebook software detected suicidal intent.

The company told Global News there is currently no roll out date for the software for Canada.

Get daily National news

Get the day's top news, political, economic, and current affairs headlines, delivered to your inbox once a day.

Sign up for daily National newsletter Sign Up

By providing your email address, you have read and agree to Global News' Terms and Conditions and Privacy Policy.

Facebook said it tries to have specialist employees available at any hour to call authorities in local languages.

“Speed really matters. We have to get help to people in real time,” Rosen said.

Tweet This Click to share quote on Twitter: "Speed really matters. We have to get help to people in real time," Rosen said.

Last year, when Facebook launched live video broadcasting, videos proliferated of violent acts including suicides and murders, presenting a threat to the company’s image. In May Facebook said it would hire 3,000 more people to monitor videos and other content.

Rosen did not name the countries where Facebook was deploying the software, but he said it would eventually be used worldwide except in the European Union due to sensitivities, which he declined to discuss.

Other tech firms also try to prevent suicides. Google’s search engine displays the phone number for a suicide hot line in response to certain searches.

2:09 New research shows alarming trend of suicide among Indigenous youth

• New research shows alarming trend of suicide among Indigenous youth
• Suicide numbers worry Brockville social workers
• Woman talks about her brother’s struggles on World Suicide Prevention Day
• Young people with chronic disease at greater risk of suicide: study
• Vigil for indigenous youth suicide enters Day 20 outside of government office in Toronto
• Youth mental health expert unveils findings after spate of suicides in Cape Breton

Previous Video

Next Video

Facebook knows lots about its 2.1 billion users – data that it uses for targeted advertising – but in general the company has not been known previously to systematically scan conversations for patterns of harmful behavior.

One exception is its efforts to spot suspicious conversations between children and adult sexual predators. Facebook sometimes contacts authorities when its automated screens pick up inappropriate language.

But it may be more difficult for tech firms to justify scanning conversations in other situations, said Ryan Calo, a University of Washington law professor who writes about tech.

“Once you open the door, you might wonder what other kinds of things we would be looking for,” Calo said.

Rosen declined to say if Facebook was considering pattern recognition software in other areas, such as non-sex crimes.

READ MORE: Facebook was designed to be addictive

1:14 Facebook was designed to be addictive

*with a file from Global News