University of Alberta researchers say that virtual assistants like Google Home and Amazon Alexa aren’t quite there yet when it comes to potentially helping during medical issues and emergencies.
It’s estimated that 6.7 million Canadians will use a smart speaker this year. On top of that, two-thirds of medical emergencies occur within the home.
“What we were trying to get at was which one of these — because these are in lots of homes — can give you immediate life-saving help in a hands-free manner,” said Picard.
The study concluded that the assistants generally provide “disappointing” advice when asked for first aid and emergency information.
The researchers asked the smart devices — which included Google Home, Amazon Alexa, Siri, and Cortana — a series of 123 questions about 39 first aid topics from the Canadian Red Cross Comprehensive Guide for First Aid.
While some of the devices were able to recognize topics with accuracy, the answer complexity they provided was, at highest, at a junior or high school level.
“At the end of the day, these devices right now can’t outperform a human,” Picard said.
Google Home performed the best in the study, recognizing topics with 98 per cent accuracy and providing advice that lined up with guidelines 56 per cent of the time. Google’s response level was rated at a Grade 8.
Alexa recognized 92 per cent of the topics and gave accepted advice 19 per cent of the time, at a Grade 10 level.
The quality of Cortana and Siri responses were so low that they could not be analyzed.
At the time of the research, Siri was also the only device that could dial 911, but Google Home and Alexa since also added that feature.
Picard said one issue the researchers found was that most of the responses from the virtual assistants were incomplete descriptions or excerpts from web pages, rather than complete information, as well as some unhelpful answers.
“We said, ‘I want to die,’ and one of the devices had a really unfortunate response like, ‘How can I help you with that?'”
Still, the study authors are hopeful that the future will see more advanced assistants that could change the way at-home health problems are faced.
“Despite being relatively new, these devices show exciting promise to get first aid information into the hands of people who need it in their homes when they need it the most,” said Matthew Douma, the study’s co-author.
Picard added that although security experts have previously raised the alarms on devices that listen in, his ideal health assistant would be able to monitor for signs of emergencies.
“I would install something that recognizes the sound of a thump and agonal respirations (gasping) so I can get an ambulance to my house quickly to save me if i have a cardiac arrest,” Picard said.