Does Alexa understand your toddler? Western University researchers are looking into it
CBC
Olivia Daub’s two-year-old son is obsessed with “doodidees.” He talks about them and screams for them at 5 a.m. every day.
Daub said most people don’t have a clue what her son is saying, but she knows to bring him the tiny, dark blue fruit that he actually wants: blueberries.
“We’ve all been children and we’ve all had the experience of not being understood by adults. Inversely, we [adults] have all had a really hard time understanding children because they produce speech and language in ways that are different from adults."
Daub, an assistant professor in Western University's school of communication sciences and disorders in London, Ont., said understanding toddler-speak is even trickier for artificial intelligence (AI). That’s why she is leading new research on how AI can better understand the way toddlers talk.
Daub said that while automatic speech recognition software, such as automatic closed captions on Zoom meetings and Amazon’s Alexa virtual assistant, has become good at recognizing adult speech, it still struggles to accurately pick up what young children are saying.
“I think we’ve all seen YouTube clips of a toddler asking Alexa to play a song, and getting something completely different and really inappropriate,” she said. “This study is trying to understand how we can leverage AI and machine-learning principles to improve recognition for toddlers and preschoolers.”
To do that, she’s working with Western electrical and computer engineering assistant professor Soodeh Nikan to train an AI model on toddlers’ common speech patterns and shortcuts.
“Most of the speech models that we have are trained with adult speech, so that’s why most of these models are not very successful in recognizing that toddler speech, especially the mistakes that they make,” Nikan said.
“You have to provide examples to AI [for it] to be able to understand and distinguish normal mistakes and speech disorder problems."
Daub plans to bring in a sample of 30 children to play, tell stories and speak to research assistants. Each session will be recorded and transcribed by humans, who will also collect data on children’s speaking patterns.
One common pattern, Daub said, is that many English-speaking toddlers struggle to pronounce the “r” sound and instead use a “w” sound.
Data like this will be handed over to Nikan, who will feed the information into a private AI model in order to train it.
“We can fine-tune these models using the data that is specifically annotated for this purpose,” said Nikan, adding the AI model will also be trained with some data from already-existing OpenAI online.
Daub and her team have so far met with nine toddlers and are still seeking more study participants.
Montreal officials will hold a ceremony to mark the 36th anniversary of the Polytechnique massacre today.
The City of Regina's proposal to build a roadway through the McKell Wascana Conservation Park should be discarded, local conservationists say.
A holiday event that began in 2020 during the pandemic with three floats on pickup trucks has now become one of Kelowna’s big winter events, drawing thousands to the city’s downtown core.
WARNING: This story details allegations of child abuse.
It’s been hard to keep track of how many legal challenges and active court proceedings the United Conservative government has tried to quash or pre-emptively block in the last six weeks, but let’s try to tally:
Margaret Walker, the emcee of a Waterloo vigil commemorating the victims of the Montreal massacre, doesn't feel enough is being done to reflect on the killings and address gender-based violence.
The P.E.I. Humane Society says it is doing far more fundraising than it used to, and rising expenses — including the cost of animal medications — are a big reason why.
Ottawa is staring down a court-ordered deadline to submit a new plan to reform the on-reserve child welfare system, as a group of First Nations leaders and children’s advocates prepare a competing proposal.
An underpass revitalization project that was meant to pay tribute to the people of Parkdale has instead deteriorated into “a garbage dump,” according to nearby residents.
A young man has been charged with criminal negligence causing bodily harm after a fire at a frat party near Western University that injured five sorority sisters, including two seriously, late Tuesday night.
The massive deal to combine one of Hollywood's oldest studios with a streaming giant hasn't even been approved yet, but it's already riling multiple related industries and politicians concerned about monopolies and media concentration.
Mi'kmaq chiefs and a former Nova Scotia justice minister are criticizing the provincial government for directing police to crack down on illegal cannabis, saying the order undermines relations with Indigenous Peoples.
For years, there has been “glaring inequity” in the way the province has allocated the millions of dollars in its county roads budget, according to Department of Transportation Minister Chuck Chiasson.