BEFORE the pandemic, Chu Ka-tim, vice principal of Hong Kong’s True Light College, looked at his students’ faces to gauge how they were responding to class work. Now, with most of his lessons online, technology is helping Chu to read the room. An AI-powered learning platform monitors his students’ emotions as they study at home.

The software, 4 Little Trees, was created by Hong Kong-based startup Find Solution AI. While the use of emotion recognition AI in schools and other settings has caused concern, founder Viola Lam says it can make the virtual classroom as good as — or better than — the real thing.

Students work on tests and homework on the platform as part of the school curriculum. While they study, the AI measures muscle points on their faces via the camera on their computer or tablet, and identifies emotions including happiness, sadness, anger, surprise and fear.

The system also monitors how long students take to answer questions; records their marks and performance history; generates reports on their strengths, weaknesses and motivation levels; and forecasts their grades. The program can adapt to each student, targeting knowledge gaps and offering game-style tests designed to make learning fun. Students perform 10 percent better in exams if they have learned using 4 Little Trees, says Lam.

Lam, a former teacher, recalls finding out that certain students were struggling only when they got their exam results — by which time “it’s too late.”

She launched 4 Little Trees in 2017 — with US$5 million in funding — to give teachers a chance for “earlier intervention.” The number of schools using 4 Little Trees in Hong Kong has grown from 34 to 83, over the last year. Prices range from US$10 to US$49 per student per course.

Lam says the technology has been especially useful to teachers during the pandemic because it allows them to remotely monitor their students’ emotions as they learn.

Chu believes the technology’s benefits will outlast the pandemic, because it reduces his load by creating and marking personalized class work and tests. And, unlike teachers, the expression-reading AI can pay close attention to the emotions of every student, even in a large class.

But technology that monitors children’s faces raises concerns about privacy. Lam says 4 Little Trees records facial muscle data, which is how the AI interprets emotional expressions, but it does not video students’ faces.

Pascale Fung, director of the Center for AI Research at Hong Kong University of Science and Technology, says “transparency” is key to maintaining students’ privacy. She says developers must get consent from parents to collect students’ data, and then “explain where the data is going to go.”

Racial bias is also a serious issue for AI. Research shows that some emotional analysis technology has trouble identifying the emotions of darker skinned faces. Lam says she trains the AI with facial data that matches the demographics of the students.

Lam says Find Solution AI’s emotion recognition works with 85 percent accuracy in Hong Kong. Fung says algorithms with “very good settings” can correctly identify primary emotions, such as happiness and sadness, up to 90 percent of the time.

However, more complex emotions, like irritation, enthusiasm or anxiety, can be harder to read.

“We can hope for 60-70 percent accuracy,” says Fung, adding that most people can’t identify complex emotions with a greater level of accuracy. “Human beings are not good at reading facial expressions” she says. “We would like to train machines to be better than the average human.”

As the AI improves, Lam hopes to develop applications for businesses, as well as schools, to better understand participants’ needs and increase engagement in online meetings and webinars.

(SD-Agencies)