The system, known as the Automated Virtual Agent for Truth Assessment in Real Time, or AVATAR, has already begun tests with the Canadian Border Services Agency to help border security agents determine whether travelers coming into Canada may have undisclosed motives for entering the country, according to a report on www.phys.org, a science, research and technology news service
“AVATAR is a kiosk, much like an airport check-in or grocery store self-checkout kiosk,” the report quoted San Diego State University management information systems professor Aaron Elkins as saying.
“However, this kiosk has a face on the screen that asks questions of travelers and can detect changes in physiology and behavior during the interview. The system can detect changes in the eyes, voice, gestures and posture to determine potential risk. It can even tell when you’re curling your toes,” said Aaron.
The robot, which is bilingual, polite and responsive would flag passenger if deception is detected.
Here’s how it would work: Passengers would step up to the kiosk and be asked a series of questions such
as, “Do you have fruits or vegetables in your luggage?” or “Are you carrying any weapons with you?” Eye-detection software and motion and pressure sensors would monitor the passengers as they answer the questions, looking for tell-tale physiological signs of lying or discomfort.
The kiosk would also ask a series of innocuous questions to establish baseline measurements so people are just nervous about flying, for example, wouldn’t be unduly singled out.
Once the kiosk detected deception, they would flag those passengers for further scrutiny from human agents.
According to the report, Elkins began working on AVATAR when he was a Ph.D. student at the University of Arizona. As the deception detection project grew more advanced and more sensors were added, more data about the interviewee was analyzed.
When Elkins became an assistant professor at SDSU in the fall of 2016, his work moved with him. Here, he is in the process in completing construction of his lab where he plans to continue researching and teaching students about artificial intelligence.
“We’ve come to realize that this can be used not just for border security, but also for law enforcement, job interviews and other human resources applications as well,” Elkins said. “We continue to make improvements, such as analyzing the collected data using Big Data analysis techniques that make AVATAR a potentially valuable tool across many industries.”
In the meantime, Elkins is looking for a government agency willing to utilize the technology in a real-world application.
“AVATAR has been tested in labs, in airports and at border crossing stations,” Elkins noted. “The system is fully ready for implementation to help stem the flow of contraband, thwart fleeing criminals, and detect potential terrorists and many other applications in the effort to secure international borders.”