brent phillips

I recently signed up at stumbleupon.com and one of my first ’stumbles’ was physorg.com - a collection of science articles ranging from nanotechnology to health and medicine. In the mix was a great story on human computer interaction (HCI), based on a recent announcement by Massey University in New Zealand. The university has developed a computer-based instructor, Virtual Eve, who not only teaches course material (in math specifically, to eight year olds) but can also change its tone and manner based on the reaction of the viewer. Massey researchers suggest that, “With rising demand for long-distance learning and online tutoring, a computer programe capable of detecting human emotions may become a critical teaching tool.”

On how it works and how they do it:

“Linked to a child via computer, the animated character or virtual tutor can tell if the child is frustrated, angry or confused by the on-screen teaching session and can adapt the tutoring session appropriately.

The animated Eve (with a human-sounding voice) can ask questions, give feedback, discuss questions and solutions and show emotion. To develop the software for this system the Massey team observed children and their interactions with teachers and captured them on thousands of images.

From these images of facial expression, gestures and body movements they developed programs that would capture and recognise facial expression, body movement, and (via a mouse) heart rate and skin resistance. “

To see Eve in action, Massey offers a quicktime video here. To read Massey’s article, click here.