Numao and his team of scientists wanted to enhance the interactive experience by feeding to the machine the user’s emotional state. Users listened to music while wearing wireless headphones that contained brain wave sensors. These sensors detected EEG readings, which the robot used to make music.
“We preprogrammed the robot with songs, but added the brain waves of the listener to make new music.” Numao found that users were more engaged with the music when the system could detect their brain patterns.
Numao envisions a number of societal benefits to a human-machine interface that considers emotions. “We can use it in health care to motivate people to exercise or cheer them up.” The device was on display at the 3rd Wearable Expo in Tokyo Japan last January.