Researchers at the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and the Institute of Medical Engineering and Science (IMES) have developed a wearable they say can predict the mood of its wearer by analyzing speech patterns and physiological signs. The system may someday serve as a social coach for people with anxiety or Asperger’s syndrome.
“Imagine if, at the end of a conversation, you could rewind it and see the moments when the people around you felt the most anxious,” Tuka Alhanai, a CSAIL graduate student who worked on the project, said in a statement. “Our work is a step in this direction, suggesting that we may not be that far away from a world where people can have an AI social coach right in their pocket.”
Using two AI algorithms and a Samsung Simband, the system measures vitals like heart rate, blood pressure, blood flow, and skin temperature, while recording audio data related to the wearer’s pitch, tone, and vocabulary. It then attempts to identify the speaker’s mood, from positive to neutral to negative, in five-second increments.