Sign In

Communications of the ACM

ACM TechNews

Mental Health Monitoring Through 'Selfie' Videos and Social Media Tracking


A woman snapping a selfie.

Researchers at the University of Rochester say they have developed an approach that can turn any camera-equipped computer or smartphone into a personal mental health monitoring device.

Credit: infomastern

University of Rochester researchers have developed an approach to turning any computer or smartphone with a camera into a personal mental health monitoring device.

The approach uses software to analyze "selfie" videos recorded by a webcam as the user engages with social media. The program is designed to be unobtrusive, in that it does not require users to explicitly state what they are feeling, input any extra information, or wear any special gear.

The researchers used the program to analyze the video data and extract a number of "clues," such as heart rate, blinking rate, eye pupil radius, and head movement rate. They then enrolled 27 participants in a test group and sent them messages, real tweets, with sentiment to induce their emotion, which enabled them to gauge how subjects reacted after seeing or reading material considered to be positive or negative.

University of Rochester professor Jiebo Luo notes using this system means "effectively giving this app permission to observe you constantly." However, Luo says the program is designed for the use of the user only and does not share data with anyone else unless otherwise designated by the user.

From University of Rochester NewsCenter
View Full Article

 

Abstracts Copyright © 2015 Information Inc., Bethesda, Maryland, USA


 

No entries found

Read CACM in a free mobile app!
Access the latest issue, plus archived issues and more
ACM Logo
  • ACM CACM apps available for iPad, iPhone and iPod Touch, and Android platforms
  • ACM Digital Library apps available for iOS, Android, and Windows devices
  • Download an app and sign in to it with your ACM Web Account
Find the app for your mobile device
ACM DL Logo