Algorithm engineered that can spot hidden feelings

Share this on social media:

Machines that can tell how a person is feeling by recognising almost imperceptible facial expressions could soon be a reality thanks to advances in machine vision algorithms. Scientists at the University of Oulu in Finland have developed an algorithm capable of spotting microexpressions, a form of facial expression that only occurs fleetingly and reveals true emotions even when the person is trying to hide them.

The work, led by Xiaobai Li at the University of Oulu, recorded the expressions of 20 individuals on a camera at 100 frames per second. The group watched a series of videos designed to invoke strong emotions but were also given an incentive to avoid displaying any emotion. Microexpressions tend to occur when the individual is trying to hide what they're really feeling.

The camera picked up 164 microexpressions from the group by recognising when the expression changed from frame to frame. These were then linked to the emotions exhibited in the videos and the images used to train the algorithm.

To overcome the inherently small degree of facial movement exhibited in microexpressions, the scientists algorithm magnified the parts of the face that moved before classifying the emotion.

The team’s algorithm significantly outperformed humans in recognising microexpressions in a comparative test. According to the team, the system is the first one that’s been tested on a spontaneous microexpression data set.

Potential applications include law enforcement and psychological analysis.

Further information:

University of Oulu

Recent News

03 September 2020

Terahertz imaging company, Tihive, has been awarded €8.6m from the European Innovation Council's Accelerator programme to scale up its industrial inspection technology

19 May 2020

The National Institute of Standards and Technology and ASTM Committee E57 have released proceedings on a workshop to define the performance of 3D imaging systems for robots in manufacturing

12 May 2020

The sensors boast a pixel pitch of 5μm thanks to Sony's stacking technology using a copper-to-copper connection. They also deliver high quantum efficiency even in the visible range

06 April 2020

Zensors' algorithms analyse feeds from CCTV cameras to provide real-time data on the number of people in an area and whether safe distances are maintained between them