Summary: New computer software can accurately detect whether a smile is real or faked. Genuine smiles generate 10% more movement around eye muscles.
Source: University of Bradford
Real and fake smiles can be tricky to tell apart, but researchers at the University of Bradford have now developed computer software that can spot false facial expressions.
By analysing the movement of the smile across a person’s face, the software can determine whether or not the expression is genuine. The most significant movements detected by the software were around the eyes, supporting popular theories that a spontaneous, genuine smile is one that can be seen in a person’s eyes.
“A smile is perhaps the most common of facial expressions and is a powerful way of signalling positive emotions,” says Hassan Ugail, Professor of Visual Computing at the University of Bradford, who led the research. “Techniques for analysing human facial expressions have advanced dramatically in recent years, but distinguishing between genuine and posed smiles remains a challenge because humans are not good at picking up the relevant cues.”
The software works by first mapping a person’s face from within a video recording, and identifying the mouth, cheeks and eyes of the subject. It then measures how these facial features move through the progress of the smile and calculates the differences in movement between the video clips showing real and fake smiles.
Researchers tested the programme using two different datasets, one containing images of people expressing genuine smiles, and another in which the images portrayed posed smiles.
They found significant differences in the way the subjects’ mouths and cheeks moved when comparing the real and the fake expressions. The movements around the subjects’ eyes, however, showed the most striking variation, with genuine smiles generating at least 10 percent more movement in these muscles.
“We use two main sets of muscles when we smile – the zygomaticus major, which is responsible for the curling upwards of the mouth, and the orbicularis oculi, which causes crinkling around our eyes,” explains Professor Ugail. “In fake smiles it is often only the mouth muscles which move but, as humans, we often don’t spot the lack of movement around the eyes. The computer software can spot this much more reliably.”
He adds: “An objective way of analysing whether or not a smile is genuine could help us develop improved interactions between computers and humans – for example in biometric identification. It could also be important to social and clinical scientists aiming to gain more insight into human behaviour and emotion.”
The study is published today in Advanced Engineering Informatics.
Funding: The research was supported in part by the European Union’s Horizon 2020 Programme.
Source:
University of Bradford
Media Contacts:
Beck Lockwood – University of Bradford
Image Source:
The image is credited to University of Bradford.
Original Research: Open access
“A Genuine Smile is Indeed in the Eyes – the Computer Aided Non-invasive Analysis of the Exact Weight Distribution of Human Smiles Across the Face”. Hassan Ugail and Ahmad Al-dahoud.
Advanced Engineering Informatics. doi:10.1016/j.aei.2019.100967
Abstract
A Genuine Smile is Indeed in the Eyes – the Computer Aided Non-invasive Analysis of the Exact Weight Distribution of Human Smiles Across the Face
Understanding the detailed differences between posed and spontaneous smiles is an important topic with a range of applications such as in human-computer interaction, automatic facial emotion analysis and in awareness systems. During the past decade or so, there have been very promising solutions for accurate automatic recognition and detailed facial emotion analysis. To this end, many methods and techniques have been proposed for distinguishing between spontaneous and posed smiles. Our aim here is to go beyond the present state of the art in this field. Hence, in this work, we are concerned with understanding the exact distribution of a smile – both spontaneous and posed – across the face. To do this, we utilise a lightweight computational framework which we have developed to analyse the dynamics of human facial expressions. We utilise this framework to undertake a detailed study of the smile expression. Based on computing the optical flow across the face – especially across key parts of the face such as the mouth, the cheeks and around the eyes – we are able to accurately map the dynamic weight distribution of the smile expression. To validate our computational model, we utilise two publicly available datasets, namely the CK + dataset in which the subjects express posed smiles and the MUG dataset in which the subjects express genuine smiles. Our results not only confirm what already exists in the literature – i.e. that the spontaneous genuine smile is truly in the eyes – but it also gives further insight into the exact distribution of the smile across the face.
