The Brain May Use a Common Neural Code to Read Emotion Across Faces and Voices

A recent study published in the Journal of Neuroscience reveals that the brain uses a common neural code to recognize emotions across both faces and voices. Researchers from Belgium and Portugal conducted a study involving 24 participants who watched or listened to recordings of actors displaying emotions such as happiness, sadness, disgust, and fear.

Using functional magnetic resonance imaging (fMRI), the team observed brain activation in key areas linked to face and voice recognition, including the fusiform face area and temporal voice areas. Interestingly, the authors found that information about emotions spilled over traditional boundaries between these brain regions. This means that the fusiform face area, which is typically associated with processing visual facial expressions, could also identify differences between vocal emotions.

In fact, the study suggests that the brain represents the same emotion similarly, whether it is seen or heard, in several brain regions. Moreover, the researchers discovered that when audiovisual stimuli and single-emotion inputs were combined, the algorithm was not better at identifying the emotional link. This finding challenges previous assumptions about brain regions like the fusiform face area, which were thought to solely recognize fixed features like identity.

Instead, the study highlights the role of brain network information in encoding ever-changing emotional information. While the study had some limitations, including its small sample size and the inability to fully image all relevant brain areas, it provides a new perspective on how the brain processes emotions. The findings suggest that instead of a segregated system where specialized regions process their own data, emotions are instead shared across brain areas.