How what we see and hear feed together to help us understand emotions
The emotions themselves may be more important than the senses we use to perceive them
The brain does not process emotions by utilizing separate regions for sensory information, as previously believed. Recent research reveals that the brain's response to emotions is more interconnected than previously thought. When seeing an emotive face, the brain's voice-processing centers are activated, and vice versa. This study, led by Stefania Mattioni, a cognitive neuroscience postdoctoral researcher at Ghent University, involved 24 participants watching clips of actors portraying various emotions while connected to an MRI machine.
Both audio-only and video-only clips activated brain regions linked to face and voice processing, indicating that emotion, not the modality, guides the brain's response. This multisensory network plays a crucial role in emotion recognition, enabling faster and more accurate understanding, particularly in complex or noisy environments.
Such findings could aid in developing interventions for individuals struggling with social cues. Additionally, research has shown that brain plasticity allows voice-selective and face-selective regions to adapt to different sensory inputs in those with early deafness or blindness. The study, published in the Journal of Neuroscience, highlights the importance of integrating visual and auditory information to understand emotions more effectively.
Written by urgent.news from Scientific American's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
