Cross-Modal Organization of Facial and Vocal Behavior Revealed by Coordination Metrics Derived from Temporal Alignment
Facial and vocal behaviors jointly convey affective and communicative information, yet their cross-modal organization remains difficult to characterize quantitatively. We propose a framework for characterizing facial-vocal organization by aligning facial and vocal dynamics using canonical time warping. Multivariate facial action unit trajectories and vocal prosodic trajectories were extracted…
We haven't written up this one. bioRxiv has the full story — the link below goes straight to it.
