학술논문

Equivalent processing of facial expression and identity by macaque visual system and task-optimized neural network
Document Type
article
Source
NeuroImage, Vol 273, Iss , Pp 120067- (2023)
Subject
Primate vision
Monkey visual cortex
Monkey functional MRI
Multi-task deep neural network (multi-task DNN)
Facial expression
Face perception
Neurosciences. Biological psychiatry. Neuropsychiatry
RC321-571
Language
English
ISSN
1095-9572
Abstract
Both the primate visual system and artificial deep neural network (DNN) models show an extraordinary ability to simultaneously classify facial expression and identity. However, the neural computations underlying the two systems are unclear. Here, we developed a multi-task DNN model that optimally classified both monkey facial expressions and identities. By comparing the fMRI neural representations of the macaque visual cortex with the best-performing DNN model, we found that both systems: (1) share initial stages for processing low-level face features which segregate into separate branches at later stages for processing facial expression and identity respectively, and (2) gain more specificity for the processing of either facial expression or identity as one progresses along each branch towards higher stages. Correspondence analysis between the DNN and monkey visual areas revealed that the amygdala and anterior fundus face patch (AF) matched well with later layers of the DNN's facial expression branch, while the anterior medial face patch (AM) matched well with later layers of the DNN's facial identity branch. Our results highlight the anatomical and functional similarities between macaque visual system and DNN model, suggesting a common mechanism between the two systems.