학술논문

SFF-DA: Spatiotemporal Feature Fusion for Nonintrusively Detecting Anxiety
Document Type
Periodical
Source
IEEE Transactions on Instrumentation and Measurement IEEE Trans. Instrum. Meas. Instrumentation and Measurement, IEEE Transactions on. 73:1-13 2024
Subject
Power, Energy and Industry Applications
Components, Circuits, Devices and Systems
Feature extraction
Anxiety disorders
Spatiotemporal phenomena
Data mining
Physiology
Training
Mouth
Facial video understanding
feature fusion
few-shot learning
nonintrusive anxiety detection
spatiotemporal feature extraction
Language
ISSN
0018-9456
1557-9662
Abstract
The early detection of anxiety disorders is crucial in mitigating distress and enhancing outcomes for individuals with mental disorders. Deep learning methods and traditional machine learning approaches are both used for the early screening of mental disorders, particularly those with anxiety symptoms. These methods excel at extracting spatiotemporal features associated with mental disorders; however, they often overlook potential interrelationships among these features. Furthermore, the effectiveness of the existing methods is hindered by disparities in the quality of subject data collected in nonlaboratory settings, limited data sample sizes, and other factors. Therefore, we propose a nonintrusive anxiety detection framework based on spatiotemporal feature fusion. Within this framework, spatiotemporal features are extracted from physiological and behavioral data through a shared feature extraction network. In addition, we design a few-shot learning architecture to compute the coupling of fused spatiotemporal features, assessing the similarity of various feature types within sample pairs. Furthermore, joint training strategies applied within the framework significantly enhance the performance of classification performance. We validate the performance of our framework through experiments with a real-world seafarer dataset. The experimental results unequivocally demonstrate that our framework outperforms comparative approaches.