학술논문

CAEVR: Biosignals-Driven Context-Aware Empathy in Virtual Reality
Document Type
Periodical
Source
IEEE Transactions on Visualization and Computer Graphics IEEE Trans. Visual. Comput. Graphics Visualization and Computer Graphics, IEEE Transactions on. 30(5):2671-2681 May, 2024
Subject
Computing and Processing
Bioengineering
Signal Processing and Analysis
Emotion recognition
Electroencephalography
Brain modeling
Real-time systems
Solid modeling
Heart rate variability
Cognitive load
empathy
VR
metaverse
physiology
emotion
context-aware
virtual agents
Language
ISSN
1077-2626
1941-0506
2160-9306
Abstract
There is little research on how Virtual Reality (VR) applications can identify and respond meaningfully to users' emotional changes. In this paper, we investigate the impact of Context-Aware Empathic VR (CAEVR) on the emotional and cognitive aspects of user experience in VR. We developed a real-time emotion prediction model using electroencephalography (EEG), electrodermal activity (EDA), and heart rate variability (HRV) and used this in personalized and generalized models for emotion recognition. We then explored the application of this model in a context-aware empathic (CAE) virtual agent and an emotion-adaptive (EA) VR environment. We found a significant increase in positive emotions, cognitive load, and empathy toward the CAE agent, suggesting the potential of CAEVR environments to refine user-agent interactions. We identify lessons learned from this study and directions for future work.