학술논문

Active Reinforcement Learning for Personalized Stress Monitoring in Everyday Settings
Document Type
Conference
Source
2023 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) CHASE Connected Health: Applications, Systems and Engineering Technologies (CHASE), 2023 IEEE/ACM Conference on. :44-55 Jun, 2023
Subject
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
General Topics for Engineers
Robotics and Control Systems
Q-learning
Instruments
Human factors
Predictive models
Data collection
Real-time systems
Biomedical monitoring
Active learning
Personalization
E-healt
lIoT Systems
Language
ISSN
2832-2975
Abstract
Most existing sensor-based monitoring frameworks presume that a large available labeled dataset is processed to train accurate detection models. However, in settings where personalization is necessary at deployment time to fine-tune the model, a person-specific dataset needs to be collected online by interacting with the users. Optimizing the collection of labels in such phase is instrumental to impose a tolerable burden on the users while maximizing personal improvement. In this paper, we consider a fine-grain stress detection problem based on wearable sensors targeting everyday settings, and propose a novel context-aware active learning strategy capable of jointly maximizing the meaningfulness of the signal samples we request the user to label and the response rate. We develop a multilayered sensor-edge-cloud platform to periodically capture physiological signals and process them in real-time, as well as to collect labels and retrain the detection model. We collect a large dataset and show that the context-aware active learning technique we propose achieves a desirable detection performance using 88% and 32% fewer queries from users compared to a randomized strategy and a traditional active learning strategy, respectively.