학술논문

Encoder-Decoder Graph Convolutional Network for Automatic Timed-Up-and-Go and Sit-to-Stand Segmentation
Document Type
Conference
Source
ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2023 - 2023 IEEE International Conference on. :1-5 Jun, 2023
Subject
Bioengineering
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Measurement
Signal processing
Acoustics
Convolutional neural networks
Speech processing
action segmentation
automatic TUG segmentation
human movement evaluation
graph convolutional network
Language
ISSN
2379-190X
Abstract
Vision-based action segmentation is an important tool in human movement analysis. In this work, we present a novel Encoder-Decoder Graph Convolutional Network (ED-GCN) to perform auto-segmentation on two widely accepted clinical tests for human mobility and balance assessment: the "Timed-Up-and-Go" (TUG) test and the "Sit-to-Stand" (STS) test. For STS, we perform a fine-grained segmentation that further segments the stand up and sit down actions into more sub-phases. To the best of our knowledge, this is the first work that analyzes such subtle segmentation with biomedical significance. We also propose two novel metrics for action segmentation, which overcome some key drawbacks in the popular F1 and Edit scores. Experiment shows that our network has superior performance over state-of-the-art action segmentation networks in TUG and STS segmentation.