학술논문

A Thermal Infrared Face Database With Facial Landmarks and Emotion Labels
Document Type
Periodical
Source
IEEE Transactions on Instrumentation and Measurement IEEE Trans. Instrum. Meas. Instrumentation and Measurement, IEEE Transactions on. 68(5):1389-1401 May, 2019
Subject
Power, Energy and Industry Applications
Components, Circuits, Devices and Systems
Databases
Face
Task analysis
Thermal sensors
Thermal analysis
Visualization
Machine learning algorithms
Face detection
face tracking
facial expression recognition
machine learning
thermal infrared
Language
ISSN
0018-9456
1557-9662
Abstract
Thermal infrared imaging is an emerging modality that has gained increasing interest in recent years, mostly due to technical advances resulting in the availability of affordable microbolometer-based IR imaging sensors. However, while sensors are widely available, algorithms for thermal image processing still lack robustness and accuracy when compared to their RGB counterparts. Current methods developed for RGB data make use of machine learning algorithms that require large amounts of labeled images which are currently not available for the thermal domain. In this paper, we address the question whether providing a large number of labeled images would allow the application of current image processing methods on the example of solving challenging face analysis tasks. We introduce a high-resolution thermal facial image database with extensive manual annotations and explore how it can be used to adapt methods from the visual domain for infrared images. In addition, we extend existing approaches for infrared landmark detection with a head pose estimation for improved robustness and analyze the performance of a deep learning method on this task. An evaluation of algorithm performance shows that learning algorithms either outperform available solutions or allow completely new applications that could previously not be addressed. As a conclusion, we prove that investing the effort into acquiring appropriate training data and adapting competitive algorithms is not only a viable approach in analysing thermal infrared images but can also allow outperforming specific task-designed solutions. The database is freely available for academic use at https://github.com/marcinkopaczka/thermalfaceproject.