학술논문

Data Imputation with an Autoencoder and MAGIC
Document Type
Conference
Source
2023 International Conference on Sampling Theory and Applications (SampTA) Sampling Theory and Applications (SampTA), 2023 International Conference on. :1-5 Jul, 2023
Subject
Computing and Processing
General Topics for Engineers
Signal Processing and Analysis
Deep learning
Manifolds
Noise reduction
Benchmark testing
Generative adversarial networks
Data models
Robustness
Language
ISSN
2694-0108
Abstract
Missing data is a common problem in many applications. Imputing missing values is a challenging task, as the imputations need to be accurate and robust to avoid introducing bias in downstream analysis. In this paper, we propose an ensemble method that combines the strengths of a manifold learning-based imputation method called MAGIC and an autoencoder deep learning model. We call our method Deep MAGIC. Deep MAGIC is trained on a linear combination of the mean squared error of the original data and the mean squared error of the MAGIC-imputed data. Experimental results on three benchmark datasets show that Deep MAGIC outperforms several state-of-the-art imputation methods, demonstrating its effectiveness and robustness in handling large amounts of missing data.