학술논문

eAIEDF: Extended AI Error Diagnosis Flowchart for Automatically Identifying Misprediction Causes in Production Models
Document Type
Conference
Source
2024 IEEE/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) ICSE-COMPANION Software Engineering: Companion Proceedings (ICSE-Companion), 2024 IEEE/ACM 46th International Conference on. :335-336 Apr, 2024
Subject
Computing and Processing
Flowcharts
Adaptation models
Analytical models
Production
Manuals
Machine learning
Numerical models
MLOps
Machine Learning
Error Analysis
Explainability
Language
ISSN
2574-1934
Abstract
MLOps, addressing operational issues in machine learning, has gained attention for enhancing the performance of production models. A core challenge is efficiently understanding the causes of mispredictions, as current methods often require labor-intensive manual analysis. To address this, we propose the Extended AI Error Diagnosis Flowchart (eAIEDF) as an extension of the AIEDF, an automated method for identifying root causes of mispredictions during model operation, in order to make it adaptable to both classification and regression models, ensuring applicability in various use cases. Compared to AIEDF, eAIEDF features a more comprehensive flowchart structure for improved cause identification. Through numerical experiments, we confirm that eAIEDF provides valuable insights for enhancing model performance.