학술논문

The What-If Tool: Interactive Probing of Machine Learning Models
Document Type
Periodical
Source
IEEE Transactions on Visualization and Computer Graphics IEEE Trans. Visual. Comput. Graphics Visualization and Computer Graphics, IEEE Transactions on. 26(1):56-65 Jan, 2020
Subject
Computing and Processing
Bioengineering
Signal Processing and Analysis
Tools
Data models
Data visualization
Analytical models
Predictive models
Machine learning
Computational modeling
Interactive Machine Learning
Model Debugging
Model Comparison
Language
ISSN
1077-2626
1941-0506
2160-9306
Abstract
A key challenge in developing and deploying Machine Learning (ML) systems is understanding their performance across a wide range of inputs. To address this challenge, we created the What-If Tool , an open-source application that allows practitioners to probe, visualize, and analyze ML systems, with minimal coding. The What-If Tool lets practitioners test performance in hypothetical situations, analyze the importance of different data features, and visualize model behavior across multiple models and subsets of input data. It also lets practitioners measure systems according to multiple ML fairness metrics. We describe the design of the tool, and report on real-life usage at different organizations.