학술논문

Robustness Certification of k-Nearest Neighbors
Document Type
Conference
Source
2023 IEEE International Conference on Data Mining (ICDM) ICDM Data Mining (ICDM), 2023 IEEE International Conference on. :110-119 Dec, 2023
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Machine learning algorithms
Approximation algorithms
Robustness
Stability analysis
Certification
Thermal stability
Numerical stability
k-nearest neighbors
robustness
individual fairness
formal certification
Language
ISSN
2374-8486
Abstract
We study the certification of stability properties, such as robustness and individual fairness, of the k-Nearest Neighbor algorithm (kNN). Our approach leverages abstract interpretation, a well-established program analysis technique that has been proven successful in verifying several machine learning algorithms, notably, neural networks, decision trees, and support vector machines. In this work, we put forward an abstract interpretation-based framework for designing a sound approximate version of the kNN algorithm, which is instantiated to the interval and zonotope abstractions for approximating the range of numerical features. We show how this abstraction-based method can be used for stability, robustness, and individual fairness certification of kNN. Our certification technique has been implemented and experimentally evaluated on several benchmark datasets. These experimental results show that our tool can formally prove the stability of kNN classifiers in a precise and efficient way, thus expanding the range of machine learning models amenable to robustness certification.