학술논문

Supervised Learning for Coverage-Directed Test Selection in Simulation-Based Verification
Document Type
Conference
Source
2022 IEEE International Conference On Artificial Intelligence Testing (AITest) AITEST Artificial Intelligence Testing (AITest), 2022 IEEE International Conference On. :19-25 Aug, 2022
Subject
Computing and Processing
Engineering Profession
General Topics for Engineers
Robotics and Control Systems
Supervised learning
Redundancy
Manuals
Production
Life estimation
Learning (artificial intelligence)
Writing
Design Verification
Supervised Learning
Coverage-Directed Test Generation
Test Selection
Machine Learning for Verification
CDG
EDA
Language
Abstract
Constrained random test generation is one of the most widely adopted methods for generating stimuli for simulation-based verification. Randomness leads to test diversity, but tests tend to repeatedly exercise the same design logic. Constraints are written (typically manually) to bias random tests towards interesting, hard-to-reach, and yet-untested logic. However, as verification progresses, most constrained random tests yield little to no effect on functional coverage. If stimuli generation consumes significantly less resources than simulation, then a better approach involves randomly generating a large number of tests, selecting the most effective subset, and only simulating that subset. In this paper, we introduce a novel method for automatic constraint extraction and test selection. This method, which we call coverage-directed test selection, is based on supervised learning from coverage feedback. Our method biases selection towards tests that have a high probability of increasing functional coverage, and prioritises them for simulation. We show how coverage-directed test selection can reduce manual constraint writing, prioritise effective tests, reduce verification resource consumption, and accelerate coverage closure on a large, real-life industrial hardware design.