학술논문

A Pairwise Surrogate Model using GNN for Evolutionary Optimization
Document Type
Conference
Source
2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC) Systems, Man, and Cybernetics (SMC), 2023 IEEE International Conference on. :3996-4002 Oct, 2023
Subject
Aerospace
Bioengineering
Communication, Networking and Broadcast Technologies
Computing and Processing
General Topics for Engineers
Power, Energy and Industry Applications
Robotics and Control Systems
Signal Processing and Analysis
Transportation
Costs
Computational modeling
Predictive models
Benchmark testing
Graph neural networks
Optimization
Cybernetics
Language
ISSN
2577-1655
Abstract
Optimization problems widely arise in various science and engineering fields and can be computationally expensive in many real-world applications. Evaluation of the fitness function to assess a candidate solution is the main operation in all optimization procedures which can be heavily compute-intensive. Machine learning-based surrogate models can contribute to learning the specific pattern among the decision variables and objective values to consequently reduce the computation time of fitness evaluation. In this study, we have proposed a novel pairwise surrogate model to identify the superiority between candidate solutions in a pairwise comparison despite the fact that most of the surrogate models try to predict the exact fitness value. The proposed idea can significantly help the optimizer to reach better results in a shorter period of time. It seems comparing two candidate solutions for a greedy selection is much easier than approximating fitness values for both. We demonstrated Graph Neural Network (GNN) for this purpose to be trained on a limited number of pairwise ranks and then utilized to compare a pair of candidate solutions. In order to examine the efficacy of our model, we utilized different well-known single-objective optimization benchmarks in dimensions 10,20, and 30. Moreover, the results of the learning-based evaluation are compared with the results from the real fitness evaluation. The results, assessed in terms of the number of fitness calls and the best-found solution, showed that the proposed method is able to decrease the computing cost of fitness evaluation significantly while we achieve a comparable solution. Our model can be tested with any optimization algorithm which employs a comparison-based mechanism among its candidate solutions.