학술논문

Meta Transductive Linear Probing for Few-Shot Node Classification
Document Type
Conference
Source
2024 IEEE 5th International Conference on Pattern Recognition and Machine Learning (PRML) Pattern Recognition and Machine Learning (PRML), 2024 IEEE 5th International Conference on. :256-260 Jul, 2024
Subject
Computing and Processing
Signal Processing and Analysis
Training
Metalearning
Design methodology
Data visualization
Prediction algorithms
Magnetic heads
Data models
Graph neural networks
Pattern recognition
Few shot learning
meta learning
few-shot learning
graph neural network
self-supervised learning
Language
Abstract
Graph few-shot learning aims to predict well by training with very few labeled data. Meta learning has been the most popular solution for few-shot learning problem. However, transductive linear probing shows that fine-tuning a simple linear classification head after a pretrained graph neural networks can outperforms most of the sophisticated-designed graph meta learning algorithms. Therefore, in the paper, we propose a meta transductive linear probing methods named Meta-TLP to incorporate the advantages of graph self-supervised and graph meta learning model. Specifically, the graph neural network is firstly pretrained with graph contrastive learning methods. Then we design an unsupervised meta training task construction methods to require meta tasks without relying on labeled data. Finally, we meta training the linear classification head on the meta training tasks to learn to fast adopt to novel classes. Experiment results show that our model can perform better than TLP on three real world datasets.