Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning
File version
Version of Record (VoR)
Author(s)
Zheng, Y
Li, YF
Gong, C
Zhou, C
Pan, S
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
Size
File type(s)
Location
Montreal, Canada
License
Abstract
Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of graph contrastive learning and Siamese networks in visual representation learning, we propose a novel self-supervised approach in this paper to learn node representations by enhancing Siamese self-distillation with multi-scale contrastive learning. Specifically, we first generate two augmented views from the input graph based on local and global perspectives. Then, we employ two objectives called cross-view and cross-network contrastiveness to maximize the agreement between node representations across different views and networks. To demonstrate the effectiveness of our approach, we perform empirical experiments on five real-world datasets. Our method not only achieves new state-of-the-art results but also surpasses some semi-supervised counterparts by large margins. Code is made available at https://github.com/GRAND-Lab/MERIT.
Journal Title
Conference Title
IJCAI Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence
Book Title
Edition
Volume
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
© 2021 International Joint Conference on Artificial Intelligence. The attached file is reproduced here in accordance with the copyright policy of the publisher. Please refer to the journal's website for access to the definitive, published version.
Item Access Status
Note
Access the data
Related item(s)
Subject
Neural networks
Information systems
Persistent link to this record
Citation
Jin, M; Zheng, Y; Li, YF; Gong, C; Zhou, C; Pan, S, Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning, IJCAI Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, 2021, pp. 1477-1483