Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Jin, M
Zheng, Y
Li, YF
Gong, C
Zhou, C
Pan, S
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2021
Size
File type(s)
Location

Montreal, Canada

License
Abstract

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of graph contrastive learning and Siamese networks in visual representation learning, we propose a novel self-supervised approach in this paper to learn node representations by enhancing Siamese self-distillation with multi-scale contrastive learning. Specifically, we first generate two augmented views from the input graph based on local and global perspectives. Then, we employ two objectives called cross-view and cross-network contrastiveness to maximize the agreement between node representations across different views and networks. To demonstrate the effectiveness of our approach, we perform empirical experiments on five real-world datasets. Our method not only achieves new state-of-the-art results but also surpasses some semi-supervised counterparts by large margins. Code is made available at https://github.com/GRAND-Lab/MERIT.

Journal Title
Conference Title

IJCAI Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence

Book Title
Edition
Volume
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2021 International Joint Conference on Artificial Intelligence. The attached file is reproduced here in accordance with the copyright policy of the publisher. Please refer to the journal's website for access to the definitive, published version.

Item Access Status
Note
Access the data
Related item(s)
Subject

Neural networks

Information systems

Persistent link to this record
Citation

Jin, M; Zheng, Y; Li, YF; Gong, C; Zhou, C; Pan, S, Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning, IJCAI Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, 2021, pp. 1477-1483