Spatial transcriptomics prediction from histology jointly through Transformer and graph neural networks

No Thumbnail Available
File version
Author(s)
Zeng, Yuansong
Wei, Zhuoyi
Yu, Weijiang
Yin, Rui
Yuan, Yuchen
Li, Bingling
Tang, Zhonghui
Lu, Yutong
Yang, Yuedong
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2022
Size
File type(s)
Location
License
Abstract

The rapid development of spatial transcriptomics allows the measurement of RNA abundance at a high spatial resolution, making it possible to simultaneously profile gene expression, spatial locations of cells or spots, and the corresponding hematoxylin and eosin-stained histology images. It turns promising to predict gene expression from histology images that are relatively easy and cheap to obtain. For this purpose, several methods are devised, but they have not fully captured the internal relations of the 2D vision features or spatial dependency between spots. Here, we developed Hist2ST, a deep learning-based model to predict RNA-seq expression from histology images. Around each sequenced spot, the corresponding histology image is cropped into an image patch and fed into a convolutional module to extract 2D vision features. Meanwhile, the spatial relations with the whole image and neighbored patches are captured through Transformer and graph neural network modules, respectively. These learned features are then used to predict the gene expression by following the zero-inflated negative binomial distribution. To alleviate the impact by the small spatial transcriptomics data, a self-distillation mechanism is employed for efficient learning of the model. By comprehensive tests on cancer and normal datasets, Hist2ST was shown to outperform existing methods in terms of both gene expression prediction and spatial region identification. Further pathway analyses indicated that our model could reserve biological information. Thus, Hist2ST enables generating spatial transcriptomics data from histology images for elucidating molecular signatures of tissues.

Journal Title

Briefings in Bioinformatics

Conference Title
Book Title
Edition
Volume

23

Issue

5

Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
Item Access Status
Note
Access the data
Related item(s)
Subject

Clinical sciences

Bioinformatics and computational biology

Science & Technology

Life Sciences & Biomedicine

Biochemical Research Methods

Mathematical & Computational Biology

Biochemistry & Molecular Biology

Persistent link to this record
Citation

Zeng, Y; Wei, Z; Yu, W; Yin, R; Yuan, Y; Li, B; Tang, Z; Lu, Y; Yang, Y, Spatial transcriptomics prediction from histology jointly through Transformer and graph neural networks, Briefings in Bioinformatics, 2022, 23 (5), pp. bbac297

Collections