CTMNet: Enhanced Open-pit Mine Extraction and Change Detection with a Hybrid CNN-Transformer Multitask Network

No Thumbnail Available
File version
Author(s)
Xing, J
Zhang, J
Li, J
Gao, Y
Du, S
Zhang, C
Wang, Y
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2024
Size
File type(s)
Location
License
Abstract

Automatic open-pit mine extraction and change detection from high-resolution remote sensing images are of great importance to mineral resource management. However, the high spatial heterogeneity and spectral variations of mining area scenarios make these tasks challenging. Motivated by the strong correlation between the two tasks and their potential mutual benefits, this article presents a hybrid convolutional neural network (CNN)–Transformer multitask network (CTMNet). Constructed in an encoder-decoder manner, CTMNet has two sperate extraction paths (EPs) to localize the regions of interest for bi-temporal images, along with a change detection path (CDP) to identify discrepancies by differentiating the multiscale feature representations from the EPs. As the basic building block for the EP, a CNN-Transformer hybrid block is designed to enhance the global and local feature representation capacity. To cope with the variations in the bi-temporal images, we propose the feature alignment module for the CDP. A hard sample mining-based contrastive constraint loss is proposed to emphasize the contributions of hard samples to the training process. The experimental results on a collected open-pit mine extraction and change detection dataset (OMECSet) and two public datasets reveal the validity of the CTMNet when compared to the state-of-the-art methods. The OMECSet and the code of CTMNet have been made public available at https://figshare.com/s/80519cb980ca54456447 .

Journal Title

IEEE Transactions on Geoscience and Remote Sensing

Conference Title
Book Title
Edition
Volume

62

Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
Item Access Status
Note
Access the data
Related item(s)
Subject

Photogrammetry and remote sensing

Earth sciences

Engineering

Persistent link to this record
Citation

Xing, J; Zhang, J; Li, J; Gao, Y; Du, S; Zhang, C; Wang, Y, CTMNet: Enhanced Open-pit Mine Extraction and Change Detection with a Hybrid CNN-Transformer Multitask Network, IEEE Transactions on Geoscience and Remote Sensing, 2024, 62, pp. 5409619

Collections