Hyperspectral Image Denoising via Spatial–Spectral Recurrent Transformer

Loading...
Thumbnail Image
File version

Accepted Manuscript (AM)

Author(s)
Fu, Guanyiman
Xiong, Fengchao
Lu, Jianfeng
Zhou, Jun
Zhou, Jiantao
Qian, Yuntao
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2024
Size
File type(s)
Location
License
Abstract

Hyperspectral images (HSIs) often suffer from noise arising from both intraimaging mechanisms and environmental factors. Leveraging domain knowledge specific to HSIs, such as global spectral correlation (GSC) and nonlocal spatial self-similarity (NSS), is crucial for effective denoising. Existing methods tend to independently utilize each of these knowledge components with multiple blocks, overlooking the inherent 3-D nature of HSIs where domain knowledge is strongly interlinked, resulting in suboptimal performance. To address this challenge, this article introduces a spatial–spectral recurrent transformer U-Net (SSRT-UNet) for HSI denoising. The proposed SSRT-UNet integrates NSS and GSC properties within a single SSRT block. This block consists of a spatial branch and a spectral branch. The spectral branch employs a combination of the transformer and the recurrent neural network (RNN) to perform recurrent computations across bands, allowing for GSC exploitation beyond a fixed number of bands. Concurrently, the spatial branch encodes NSS for each band by sharing keys and values with the spectral branch under the guidance of GSC. The interaction between the two branches enables the joint utilization of NSS and GSC, avoiding their independent treatment. Experimental results demonstrate that our method outperforms several alternative approaches. The source code will be available at https://github.com/lronkitty/SSRT .

Journal Title

IEEE Transactions on Geoscience and Remote Sensing

Conference Title
Book Title
Edition
Volume

62

Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

This work is covered by copyright. You must assume that re-use is limited to personal use and that permission from the copyright owner must be obtained for all other uses. If the document is available under a specified licence, refer to the licence for details of permitted re-use. If you believe that this work infringes copyright please make a copyright takedown request using the form at https://www.griffith.edu.au/copyright-matters.

Item Access Status
Note
Access the data
Related item(s)
Subject
Persistent link to this record
Citation

Fu, G; Xiong, F; Lu, J; Zhou, J; Zhou, J; Qian, Y, Hyperspectral Image Denoising via Spatial-Spectral Recurrent Transformer, IEEE Transactions on Geoscience and Remote Sensing, 2024, 62, pp. 5511214

Collections