Hyperspectral Image Denoising via Spatial–Spectral Recurrent Transformer
File version
Accepted Manuscript (AM)
Author(s)
Xiong, Fengchao
Lu, Jianfeng
Zhou, Jun
Zhou, Jiantao
Qian, Yuntao
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
Size
File type(s)
Location
License
Abstract
Hyperspectral images (HSIs) often suffer from noise arising from both intraimaging mechanisms and environmental factors. Leveraging domain knowledge specific to HSIs, such as global spectral correlation (GSC) and nonlocal spatial self-similarity (NSS), is crucial for effective denoising. Existing methods tend to independently utilize each of these knowledge components with multiple blocks, overlooking the inherent 3-D nature of HSIs where domain knowledge is strongly interlinked, resulting in suboptimal performance. To address this challenge, this article introduces a spatial–spectral recurrent transformer U-Net (SSRT-UNet) for HSI denoising. The proposed SSRT-UNet integrates NSS and GSC properties within a single SSRT block. This block consists of a spatial branch and a spectral branch. The spectral branch employs a combination of the transformer and the recurrent neural network (RNN) to perform recurrent computations across bands, allowing for GSC exploitation beyond a fixed number of bands. Concurrently, the spatial branch encodes NSS for each band by sharing keys and values with the spectral branch under the guidance of GSC. The interaction between the two branches enables the joint utilization of NSS and GSC, avoiding their independent treatment. Experimental results demonstrate that our method outperforms several alternative approaches. The source code will be available at https://github.com/lronkitty/SSRT .
Journal Title
IEEE Transactions on Geoscience and Remote Sensing
Conference Title
Book Title
Edition
Volume
62
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
This work is covered by copyright. You must assume that re-use is limited to personal use and that permission from the copyright owner must be obtained for all other uses. If the document is available under a specified licence, refer to the licence for details of permitted re-use. If you believe that this work infringes copyright please make a copyright takedown request using the form at https://www.griffith.edu.au/copyright-matters.
Item Access Status
Note
Access the data
Related item(s)
Subject
Persistent link to this record
Citation
Fu, G; Xiong, F; Lu, J; Zhou, J; Zhou, J; Qian, Y, Hyperspectral Image Denoising via Spatial-Spectral Recurrent Transformer, IEEE Transactions on Geoscience and Remote Sensing, 2024, 62, pp. 5511214