Due to the presence of the same object with different spectrum and the same spectrum with different objects in hyperspectral images, spectral information alone cannot fully reflect the features of hyperspectral images, and spatial information can be introduced to capture the features of objects more accurately. Therefore, a hyperspectral image classification method based on hybrid spectral enhancement and multi-scale spatial aggregation is proposed in this paper. In this method, a hybrid spectral enhancement module is designed, multi-scale local features of the spectrum are constructed using wavelet transform, and global features of the spectrum are generated by Transformer architecture, so as to enhance the intra-class consistency of the spectral features. At the same time, a multi-scale spatial aggregation module is designed to extract the inherent multi-scale information of spatial features and establish the interaction between different scales, so as to generate a more robust land cover representation, thereby further improve the classification performance. The experimental results show that the proposed method is superior to other advanced networks, indicating that the method can effectively obtain more abundant spectral information and spatial feature representation.
YangK, SunH, ZouC B, et al. Cross-attention spectral-spatial network for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-14.
[2]
AhmadM, KhanA M, MazzaraM, et al. Hybrid dense network with attention mechanism for hyperspectral image classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15: 3948-3957.
OuyangNing, LiZu-feng, LinLe-ping. Hyperspectral image classification based on a multi-level spatial-spectral fusion network[J]. Journal of Jilin University (Engineering and Technology Edition), 2022,52(10):2438-2446.
OuyangNing, LiZu-feng, LinLe-ping. Hyperspectral image classification based on a spatial-spectral group convolution dense network[J]. Computer Engineering and Design, 2022,43(7):2031-2039.
[7]
HamidaA B, BenoitA, LambertP, et al. 3-D deep learning approach for remote sensing image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(8): 4420-4434.
[8]
DosovitskiyA, BeyerL, KolesnikovA, et al. An image is worth 16×16 words: Transformers for image recognition at scale[J]. Arxiv Preprint, 2010, 11: 201011929.
[9]
HongD F, HanZ, YaoJ, et al. Spectralformer: rethinking hyperspectral image classification with transformers[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-15.
[10]
SunL, ZhaoG R, ZhengY H, et al. Spectral–spatial feature tokenization Transformer for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-14.
[11]
UddinM P, MamunM A, HossainM A. Feature extraction for hyperspectral image classification[C]∥ IEEE Region 10 Humanitarian Technology Conference. Piscataway, NJ: IEEE. 2017: 379-382.
[12]
ZhangD S. Wavelet Transform[J]. Fundamentals of Image Data Mining: Analysis, Features, Classification and Retrieval, 2019: 35-44.
[13]
TangY G, XieX L, YuY H. Hyperspectral classification of two-branch joint networks based on gaussian pyramid multiscale and wavelet transform[J]. IEEE Access, 2022, 10: 56876-56887.
[14]
AhmadM, GhousU, UsamaM, et al. WaveFormer: spectral-spatial wavelet Transformer for hyperspectral image classification[J]. IEEE Geoscience and Remote Sensing Letters, 2024, 21: 1-5.
[15]
WangD, DuB, ZhangL P, et al. Adaptive spectral-spatial multiscale contextual feature extraction for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(3): 2461-2477.
[16]
GaoH M, YangY, LiC M, et al. Multiscale residual network with mixed depthwise convolution for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(4): 3396-3408.
[17]
LengQ M, YangH O, JiangJ J, et al. Adaptive multiscale segmentations for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 58(8): 5847-5860.
[18]
GhaderizadehS, AbbasiM D, SharifiA, et al. Multiscale dual-branch residual spectral-spatial network with attention for hyperspectral image classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15: 5455-5467.
[19]
WangX, TanK, DuP J, et al. A unified multiscale learning framework for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-19.
[20]
BaumgardnerM F, BiehlL L, LandgrebeD A. 220 band aviris hyperspectral image data set: June 12, 1992 Indian pine test site 3[J]. Purdue University Research Repository, 2015, 10(7): 991.
[21]
ZhongY F, HuX, LuoC, et al. WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRF[J]. Remote Sensing of Environment, 2020, 250: 112012.
[22]
ZhongY F, WangX Y, XuY, et al. Mini-UAV-borne hyperspectral remote sensing: From observation and processing to applications[J]. IEEE Geoscience and Remote Sensing Magazine, 2018, 6(4): 46-62.
[23]
MeiS H, LiX G, LiuX, et al. Hyperspectral image classification using attention-based bidirectional long short-term memory network[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-12.