利用空间-光谱双分支特征和动态选择的高光谱影像农作物分类

高光谱遥感可以捕获地表近乎连续的光谱曲线,以较高的光谱诊断能力对地表农作物进行精细分类与识别。传统基于深度学习的高光谱分类算法中空间、光谱特征捕捉利用困难、冗余特征筛选能力不足、模型约束过于单一等问题,导致农作物类型复杂且样本分布不均区域分类模型性能下降。该研究提出一种基于空间-光谱双分支动态特征选择的高光谱分类算法,在结合通道注意力机制和空间注意力机制进行空间-光谱特征提取的基础上,通过门控卷积层对提取到的特征进行相关性的计算和处理,实现空间维度和通道维度上的特征动态选择,并分别从空间、光谱和联合特征3个角度对分类结果约束,结合分类损失函数实现高光谱影像的分类任务。结果表明,在JAAS(Jiangsu academy of agricultural sciences,江苏省农业科学院)高光谱农作物分类数据集上,该研究算法总体精度、Kappa系数分别为99.35%和99.20%,相较于专为高光谱分类设计的算法CDCNN(contextual deep convolution network,上下文深层卷积网络)、 WCRN(wide contextual residual networ...

Classifying crops from hyperspectral images using spatial-spectral dual branches and dynamic feature selection

Hyperspectral remote sensing images can capture the continuous spectral curves of the ground surface, and then enable the delicate classification of crops, due to their diagnostic capability of high spectral data. The conventional algorithms of hyperspectral image classification are highly required to explore the spatial information and effective utilization of spectral images. It cannot be fully addressed on the "same object, different spectra; different objects, same spectra" problem, such as the Hughes phenomenon. The classification accuracy has been improved with the continuous development of deep learning-based classification on hyperspectral images. However, there are still several issues that need to be addressed: 1) Traditional convolution layers can be calculated by the equal weights for all pixels in the feature extraction, particularly without considering the spatial correlation and local similarity within the feature neighborhood. 2) Although the previous algorithms have separately captured the spatial and spectral features in the hyperspectral images, the extraction of high-dimensional features can often result in redundancy, which is lacking in effective feature selection. 3) Traditional algorithms of deep learning can often merge the temporal and spatial features using a single feature constraint method, especially for loss calculation. Comprehensive feedback is required on the classification from the spatial and spectral perspectives. The comprehensiveness of the fused features can remain to be examined during this time. In this study, a hyperspectral classification algorithm was proposed using a spatial-spectral dual-branch architecture and a dynamic feature selection strategy. The channel and spatial attention modules were introduced to extract and screen the spatial-spectral joint features. Moreover, the gated convolutional layers were used to calculate the correlation of extracted features, enabling dynamic feature selection in both the spatial and channel dimensions. A novel loss function was designed to constrain the classification, in terms of the spatial and spectral perspectives. The results indicate that: 1) The DBDS algorithm performed better in the time efficiency and accuracy, compared with the mainstream crop classification. On the JAAS dataset, the OA and Kappa of the improved algorithms were 99.35% and 99.2%, respectively, which were 4.91% and 6.12%, 6.82% and 8.53%, 2.12% and 2.63%, 2.04% and 2.54% higher than those of CDCNN, WCRN, DBDA, and DCNN, respectively. On the WHU-Hi-HanChuan dataset, the OA of 99.49% and the Kappa of 99.41% were 1.67% and 1.96%, 3.23% and 3.8%, 2% and 2.35%, 1.1% and 1.29% higher than those of CDCNN, WCRN, DBDA, and DCNN, respectively. On the WHU-Hi-Longkou dataset, the OA and Kappa were also improved, reaching 99.8% and 99.74%, respectively, which were 1.3% and 1.71%, 0.59% and 1.74%, 0.71% and 0.93%, 0.57% and 0.76% higher than those of CDCNN, WCRN, DBDA, and DCNN, respectively. 2) The spatial-spectral features were effectively extracted to reduce the model degradation in the dataset with the limited samples, complex and difficult-to-distinguish land cover classification. On the WHU-Hi-Hanchuan dataset, the DBDA algorithm was focused on the extraction of spectral information. The better performance was achieved in the tasks of crop classification with sufficient samples, indicating the high f1 scores for the strawberry, Cowpea, soybean, and sorghum (99.6%, 99.1%, 99. 41%, and 99.71%, respectively). However, the significant degradation of the model was observed to classify the lack-sample targets, where the f1 scores for the watermelon and bare soil were only 86.30% and 91.07%, respectively. By contrast, the DBDS algorithm improved the recognition accuracy of various crops with the f1 scores of 96.65% and 98.23% for the watermelon and bare soil, respectively, indicating the effective extraction and utilization of spatial and spectral features. Therefore, the higher accurate and efficient classification was achieved in the fine-grained crop in the regions with the imbalanced samples and the diverse types of land covering. Therefore, 2D convolution-based hyperspectral classification algorithms can be expected to obtain the effective extraction of spatial-spectral features with comparable accuracy to 3D convolution with fewer parameter computations. This finding can also provide important implications and strong references for the target recognition tasks using hyperspectral data.