面向误差补偿的高光谱与多光谱图像融合
摘 要
目的 在高光谱和多光谱融合领域,光谱字典学习是一种常用的方法,但是这种算法获得的融合结果不可避免地会损失一部分空间信息。针对这一问题,本文提出了一种面向误差补偿的高光谱和多光谱融合框架,即先利用低分辨率图像构建出误差,再将构建的误差对字典学习所得初步结果进行补偿,从而捕获更多的空间信息和光谱信息。方法 设计了一种基于局部区域的注入系数,使得到的系数能够根据局部区域的光谱特性自适应地调整误差信息的注入权重,从而避免注入过多或者过少的空间信息而导致光谱失真。为了保证融合结果在提升空间分辨率的同时不发生光谱畸变,在梯度域提取多光谱图像的空间结构,构造变分模型,并将光谱字典学习得到的初步结果与计算出的系数相结合构成优化项并将该优化项与变分模型结合,构建出一个新的模型,通过迭代更新,逐步提升补偿系数的精度和融合结果的质量。结果 分别在两个公开数据集上与其他算法进行对比,实验结果表明,本文算法在评价指标和视觉效果上都取得明显提升。从主观分析来看,本文方法可以得到融合质量高、视觉效果自然清晰的目标图像。从客观评价指标来看,在Pavia University数据集上的实验结果在ERGAS(relative dimensionless global error in synthesis)、SAM(spectral angle mapper)、RMSE(root mean square error)指标上与次优方法相比,分别提升了4.2%、4.1%和2.2%;在AVIRIS(airborne visible infrared imaging spectrometer)数据集上分别提升了2.0%,4.0%和3.5%。结论 本文算法在有效提升融合结果空间分辨率的同时,很好地保持了光谱信息。且在不同数据集上取得了较优的表现,具有一定的鲁棒性。
关键词
Hyperspectral and multispectral image fusion focused on error compensation
Fang Shuai1,2, Xu Man1(1.School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China;2.Anhui Province Key Laboratory of Industry Safety and Emergency Technology, Hefei 230601, China) Abstract
Objective Hyperspectral images(HSI) are widely used in image classification and target detection because of their rich and useful spectral information. Their spatial resolution is required to be optimized further due to the limitation of imaging cameras. Multispectral or panchromatic images with lower spectral resolution have higher spatial resolution compared to hyperspectral images. To improve the spatial resolution of hyperspectral images, they are often fused with multispectral images(MSI) or panchromatic images in the same scene. Dictionary learning is one of the popular algorithms for image fusion, which can be divided into dictionary-spectral learning and dictionary-spatial learning. Using spectral dictionary learning algorithms, high-resolution hyper-spectral images can be expressed as an over-completed spectral dictionary multiplied by sparse coefficients. Spectral dictionary can illustrate the spectral information of high-resolution hyperspectral images, which is originated from k-singular value decomposition(SVD) and the algorithms-related. It is challenged of spatial information loss for spectral dictionary cannot fully express spatial information. Therefore, we develop a new compensated framework to explore more detailed spatial information. To improve the spatial resolution of fusion result, residual spatial information is used to compensate the preliminary result. The residual information is calculated as the error between the image obtained by spectral down sampling through preliminary results and the multispectral image. It is required to inject the residual space information into the preliminary results in an appropriate manner. However, most of the algorithms have limitations for that they only consider the differences between spectral channels but do not consider the differences in spatial. Therefore, the spectral and spatial quality of the fused image will be seriously affected if the extracted errors are injected indiscriminately into a channel. Method Our method is focused on improving the spatial resolution of hyperspectral image while keeping its spectral information free from distortion. On the basis of fully capturing the spectral information of hyperspectral image through dictionary learning, the residual spatial information is used to compensate for the spatial resolution. First, a fusion method based on local region is designed. To avoid the spectral distortion caused by inappropriate information injection, adjusting the injection degree of residual information adaptively through a coefficient in accordance with the spectral features of the local area. Second, to maintain the consistency of the spatial structure of the fusion results with multispectral image(MSI), the spatial structure of MSI is extracted in the gradient domain, and a variational model is constructed. The coefficients-calculated are incorporated to the spectral dictionary-derived preliminary results to form an optimization term updated alternately. The objective function also contains spectral constraints composed of the target image and HSI, as well as spatial constraint composed of variational components. This function is run iteratively via alternating direction method of multipliers (ADMM). The spatial and spectral constraints-involved fusion model cannot only improve the spatial resolution, but also ensure that the spectral information does not have distortion. Result Our analysis is compared to six other algorithms on two public datasets. To verify the effectiveness and efficiency of our method, qualitative and quantitative evaluation is carried out in combination with other methods-related through the experimental platform—MATLAB R2018a. For qualitative analysis, our proposed method is capable to get the target image-fused with higher natural and clear visual effect. For quantitative evaluation indicators, compared with the sub-optimal experiment, the Pavia University data set-relevant experimental results are reduced by 4.2%, 4.1% and 2.2% in relation to relative dimensionless global error in synhesis(ERGAS), spectral angle mapper(SAM) and root mean square error(RMSE) indicators. The AVIRIS(airborne visible infrared imaging spectrometer) dataset-related values are reduced by 2.0%, 4.0% and 3.5% of each. Conclusion Our fusion algorithm can effectively improve the spatial resolution preserve spectral information. Furthermore, our algorithm has its optimization and robustness potentially.
Keywords
remote sensing hyperspectral and multispectral image fusion dictionary learning error compensation superpixel segmentation
|