多路径生成对抗网络的红外与可见光图像融合
CSTR:
作者:
作者单位:

1.安徽理工大学计算机科学与工程学院;2.安徽理工大学计算机科学与工程学院 淮南 232001

中图分类号:

TP391.41

基金项目:

国家自然科学基金项目(面上项目,重点项目,重大项目);安徽理工大学博士基金(ZX942);安徽理工大学研究生创新基金项目(2022CX2125)


Multipath Generative Adversarial Network for Infrared and Visible Image Fusion
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • | |
  • 文章评论
    摘要:

    生成对抗网络在红外与可见光图像融合领域受到到广泛关注,但单路径进行融合容易丢失浅层信息、分支路特征提取融合能力有限。提出一种基于多路径生成对抗网络的红外与可见光图像融合方法。在生成器端,利用源图像与导向滤波结果构建三条路径输入路径提取更多源图像特征信息,以获得细节跟丰富的融合图像;然后,卷积层加入掩码注意力机制模块,提升显著信息的提取效率,引入密集连接和残差连接,在提升特征传递效率的同时可获取更多源图像重要特征信息。在鉴别器端,采用双鉴别器估计红外与可见光图像的区域分布,避免单鉴别器网络丢失对比度信息的模态失衡问题。通过对比实验,表明所提算法在多个客观评估指标上均取得了最好的效果,且具有更好的视觉效果。

    Abstract:

    Generative adversarial network has received widespread attention in the field of infrared and visible image fusion, but single path fusion is prone to loss of shallow information and limited fusion ability for branch feature extraction. This paper proposes a fusion method for infrared and visible images based on multi-path generative adversarial networks. In the generator, three input paths are constructed using the source images and the results of guided image filter to extract more source image feature information, in order to obtain detailed and rich fused images; Then, the convolutional layer adds a extract mask attention module to improve the efficiency of extracting significant information, introducing dense connections and residual connections, while improving the efficiency of feature transmission, it can obtain more important feature information of the source image. In the discriminator, dual discriminators are used to estimate the regional distribution of infrared and visible light images, avoiding the modal imbalance problem of losing contrast information in a single discriminator network. Through comparative experiments, it is shown that the proposed algorithm has achieved the best results on multiple objective evaluation indicators and has better visual effects.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-09-23
  • 最后修改日期:2023-12-06
  • 录用日期:2023-12-06
文章二维码
×
《国外电子测量技术》
2025年投稿方式有变