sis 22(36): e6

Research Article

Double-channel cascade-based generative adversarial network for power equipment infrared and visible image fusion

Download1184 downloads
  • @ARTICLE{10.4108/eai.22-11-2021.172216,
        author={Jihong Wang and Haiyan Yu},
        title={Double-channel cascade-based generative adversarial  network for power equipment infrared and visible image  fusion},
        journal={EAI Endorsed Transactions on Scalable Information Systems},
        volume={9},
        number={36},
        publisher={EAI},
        journal_a={SIS},
        year={2021},
        month={11},
        keywords={infrared and visible image fusion, double-channel cascade, generative adversarial network, power equipment},
        doi={10.4108/eai.22-11-2021.172216}
    }
    
  • Jihong Wang
    Haiyan Yu
    Year: 2021
    Double-channel cascade-based generative adversarial network for power equipment infrared and visible image fusion
    SIS
    EAI
    DOI: 10.4108/eai.22-11-2021.172216
Jihong Wang1, Haiyan Yu1,*
  • 1: School of Electrical Engineering, Zhengzhou University of Science and Technology, Zhengzhou 450000 China
*Contact email: zkdywjh@126.com

Abstract

At present, visible light imaging sensor and infrared imaging sensor are two commonly used sensors, which are widely used in aviation, navigation and other military fields of detection, monitoring and tracking. Due to their different working principles, their performance is different. The infrared imaging sensor records the infrared radiation information of the target itself by acquiring the infrared radiation of the ground target. It identifies the target by detecting the thermal radiation difference between the target and the background, so it has special recognition and camouflage ability, such as finding people, vehicles and artillery hidden in the woods and grass. Although the infrared imaging sensor has a good detection performance for thermal targets, it is insensitive to the brightness changes of the scene and has low imaging resolution, which is not conducive to human eyes interpretation. Visible light imaging sensor is sensitive to the reflection of the target scene and has nothing to do with the thermal contrast of the target scene. The obtained image has high clarity and can provide the details of the target scene. Therefore, the fusion of infrared and visible images will be beneficial to the combination of infrared image's better target indication characteristics and visible image's scene clearing information. In this paper, we propose a double-channel cascade-based generative adversarial network for power equipment infrared and visible image fusion. The experimental results show that the fusion image not only retains the target information of the infrared image, but also retains more details of the visible image, and achieves better performance in both subjective and objective evaluation