IVIF-Code-Interpretation

Provide a summary of open-source deep learning-based infrared and visible image fusion (IVIF) and some vision algorithms for those in the field of image fusion and computer vision.
(Survey, Code, Dataset, Evaluation and more).

🏃 keep updating. 🏃
🚩2024.8.4 Add FILM (ICML 2024)
🚩2024.7.27 Add SimpleFusion, SHIP (CVPR 2024), FISCNet, MambaDFuse
🚩2024.7.21 Add AGMFusion (A great work!!!!)
🚩2024.5.19 Add Text-IF, Diff-IF, TC-MoA, and MMIF-EMMA
🚩2024.4.18 Add a general image fusion framework using multi-task semi-supervised learning
🚩2024.4.11 Add some clarifications.
🚩2024.4.2 Add MTDFusion, SFCFusion, MetaFusion.

Reprinted please specify the source~

https://github.com/liushh39

Content:

1. Survey

Year	Title
2023	Visible and Infrared Image Fusion Using Deep Learning 🤗🤗
2023	基于深度学习的图像融合方法综述 🤗🤗

2. Latest or novel IVIF method

Year	Title
2024	AGMFusion: A Real-Time End-to-End Infrared and Visible Image Fusion Network Based on Adaptive Guidance Module 🤗🤗🤗🤗🤗
2024	FILM: image Fusion via vIsion-Language Model
2024	Probing Synergistic High-Order Interaction in Infrared and Visible Image Fusion
2024	Frequency Integration and Spatial Compensation Network for Infrared and Visible Image Fusion
2024	A general image fusion framework using multi-task semi-supervised learning 🤗🤗🤗🤗
2024	Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion 🤗🤗🤗🤗
2024	Diff-IF: Multi-modality image fusion via diffusion model with fusion knowledge prior 🤗🤗🤗🤗
2024	Task-Customized Mixture of Adapters for General Image Fusion
2024	Equivariant Multi-Modality Image Fusion
2024	SFCFusion: Spatial–Frequency Collaborative Infrared and Visible Image Fusion
2023	DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion 🤗🤗🤗
2023	A Task-guided, Implicitly-searched and Meta- initialized Deep Model for Image Fusion 🤗🤗🤗
2023	Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyond 🤗🤗🤗
2023	MetaFusion: Infrared and Visible Image Fusion via Meta-Feature Embedding from Object Detection
2022	Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion

3. AE-based IVIF method

Year	Title
2024	TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusion 🤗🤗🤗
2023	LRRNet: A Novel Representation Learning Guided Fusion Framework for Infrared and Visible Images 🤗🤗🤗
2023	MURF: Mutually Reinforcing Multi-modal Image Registration and Fusion
2023	CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion
2023	Recurrent Correction Network for Fast and Efficient Multi-modality Image Fusion
2023	CAMF: An Interpretable Infrared and Visible Image Fusion Network Based on Class Activation Mapping
2023	DIVFusion: Darkness-free infrared and visible image fusion
2023	MUFusion: A general unsupervised image fusion network based on memory unit 🤗🤗
2023	SOSMaskFuse: An Infrared and Visible Image Fusion Architecture Based on Salient Object Segmentation Mask 🤗🤗
2023	Semantics lead all: Towards unified image registration and fusion from a semantic perspective 🤗🤗🤗
2022	Res2Fusion: Infrared and visible image fusion based on dense Res2net and double nonlocal attention models
2022	CUFD: An encoder-decoder network for visible and infrared image fusion based on common and unique feature decomposition
2022	Breaking Free from Fusion Rule: A Fully Semantic-driven Infrared and Visible Image Fusion
2021	SEDRFuse: A Symmetric Enocder-Decoder with Residual Network for Infrared and Visible Image Fusion
2021	RFN-Nest: An end-to-end residual fusion network for infrared and visible images
2021	Efficient and Interpretable Infrared and Visible Image Fusion Via Algorithm Unrolling
2020	NestFuse: An Infrared and Visible Image Fusion Architecture based on Nest Connection and Spatial/Channel Attention Models
2020	DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion
2020	Classification Saliency-Based Rule for Visible and Infrared Image Fusion
2020	UNIFusion: A Lightweight Unified Image Fusion Network
2020	SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion
2019	Densefuse: A Fusion Approach to Infrared and Visible Images 🤗🤗
2018	Infrared and Visible Image Fusion using a Deep Learning Framework

4. CNN-based IVIF method

Year	Title
2024	SimpleFusion: A Simple Fusion Framework for Infrared and Visible Images
2023	MTDFusion: A Multilayer Triple Dense Network for Infrared and Visible Image Fusion
2023	LE2Fusion: A novel local edge enhancement module for infrared and visible image fusion
2023	Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation 🤗🤗🤗
2023	LDRepFM: A Real-Time End-to-End Visible and Infrared Image Fusion Model Based on Layer Decomposition and Re-Parameterization
2023	An interactively reinforced paradigm for joint infrared-visible image fusion and saliency object detection 🤗🤗🤗
2022	Attention-Guided Polarization Image Fusion Using Salient Information Distribution
2022	PIAFusion: A Progressive Infrared and Visible Image Fusion Network Based on Illumination Aware
2022	Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network 🤗🤗
2022	CLF-Net: "Contrastive Learning for Infrared and Visible Image Fusion Network
2022	Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration
2022	IPLF:A Novel Image Pair Learning Fusion Network for Infrared and Visible Image
2022	Learn to Search a Lightweight Architecture for Target-aware Infrared and Visible Image Fusion
2022	SuperFusion: A Versatile Image Registration and Fusion Network with Semantic Awareness
2022	DetFusion: A Detection-driven Infrared and Visible Image Fusion Network
2022	FLFuse-Net: A Fast and Lightweight Infrared and Visible Image Fusion Network Via Feature Flow and Edge Compensation for Salient Information 🤗🤗
2022	Multiscale Progressive Fusion of Infrared and Visible Images 🤗
2022	Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution 🤗
2021	STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection 🤗🤗
2021	DRF: Disentangled Representation for Visible and Infrared Image Fusion
2021	Different Input Resolutions and Arbitrary Output Resolution: A Meta-Learning Based Deep Framework for Infrared and Visible Image Fusion 🤗🤗
2021	SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
2021	MIFFuse: A Multi-level Feature Fusion Network for Infrared and visible Images 🤗
2020	IFCNN: A General Image Fusion Framework Based on Convolutional Neural Network
2020	FusionDN: A Unified Densely Connected Network for Image Fusion
2020	Rethinking the image fusion: A fast unified image fusion network based on proportional maintenance of gradient and intensity
2020	U2Fusion: A Unified Unsupervised Image Fusion Network 🤗🤗

5. GAN-based IVIF method

Year	Title
2023	A Cross-scale Iterative Attentional Adversarial Fusion Network for Infrared and Visible Images
2023	Infrared and Visible Image Fusion Based on Multiclassification Adversarial Mechanism in Feature Space
2022	Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection 🤗🤗
2022	Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning
2021	Coupled GAN with Relativistic Discriminators for Infrared and Visible Images Fusion
2021	Sematic-Supervised Infrared and Visible Image Fusion via Dual-Discriminator Generative Adversarial Network
2021	MFEIF: Learning a Deep Multi-scale Feature Ensemble and an Edge-attention Guidance for Image Fusion
2021	GANMcC: A Generative Adversarial Network with Multi-classification Constraints for Infrared and Visible Image Fusion
2021	GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators
2019	FusionGAN: A generative adversarial network for infrared and visible image fusion
2019	DDcGAN:infrared and visible image fusion via dual-discriminator conditional generative adversarial network

6. Transformer-based IVIF method

Year	Title
2023	PTET: A Progressive Token Exchanging Transformer for Infrared and Visible Image Fusion
2023	SFPFusion: An Improved Vision Transformer Combining Super Feature Attention and Wavelet-Guided Pooling for Infrared and Visible Images Fusion
2023	Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity
2023	CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion 🤗🤗🤗
2023	DATFuse: Infrared and Visible Image Fusion via Dual Attention Transformer
2023	Cross-Modal Transformers for Infrared and Visible Image Fusion 🤗🤗🤗
2022	YDTR: Infrared and Visible Image Fusion via Y-shape Dynamic Transformer 🤗🤗
2022	SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images
2022	SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
2022	Image fusion transformer

7. Mamba-based IVIF method

2024 | MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion

8. Datasets

TNO, RoadScene, M3FD, MFNet, MSRS, LLVIP, IVS, HDO, AVIID,

9. Evaluation

Excellent code

If you have any other questions about the IVIF, please email [email protected] !!!

Reprinted please specify the source~

https://github.com/liushh39

liushh39 / ivif-code-interpretation Goto Github PK