170744039/papers

Image Forgery Detection and Localization (and related) Papers List

description
Deep learning papers notes sharing

😀 Overview

Related

• Datasets Resources
• Nice Expression
• Research Methods (public information summery)
• Paper Resource Links

Basics

• 图像处理基础知识

Backbone

骨干网络，多为图像分类的网络。

• Attention Is All You Need (NeurIPS '17) [Paper] [Code_official] [Code_community]
• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks (ICML '19) [Paper] [Code]
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (ICLR '21) [Paper] [Code]
• Multi-Dimensional Model Compression of Vision Transformer (ICME '22) [Paper]
• Deep Residual Learning for Image Recognition (CVPR '16) [Paper]
• Generative Adversarial Networks (NeurIPS '14) [Paper]
• Masked Auto-Encoders Meet Generative Adversarial Networks and Beyond (CVPR '23) [Paper]
• A Kernel Perspective of Skip Connections in Convolutional Networks (ICLR '23) [Paper]
• EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention (CVPR '23) [Paper] [Code] [Note_community]

Image Tampering

图像篡改检测定位

Image Editing

2020 and before

• LSTM and encoder–decoder architecture for detection of image forgeries (TIP '19) [Paper] [Code]
• ManTra-Net: Manipulation Tracing Network for Detection and Localization of Image Forgeries With Anomalous Features (CVPR '19) [Paper] [Code]
• A Full-Image Full-Resolution End-to-EndTrainable CNN Framework for Image Forgery Detection (IEEE Access '20) **[Paper]
• Constrained R-CNN: A general image manipulation detection model (ICME '20) [Paper] [Code]
• A CNNBased Camera Model Fingerprint (TIFS '20) **[Paper]
• An Adaptive Neural Network for Unsupervised Mosaic Consistency Analysis in Image Forensics (CVPR '20) **[Paper]
• A dense u-net with cross-layer intersection for detection and localization of image forgery (ICASSP '20) [Paper] [Note_unofficial]
• Generate, Segment, and Refine: Towards Generic Manipulation Segmentation (AAAI '20) [Paper] [Code] (GSRNet)
• SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization (ECCV '20) [Paper] [Project] [Code]

2021

• MSTA-Net: Forgery Detection by Generating Manipulation Trace Based on Multi-Scale Self-Texture Attention (TCSVT '21) [Paper]
• Image Manipulation Detection by Multi-View Multi-Scale Supervision (ICCV '21) [Paper] [Code]
• TransForensics: Image Forgery Localization with Dense Self-Attention (ICCV '21) [Paper]
• Self-supervised Domain Adaptation for Forgery Localization of JPEG Compressed Images (ICCV '21) [Paper]
• Image Tampering Localization Using a Dense Fully Convolutional Network (TIFS '21) [Paper] [Code] (DenseFCN)
• Image Manipulation Localization Using Attentional Cross-Domain CNN Features (TNNLS '21) [Paper]

2022

• MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localization (ArXiv '22) [Paper]
• Towards JPEG-Resistant Image Forgery Detection and Localization Via Self-Supervised Domain Adaptation (TPAMI '22) [Paper]
• ESRNet: Efficient Search and Recognition Network for Image Manipulation Detection (TOMCCAP '22) [Paper] [Tool]
• Learning to localize image forgery using end-to-end attention network (Neurocomputing '22) [Paper] [Code]
• MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection (TPAMI '22) [Paper] [Code]
• Robust Image Forgery Detection Over Online Social Network Shared Images (CVPR '22) [Paper] [Code]
• ObjectFormer for Image Manipulation Detection and Localization (CVPR '22) [Paper]
• GCA-Net: Utilizing Gated Context Attention for Improving Image Forgery Localization and Detection (CVPRW '22) [Paper]
• Non-Semantic Evaluation of Image Forensics Tools: Methodology and Database (WACV '22) [Paper] [Code]
• JPEG Compression-aware Image Forgery Localization (MM '22) [Paper]
• Image Manipulation Localization Using Multi-Scale Feature Fusion and Adaptive Edge Supervision (TMM '22) [Paper]
• ReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localization (ArXiv '22) [Paper] [Code]
• PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization (TCSVT '22) [Paper] [Code]
• Self-Adversarial Training incorporating Forgery Attention for Image Forgery Localization (TIFS '22) [Paper] [Code] (LocateNet / SATFL)
• M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection (ICMR '22) [Paper] [Code]
• A Principled Design of Image Representation: Towards Forensic Tasks (TPAMI '22) [Paper] [Code]
• TBNet: A Two-stream Boundary-aware Network for Generic Image Manipulation Localization (KDE '22) [Paper]
• Learning JPEG Compression Artifacts for Image Manipulation Detection and Localization (IJCV '22) [Paper] [Code]

2023 This year

• Image manipulation detection by multiple tampering traces and edge artifact enhancement (PR '23) [Paper] (EMT-Net)
• CFL-Net: Image Forgery Localization Using Contrastive Learning (WACV '23) [Paper] [Code]
• TruFor: Leveraging all-round clues for trustworthy image forgery detection and localization (CVPR '23) [Paper] [Project] [Code]
• TBFormer: Two-Branch Transformer for Image Forgery Localization (SPL '23) [Paper] [Code]
• Detecting and Grounding Multi-Modal Media Manipulation (CVPR '23) [Paper] [Code] [Project]
• Hierarchical Fine-Grained Image Forgery Detection and Localization (CVPR '23) [Paper] [Code]
• Edge-aware Regional Message Passing Controller for Image Forgery Localization (CVPR '23) [Paper] [Video]
• AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensics (CVPRW '23) [Paper] [Dataset]
• CTP-Net: Character Texture Perception Network for Document Image Forgery Localization (arXiv '23) [Paper]
• IML-ViT: Image Manipulation Localization by Vision Transformer (arXiv '23) [Paper] [Code]
• TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localization (arXiv '23) [Paper] [Code]
• Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learning (ICCV '23) [News]_Chinese Only
• Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning (ICCV '23) [ResearchGate]
• SAFL-Net: Semantic-Agnostic Feature Learning Network with Auxiliary Plugins for Image Manipulation Detection (ICCV '23)
• Uncertainty-guided Learning for Improving Image Manipulation Detection (ICCV '23)
• Controllable Guide-Space for Generalizable Face Forgery Detection (ICCV '23) [Paper]
• Rethinking Image Forgery Detection via Contrastive Learning and Unsupervised Clustering (arXiv '23) [Paper] [Code]

CNN-synthesized

Some of the above papers also contain methods to detect tampered images generated by GANs or DMs for synthetic images

• MaLP: Manipulation Localization Using a Proactive Scheme (CVPR '23) [Paper] [Code]
• Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (IJCAI '23) [Paper] [Code]
• Generalizable Synthetic Image Detection via Language-guided Contrastive Learning (ArXiv '23) [Paper] [Code]
• Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localization (ArXiv '23) [Paper] [Code]
• Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (ArXiv '23) [Paper]
• Masked Relation Learning for DeepFake Detection (TIFS '23) [Paper]

Image Splicing

图像的拼接篡改检测定位

2020 and before

• Deep matching and validation network: An end-to-end solution to constrained image splicing localization and detection (MM '17) [Paper]

• Image Splicing Localization via Semi-global Network and Fully Connected Conditional Random Fields (ECCV '18)

• Image splicing localization using a multi-task fully convolutional network (mfcn) (JVCIR '18) [Paper] [Code]

• Fighting Fake News: Image Splice Detection via Learned Self-Consistency (ECCV '18) [Paper] [Code]

• Deep Fusion Network for Splicing Forgery Localization (ECCV '18)

• Adversarial Learning for Constrained Image Splicing Detection and Localization Based on Atrous Convolution (TIFS '19) [Paper] [Code]

• RRU-Net: The Ringed Residual U-Net for Image Splicing Forgery Detection (CVPRW' 19) [Paper] [Code]

• Mixed adversarial generators for image splice detection (NeuIPS '19) [Paper] [Code]

• Exposing splicing forgery in realistic scenes using deep fusion network (InfoS '20) [Paper]

• Locating splicing forgery by adaptive-SVD noise estimation and vicinity noise descriptor (Neurocomputing '20)

Since 2021

• CAT-Net: Compression Artifact Tracing Network for Detection and Localization of Image Splicing (WACV '21) [Paper] [Code]
• Image Splicing Detection, Localization and Attribution via JPEG Primary Quantization Matrix Estimation and Clustering (TIFS '21) [Paper] [Code]
• Multiple Image Splicing Dataset (MISD): A Dataset for Multiple Splicing (Data, MDPI '21) [Paper]
• Reality Transform Adversarial Generators for Image Splicing Forgery Detection and Localization (ICCV '21) [Paper]
• Multi-Task Wavelet Corrected Network for Image Splicing Forgery Detection and Localization (ICME '21) [Paper]
• Detection and Localization of Multiple Image Splicing Using MobileNet V1 (IEEE Access '21) [Paper]
• Multi-Task SE-Network for Image Splicing Localization (TCSVT '22) [Paper] [Code]
• ET: Edge-Enhanced Transformer for Image Splicing Detection (SPL '22) [Paper]
• Image splicing forgery detection by combining synthetic adversarial networks and hybrid dense U-net based on multiple spaces (IJIS '22) [Paper] [Code]
• SISL:Self-Supervised Image Signature Learning for Splicing Detection & Localization (CVPRW '22) [Paper]
• Deep Metric Color Embeddings for Splicing Localization in Severely Degraded Images (TIFS '22) [Paper]
• Coarse-to-fine-grained method for image splicing region detection (PR '22) [Paper]
• A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network (Applied Science (IM: 2.8, not included in CCFs), MDPI, '23) [Paper]
• Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization (MM '23) [Paper]

Image Harmonization

图像协调化

• Toward Realistic Image Compositing with Adversarial Learning (CVPR '19) [Paper] [Code_unofficial]
• Image Harmonization with Transformer (ICCV '21) [Paper]
• SSH: A Self-Supervised Framework for Image Harmonization (ICCV '21) [Paper] [Code]
• Image Harmonization with Region-wise Contrastive Learning (ArXiv '22) [Paper]
• Harmonizer: Learning to Perform White-Box Image and Video Harmonization (ECCV '22) [Paper] [Code]
• Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization (ECCV '22) [Paper] [Code]
• High-Resolution Image Harmonization via Collaborative Dual Transformations (CVPR '22) [Paper] [Code_unofficial]
• SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonization (CVPR '22) [Paper] [Code]
• PCT-Net: Full Resolution Image Harmonization Using Pixel-Wise Color Transformations (CVPR '23)
• Semi-supervised Parametric Real-world Image Harmonization (CVPR '23) [Paper] [Code] [Project]
• LEMaRT: Label-Efficient Masked Region Transform for Image Harmonization(CVPR '23) [Paper]
• Burstormer: Burst Image Restoration and Enhancement Transformer (CVPR '23) [Paper] [Code]

Face Forgery

人脸篡改，篡改方法以及检测问题

• SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features (ICASSP '20) [Paper]
• Portrait shadow manipulation (ACM MM / TOG '20) [Paper] [Code]
• MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection (KBS '22) [Paper]
• Multi-Scale Wavelet Transformer for Face Forgery Detection (ACCV '22) [Paper]
• Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection (CVPR '22) [Paper] [Code]
• AUNet: Learning Relations Between Action Units for Face Forgery Detection (CVPR '23)
• AltFreezing for More General Face Forgery Detection (CVPR '23)
• $F^2$Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection (TIFS '23) [Paper]
• On the Security of the One-and-a-Half-Class Classifier for SPAM Feature-Based Image Forensics (TIFS '23) [Paper]
• Multimodaltrace: Deepfake Detection Using Audiovisual Representation Learning (CVPRW '23) [Paper]
• Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection (arXiv '23') [Paper]
• Contrastive Multi-FaceForensics: An End-to-end Bi-grained Contrastive Learning Approach for Multi-face Forgery Detection (arXiv '23') [Paper]
• Learning Patch-Channel Correspondence for Interpretable Face Forgery Detection (TIP '23) [Paper] [Code]
• Not All Steps are Created Equal: Selective Diffusion Distillation for Image Manipulation (ICCV '23) [Paper] [Code]

Copy Move

复制移动篡改定位问题

• BusterNet: Detecting Copy-Move Image Forgery with Source/Target Localization (ECCV '18) [Paper] [Code]
• A Serial Image Copy-Move Forgery Localization Scheme With Source/Target Distinguishment (TMM '20) [Paper] [Code]
• DOA-GAN: Dual-Order Attentive Generative Adversarial Network for Image Copy-Move Forgery Detection and Localization (CVPR '20) [Paper] [Code]
• Two-Stage Copy-Move Forgery Detection with Self Deep Matching and Proposal SuperGlue (TIP '22) [Paper]
• QDL-CMFD: A Quality-independent and deep Learning-based Copy-Move image forgery detection method (Neurocomputing '22) [Paper] [Code]
• Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection (TIFS '23) [Paper] [Code]
• Image Copy-Move Forgery Detection via Deep Cross-Scale PatchMatch (arXiv '23) [Paper]

Image Matching

特征匹配，图像匹配问题。

• LoFTR: Detector-Free Local Matching with Transformers (CVPR '21) [Paper] [Code]
• PATS: Patch Area Transportation with Subdivision for Local Feature Matching (CVPR '23) [Paper] [Code] [Project]
• Adaptive Spot-Guided Transformer for Consistent Local Feature Matching (CVPR '23) [Paper] [Code] [Project]
• ObjectMatch: Robust Registration using Canonical Object Correspondences (CVPR '23) [Paper] [Code] [Project]

Object Detection

目标检测，包括伪装物体目标检测和突出目标检测，COD以及SOD。

• OTA: Optimal Transport Assignment for Object Detection (CVPR '21) [Paper] [Code]
• Consistency-basd Active Learning for Object Detection (CVPRW '22) [Paper] [Code]
• Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection (CVPR '22) [Paper] [Code]
• Unsupervised Object Localization: Observing the Background to Discover Objects (CVPR '23) [Paper] [Code]
• Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction (CVPR '23) [Paper] [Code]
• Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers (CVPR '23) [Paper] [Code]
• Locate, Refine and Restore: A Progressive Enhancement Network for Camouflaged Object Detection (IJCAI '23)
• Spatial-Aware Token for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
• Generative Prompt Model for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
• Category-aware Allocation Transformer for Weakly Supervised Object Localization (ICCV '23)

Semantic Segmentation

语义分割，将图片中完整语义（具有标签或者类别）的部分分割出来。不仅要进行目标检测检测到图像中的物体，还需要对每个像素分类。

• Generative Semantic Segmentation (CVPR '23) [Paper] [Code]
• EfficientViT: Lightweight Multi-Scale Attention for On-Device Semantic Segmentation [Paper] [Code]
• CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation [Paper] [Code] [Project] [Note_community]

Low Level Vision

Related resources: https://github.com/Kobaayyy/Awesome-ICCV2021-Low-Level-Vision

Low-level tasks include super-resolution, denoise, dehze, low-light enhancement, etc. High-level tasks include classification, detection, segmentation, etc. segmentation, and so on. However, the ones I have listed here are probably still mainly related to tampering detection.

• (EVP) Explicit Visual Prompting for Low-Level Structure Segmentations (CVPR '23) [Paper] [Code] (including defocus blur, shadow, forgery, camouflaged dection)
• SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device (ICCV '23) [Paper] [Code]

Useful Links

1. ICCV 2023 Paper List https://huggingface.co/spaces/ICCV2023/ICCV2023-papers
2. ICLR 2023 Papers List https://openreview.net/group?id=ICLR.cc/2023/Conference
3. CVPR 2023 Accepted Papers https://cvpr2023.thecvf.com/Conferences/2023/AcceptedPapers
4. CVPR 2023 Workshops https://openaccess.thecvf.com/CVPR2023_workshops/menu
5. WACV 2023 Papers https://openaccess.thecvf.com/WACV2023
6. IJCAI 2023 Accepted Papers List https://ijcai-23.org/main-track-accepted-papers/
7. ECCV 2022 Accepted papers https://eccv2022.ecva.net/program/accepted-papers/
8. MM 2022 Proceedings https://dl.acm.org/doi/proceedings/10.1145/3503161
9. SIGGRAPH unofficial https://kesen.realtimerendering.com/ eg SIGGRAPH 2023 https://kesen.realtimerendering.com/sig2023.html
10. ICML 2022 https://dblp.org/db/conf/icml/icml2022.html
11. AAAI 2022 https://dblp.org/db/conf/aaai/aaai2022.html
12. TIFS https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=10206
13. More...

Back to Home