megvii-research/d2c-sr

Official MegEngine implementation of ECCV2022 "D2C-SR: A Divergence to Convergence Approach for Real-World Image Super-Resolution".

[ECCV 2022] D2C-SR: A Divergence to Convergence Approach for Real-World Image Super-Resolution

Youwei Li¹, Haibin Huang², Lanpeng Jia¹, Haoqiang Fan¹, Shuaicheng Liu^3,1

1. Megvii Research, 2. Kuaishou Technology

3. University of Electronic Science and Technology of China

This is the official MegEngine implementation of our ECCV2022 paper "D2C-SR: A Divergence to Convergence Approach for Real-World Image Super-Resolution".

Welcome to try megengine to train your model，and our PyTorch version will also be coming soon at D2C-SR-PyTorch.

Pipeline

Two stages in D2C architecture: (a) Divergence stage, (b) Convergence stage. Divergence network with tree-based structure outputs multi-predictions with different high-frequency recovery. Convergence network obtains more accurate result by weighted combining divergence results. (c) Divergence loss.

Dependencies

• MegEngine>=1.3.1
• tqdm

Data Preparation

RealSR and DRealSR

RealSR and DRealSR has been made public and can be downloaded from their official repo.

D2CRealSR

Our D2CRealSR dataset can be download from Google Drive.

Make Dataset List

Before training and validation, a data list in .txt format needs to be prepared, and input the path of your data list during training and evaluation. You need to prepare data lists for different scale factors as well as for training and validation datasets.

The data list has the following format：

absolute_path_LR absolute_path_HR

——————————————————————————————————————————————————————

For example (RealSR)

    List of x4 scale:
    
        ——————————————————————————————————————————————
        /data/Canon_034_LR4.png /data/Canon_034_HR.png
        /data/Canon_035_LR4.png /data/Canon_035_HR.png
        ...
    
        ——————————————————————————————————————————————
    
    List of x2 scale:
        ——————————————————————————————————————————————
        /data/Canon_034_LR2.png /data/Canon_034_HR.png
        /data/Canon_035_LR2.png /data/Canon_035_HR.png
        ...
        
        ——————————————————————————————————————————————

Training

To train the model, you can run:

python train.py --train_list_path your_train_list_path --val_list_path your_val_list_path --scale 4 --ex_id your_exp_name

Evaluation

For evaluation, load the pretrained checkpoint and run:

python test.py --checkpoint checkpoint_path --val_list_path your_val_list_path

MegEngine checkpoint can be download from Google Drive.

Citations

@inproceedings{li2022d2c,
  title={D2C-SR: A Divergence to Convergence Approach for Real-World Image Super-Resolution},
  author={Li, Youwei and Huang, Haibin and Jia, Lanpeng and Fan, Haoqiang and Liu, Shuaicheng},
  booktitle={European Conference on Computer Vision},
  pages={379--394},
  year={2022},
  organization={Springer}
}

Contact

Contact Email: [email protected]

Acknowledgments

In this project we use (parts of) the official implementations of the following works:

• RCAN
• CDC

We thank the respective authors for open sourcing their methods.

d2c-sr's Issues

Pytorch Version

Thank you for this excellent work. Thank you for sharing the code.

Could you please share the Pytorch version code? Thanks.

Hope the codes of Pytorch version.

DRealSR数据集图片像素太大导致无法测试