cv-reimplementation/bedsr-net-reimplementation

Unofficial implementation of ''BEDSR-Net: A Deep Shadow Removal from a Single Document Image'' with PyTorch

BEDSR-Net

This repository is unofficial implementation of BEDSR-Net: A Deep Shadow Removal Network From a Single Document Image [Lin+, CVPR 2020] with PyTorch.

A refined version of IsHYuhi's implementation.

Fix several problems

1. nn.ConvTranspose2d compatible with higher version of Pytorch
2. gradcam uses too much vram, use pytorch-grad-cam instead
3. provide default correct training config
4. provide easy inference code

Dependencies

Pytorch, torchvision, matplotlib, wandb, albumentations, pytorch-grad-cam

Dataset Structure

The dataset should be formatted like below, train.csv and test.csv can be generated using

python make_dataset.py

.
├── csv/
│   └── Jung/
│       ├── train.csv
│       └── test.csv
└── dataset/
    └── Jung/
        ├── train/
        │   ├── input/
        │   │   ├── *.jpg
        │   │   └── ...
        │   └── target/
        │       ├── *.jpg
        │       └── ...
        └── test/
            ├── input/
            │   ├── *.jpg
            │   └── ...
            └── target/
                ├── *.jpg
                └── ...

Training

Training BE-Net

python3 train_benet.py ./configs/model\=benet/config.yaml

Training BEDSR-Net

python3 train_bedsrnet.py ./configs/model\=bedsrnet/config.yaml

You can use W&B by --use_wandb.

Infer

mask sure put all your model state_dict into pretrained directory

python infer.py

result images will be produced in results folder

bedsr-net-reimplementation's Issues

在训练benet时loss不会下降

我用IsHYuhi's implementation代码训练benet，如果learning_rate设置为0.003，网络预测的background color会变成tensor([[1., 1., 1.]])。但是改成0.0003，loss就能正常下降。
我看到你公开的default correct training config里的learning_rate: 0.003，请问你有做其他的更改让benet可以正常训练吗

Something wrong when run infer.py

python infer.py
Traceback (most recent call last):
...
...
load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for Generator:
        Unexpected key(s) in state_dict: "CvT6.conv.bias", "CvT7.conv.bias", "CvT8.conv.bias", "CvT9.conv.bias", "CvT10.conv.bias", "CvT11.conv.bias".

pretrained models were download by this link

请问下，能否提供一下作者的数据集SDSRD的下载地址，或者合成数据的脚本？我一直没有找到在哪里下载，谢谢！

Pretrained model pth

Hello, do you have a pretrained model trained on RDD dataset?
Thank you for your code