zebrajack/panodr

PanoDR: Spherical Panorama Diminished Reality for Indoor Scenes.

Prerequisites

• Windows10 or Linux
• Python 3.7
• CPU or NVIDIA GPU + CUDA CuDNN
• PyTorch 1.7.1 (or higher)

Installation

• Clone this repo:

git clone https://github.com/VCL3D/PanoDR.git
cd PanoDR

• We recommend setting up a virtual environment (follow the virtualenv documentation). Once your environment is set up and activated, install the vcl3datlantis package:

cd src/utils
pip install -e.

Dataset

We use Structured3D dataset. To train a model on the dataset please download the dataset from the official website. We follow the official training, validation, and testing splits as defined by the authors.

Training

More info regarding the training of the model will be available soon!

Inference

You can download the pre-trained models from here and specify the arguments --eval_chkpnt_folder and --segmentation_model_chkpnt, respectively. Assuming the input image and mask are in the format as in the input folder run:

python src/train/test.py --inference --eval_path input/

Acknowledgements

This project has received funding from the European Union's Horizon 2020 innovation programme ATLANTIS under grant agreement No 951900.

Our code borrows from SEAN and deepfillv2.