irmvlab/3dunmonoflow

Codes for ICRA2021 paper "Unsupervised Learning of 3D Scene Flow from Monocular Camera"

3DUnMonoFlow

Code for the paper:

G. Wang, X. Tian, R. Ding, and H. Wang, Unsupervised Learning of Scene Flow from Monocular Camera, in International Conference on Robotics and Automation, 2021.

Prerequisites

Our model is trained and tested under:

• Python 3.6.9
• NVIDIA GPU + CUDA CuDNN
• PyTorch (torch == 1.7.1)
• torchvision
• scipy
• argparse
• tensorboardX
• tqdm
• numba
• cffi

Operation in this repo is used to compile the furthest point sampling, grouping and gathering operation for PyTorch.

cd pointnet2
python setup.py install
cd ../

Data preprocess

We referred to the dataset pre-processing approach in this repo to generate our data for training from KITTI Odometry dataset. We uploaded our processed dataset and you can click this link to download.

KITTI scene flow dataset is used for test and evaluation. Flownet3d processed the first 150 data points from KITTI scene flow dataset and removed the ground points. We copied the link here for you to download.

Get started

Train

Set data in the configuration file to the path where your training data is saved and change the batch_size according to your GPU. Then run:

python train.py config.yaml

Our pre-trained models are provided here for download.

Evaluate

Set evaluate in the configuration file to be True. Then run:

python train.py config.yaml

Acknowledgement

We are grateful for repo for its github repository.

3dunmonoflow's Issues

How do I set the data if I want to move the image I acquired with this code?

How do I set the data if I want to move the image I acquired with this code?
I have acquired a series of monocular images. I would like to compose a scene flow using these images.