Experiments on DTU and blender dataset: blurry outputs, mode collapse

[ZezhouCheng]

Experiments on DTU and blender dataset: blurry outputs, mode collapse

[ZezhouCheng]

Here is one additional question regarding experiments on the Blender dataset:

It seems there is a mode collapse issue, i.e., the GAN generator generates single-color images (e.g. red/green/white). Restarting the training a couple of times solves this issue. Is this normal in your experiments? I wanna make sure that I'm using the code base in the right way.

Thanks again for sharing the codes of this amazing work!

[quan-meng]

1. We use the preprocessed DTU dataset from the MVSNet repo, so the code is correct
2. It shows the intrinsic parameters are not correct
3. The pose estimation is not as accurate as COLMAP on the DTU dataset, but you can check the pose status from the tensorboard or evaluate it with the ATE Toolbox

[quan-meng]

Yes, the gan training sometimes will fail, and it's hard to choose the same parameters for all the scenes