mizhenxing/gbi-net

Codes for GBi-Net (CVPR2022)

gbi-net's Issues

"forward_one_depth" and "forward_all_depth"

First of all, thank you very much for your selfless sharing, this is an outstanding work.

Could you please tell me the difference between "forward_one_depth" and "forward_all_depth" in detail, and if I want to use " forward_all_depth", what do I need to change in the code, in other words: is it possible to do it in the config file?

I'd appreciate it if you could reply!

classification or regression?

Thanks for your great work. As for the depth generation, you choose argmax of classification instead of weighed operation of regression. Does it increase the risk to predict a wrong depth range in the early stage? What do you think about the choice of classification and regression in multi-view stereo.

第二种DTU的评估方式

您好
您的论文中提到对DTU数据集使用了两种评价指标，第二种是直接评估深度图预测的准确性。
请问这部分是您自己提出的一种评价方法，还是类似第一种基于距离的评价指标，由其他方法（如DTU）提供的评估方式。
谢谢！

时间消耗

您好！您是否对比过coarse-to-fine search与Binary search时间方面的消耗呢？如果Binary search较快，会快出多少呢？期待您的解答。

Code about training with gradient accumulation

Sorry to bother again.
In recent days, I am trying to train your network with gradient accumulation. However, my implementation still doesn‘t work，i.e., the training loss does not decrease.
I would be very appreciate if you could help provide the code about training with gradient accumulation.
Thanks and look forward to your reply!

About the method of upsampling

Thanks for your significiant work. I would like to ask the method of upsampling the depth hypotheses. Is it the nearest interpolation or the bilinear interpolation? I think both of them would influence the accuarcy, especially in edge regions.
Look forward for your reply!

Can not download DTU dataset from google drive.

Hi,

I try to download the dataset several times, but I always get rejected with info. below:

Sorry, you can't view or download this file at this time.

Too many users have viewed or downloaded this file recently. Please try accessing the file again later. If the file you are trying to access is particularly large or is shared with many people, it may take up to 24 hours to be able to view or download the file. If you still can't access a file after 24 hours, contact your domain administrator.

Any solution to fix that ? Thanks!

Why num_depth is (sample_interval*(2i+1)/2 + depth_min)

Congratulations, what a excellent job!
But I have a question about sample interval.
For dtu_io.py line 526-527 in datasets folder:

sample_interval = depth_range / 4.0
sample_depth = []
for i in range(4):
     sample_depth.append(np.ones_like(depth) * (sample_interval * (i + i + 1) / 2.0 + depth_min))

The sample depth acutally is a decimal, Why can not be an integer like this：

sample_interval = depth_range / 4.0
sample_depth = []
for i in range(4):
     sample_depth.append(np.ones_like(depth) * (sample_interval * ( i+ 1) + depth_min))

Look forward your reply!
Sincerely!

No GPUs found!

when running this command: python /content/GBi-Net/test_gbinet.py --cfg /content/GBi-Net/configs/test_dtu.yaml
I get this error even though I am using a T4 GPU and I installed all the required packages from the requirements.txt file.
How can I fix this ? thanks.

How to use Gipuma

Hi, I want to fuse the predicted depth maps into a point cloud(*.ply) using Gipuma fusion.

Your code based on xy-filter,,, Could you tell me how to use gipuma fusion in your project?

cpu usge is high

The code can be trained normally, and the GPU memory consumption is not high on the RTX3090, but the CPU usage is high

请问什么时候可以公开代码？

非常nice的工作，dtu上提升很大，并且大幅减少了训练显存，迫不及待将您的工作作为baseline了，请问什么时候可以开源代码呢？

About the reason of using Rectified_raw in dtu_yao?

Thanks for releasing the code!
I would like to ask about the reason of using Rectified_raw in dtu_yao?
As you coded in dtu yao, the original img is first read from the "Rectified_raw" folder, and then croped. This process can be regarded as the preprocessing of MVSNet, which delivers us a "Rectified" folder. So any difference between the above two process.
And can I directly use the "Rectified" folder from MVSNet. (Forgive me my laziness that I don't want to download the 123GB Rectified_raw hhh)
Look forward for your reply！

Rectified images cannot download？

thanks a lot