masterbin-iiau/alpharefine

Official implementation for the CVPR2021 paper Alpha-Refine

alpharefine's Issues

raw results

Could you please share the raw results of VOT2018 and LaSOT

跟踪结果的mask显示问题

您好，我想请教一下refinement module的mask输出如何显示在输出的图片上，我在demo.py中的Step 3中调用了RefineModule的get_mask方法得到了mask矩阵，请问如何在输出的图像中显示mask？

我添加的代码是：

""" Step 3: refine tracking results with Alpha-Refine """
mask_bbox = pred_bbox
pred_bbox = RF_module.refine(img, np.array(pred_bbox))
mask = RF_module.get_mask(img, np.array(mask_bbox))

VOT-ST2020

Hi, I want to evaluate a tracker on the VOT-ST2020 dataset. The segmentation annotations are placed under the gorundtruth.txt but I could not understand the format and find an explanation for it. For example, the annotation format is as in below:

m242,164,118,115,29,1,2,1,110,45,73,61,56,69,47,76,41,81,36,83,34,85,33,86,32,86,32,87,30,88,29,90,28,90,27,92,26,92,26,93,25,93,25,94,23,95,22,97,20,98,20,98,19,100,18,100,18,100,17,101,17,102,15,103,15,104,14,104,14,104,13,105,13,105,10,109,9,109,9,109,9,110,8,111,7,112,6,112,6,111,6,112,5,113,5,113,4,115,1,117,1,117,1,117,1,115,3,115,3,115,3,115,3,115,3,115,3,115,3,115,3,115,3,115,2,116,3,115,3,115,2,116,3,115,3,115,3,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,1,117,1,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,116,2,115,3,16,3,96,3,16,3,14,10,72,3,16,3,13,18,65,3,16,5,10,20,13,26,25,3,16,9,3,24,9,30,24,3,16,38,6,31,24,3,17,38,3,34,23,3,17,76,22,3,17,76,22,3,16,77,22,3,15,78,22,3,14,79,22,3,15,78,22,3,14,79,22,4,12,80,22,4,11,82,21,5,9,84,20,99,19,100,17,102,15,104,12,107,10,8

What does m242 mean? And what do these points represent? I assume that they represent the segmentation pixel points but are they ordered like x,y,x,y...x,y pixel coordinates? I tried to create binary segmentation masks considering they are ordered x,y.. but the mask obtained by these points does not represent the object. Could you please explain the annotation format for VOTSTS2022?
I would be glad if you help me with this.

No module dimp_alpha_065

After following https://github.com/MasterBin-IIAU/AlphaRefine/tree/master/AlphaRefine_submit, I am getting this in the logs:
ModuleNotFoundError: No module named 'dimp_alpha_065'

link to the Saliency dataset is invaid

Hi, thanks for your work. Could you please refresh the line of the Saliency dataset, since the current link is invalid now.

Is there any camera or video demo?

如何使用base Tracker和Alpha-Refine模块结合并进行评测

如何使用base Tracker和Alpha-Refine模块结合并进行评测，
ed.我有DIMP模型权重文件和Alpha-Refine权重文件，在OTB数据集上进行评测，如何进行eval生成txt文件，或者生成结合后的权重文件

关于VOT2020数据集测试结果的问题

作者您好，论文中VOT2020的比较结果里提到了SiamRPN++，请问SiamRPN++的测试结果是怎么得到的，可以分享一下SiamRPN++在VOT 2020上详细的测试结果吗（包括baseline和realtime的详细A/R Analysis等），非常感谢

How to train alpha-refine?

Question about base tracker`s update using more Precise bbox from Alpha Net

Hi,
Thanks for your great work! And I have a question after reading your AlphaRefine code.
You use Alpha Net to refine base tracker`s output bbox, but not return the more precise bbox which produced from mask to the base tracker for updating?? Am I correct?? If the performance will greater if the more precise bbox help base tracker updating?

Looking forward to your reply~~

pytracking integration

Hi,

I setup your tracker and the test / evaluation via vot toolkit is working fine. Now I would like to use it to track some objects in my own dataset and I am trying to use the "python run_video.py alpharefine default /home/linx123-rtx/Downloads/bee.mp4" command of the pytracking framework. However, I face the following error:

ModuleNotFoundError: No module named 'pytracking.parameter.alpharefine

Looking up the tracker integration guide of pytracking, it seems like the tracker is not integrated in pytracking, is that correct? Is there an easier way to run the tracker on an own dataset (not for evaluation purpose like vot evaluate, but just for receiving the bbox predictions) ?

thanks for your help

数据集mask的标签准备问题

您好，我是跟踪领域的分割小白，我想问一下，若是我想在跟踪模型中加入mask模块，我是需要使用跟踪常见的数据集自己制作label呢？如GOT、LaSOT。还是有专门在跟踪领域中可以用来做分割的数据集？

Tar files are not tar archives

After downloading the tar archives super_dimp.pth.tar and ARnet_seg_mask_ep0040.pth.tar I get the errors

tar: This does not look like a tar archive
tar: Skipping to next header
tar: A lone zero block at 543389
tar: Exiting with failure status due to previous errors

and

tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors

correspondingly

How to save the predicted mask from the demo.py

Hello ! Thanks for sharing your code.

I added the following code to produce mask in the step 3
mask = RF_module.get_mask(img, np.array(mask_bbox)), but I found the mask array is 0 .

Could you give me some suggestions ?

demo.py

请假一下demo.py中的data_dir。我用的是OTB100数据集，然后路径是data/OTB100,一直报错IndexError: list index out of range。是不能用这个数据集吗，还是放的位置不对。

孪生网络

能出一下SiamRPN++版的吗，谢谢

请教一下本论文的模型是不是把多个数据集同时进行训练的？各个不同数据集之间是如何读取和训练的？

when I run demo.py I got an error , im_path = self.im_paths[0] IndexError: list index out of range

how to train customize dataset??

可以加在anchor-free上面吗

How to train Alpha-Refine with single GPU

能不能共享一下用在siamrpn++上的代码