ybsong00 / vital_release Goto Github PK
View Code? Open in Web Editor NEWVITAL: VIsual Tracking via Adversarial Learning
License: BSD 2-Clause "Simplified" License
VITAL: VIsual Tracking via Adversarial Learning
License: BSD 2-Clause "Simplified" License
I run the code,but there is some error as following:
try view SCRIPT vl_nnconv as a function to execute:
D:\tracking-matlab\Vital_release-master\matconvnet\matlab\vl_nnconv.m
Hi, Thank you for sharing good research.
I have a warning about below:
There is no name exist or directory G:\Vital_release-master\Vital_release-master\matconvnet\matlab\mex
Should I make mex file for use?
when run 'demo_tracking' directly:
err:Attempt to execute SCRIPT vl_nnconv as a function
so I try to re-compile again and run 'compile_matconvnet':
err:No supported compiler or SDK was found. For options
I tried google some methods, but not work. please help~~~~
my enviroment:
ubuntu 16.04
matlab2017A
gcc/g++ 4.9/5.4
cuda 8.0
cudnn 5.1 for cuda 8.0
Thank you for your contribution!
I cloned your code and ran directly on OTB-2013, but I got AUC 0.685 and precision 0.903.
Environment: Matlab 2016b & CUDA8.0 CUDNN7 & latest matconvnet (Replace some of your changed files, Because you provide the matconvnet version can not be compiled)
So is there anything others to config? Thank you.
I look forward to your reply about whether the model provided in pytorch version (models/mdnet_vot-otb.pth) can be seen as an official weight, or only models/otbModel.mat in matlab version is certified. Thank you very much.
Excuse me,What is λ in the loss function in this paper?
I have implemented the VITAL tracker using PyTorch. It has a higher precision than the MDNet. The url is https://github.com/abnerwang/py-Vital. If there are any problems with my implementation, please feel free to give me feedback.
I run this code and failed,any body can provide the routine to run successfully?
It's a great work,but I have a few questions.Can you tell me where the costsensitiveloss is,i searched the whole matlab file,but failed. Also do you mind telling me which code position of feature maps and weight mask dropout?
Dear @ybsong00,
Is there any implementation of VITAL in python? or do you have any plan for releasing a python one?
在G_pretrain.m文件中代码摘要如下
`prob_k=zeros(9,1);
for k=1:9
row=floor((k-1)/3)+1;
col=mod((k-1),3)+1;
for i=1:nBatches
batch = pos_data(:,:,:,opts.batchSize*(i-1)+1:min(end,opts.batchSize*i));
batch(col,row,:,:)=0;
if(opts.useGpu)
batch = gpuArray(batch);
end
res = vl_simplenn(net_fc, batch, [], [], ...
'disableDropout', true, ...
'conserveMemory', true, ...
'sync', true) ;
f = gather(res(end).x) ;
if ~exist('feat','var')
feat = zeros(size(f,1),size(f,2),size(f,3),n,'single');
end
feat(:,:,:,opts.batchSize*(i-1)+1:min(end,opts.batchSize*i)) = f;
end
X=feat;
E = exp(bsxfun(@minus, X, max(X,[],3))) ;
L = sum(E,3) ;
Y = bsxfun(@rdivide, E, L) ;
prob_k(k)=sum(Y(1,1,1,:));
end
[~,idx]=min(prob_k);`
其中**[~,idx]=min(prob_k)**此处选择出来的idx对应的mask,所产生的D网络的loss不是最大的,而是最小的。这样选出的mask与论文中所阐明的选择方法不同。
@22wei22
Dear Dr.Song,
Thank you for open-sourcing the code. The VITAL paper is an excellent work and reading the paper is an inspiring experience.
I noted that the pretrain folder in this repo does not include the code for the offline pretraining process, as you mentioned in the Model Initialization in Section 4 of your paper. In fact, the folder is identical to that in MDNet and does not involve adversarial training.
I was wondering if you plan to open-source the training process, which I think would be super helpful for the community to understand better how to apply GAN to the tracking problem.
Thanks for your time.
Best regards,
Yiming
net_G = G_pretrain(net_fc, net_G, neg_data, opts_net);
为什么用负样本初始化G,而不是用正样本初始化G
could you offer some testing results, like OTB100, TrackingNet,VOT2018, UAV...??
thank you!
nnconv_forward_blas<>: : gemm<>: [cublas error] [cublas:cublasSgemm
(CUBLAS_STATUS_EXECUTION_FAILED)]
RTX2080ti cuda 8.0 cudnn5.1/cudnn6.1 is the same problem.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.