FileNotFoundError when trying to test config files in Conv3D

[jackyjsy]

FileNotFoundError when trying to test config files in Conv3D

[jackyjsy]

Thanks for your interest and I am happy to help. I think the problem is in the data paths. You can try to modify Line32 and Line 33 in "Sign_Isolated_Conv3D_clip_test.py" to

data_path = "data/train_frames"
data_path2 = "data/test_frames"

Hope that will solve your problem.

[jackyjsy]

Thanks for the help! I was able to test fully.
However, I have a confusion. After running "ensemble_multimodal_rgbd.py" on your provided .pkl files, I got the following output -

/content/CVPR21Chal-SLR/ensemble
100% 3742/3742 [00:00<00:00, 20832.23it/s]
3742
top1:  0.005077498663816141
top5:  0.021111704970603957

I got the same output after generating .pkl files on my own. Why is the accuracy only 0.5% & 2.1%? Shouldn't it be like 98%? As I am a beginner, maybe it's a misunderstanding on my part. So apologies for that.
Note that I got the same result after generating .pkl files on my own.

The accuracy you obtained is normal. Since we don't have access to the test labels, the test label we are using is just a pseudo label (random integers). The accuracy of 98% was evaluated by uploading our predictions to the challenge server. If you train our model using train set and test our code on val set, it gives you correct calculation on accuracy.

[tauhidtamim]

Thanks for the help! I was able to test fully.
However, I have a confusion. After running "ensemble_multimodal_rgbd.py" on your provided .pkl files, I got the following output -

/content/CVPR21Chal-SLR/ensemble
100% 3742/3742 [00:00<00:00, 20832.23it/s]
3742
top1:  0.005077498663816141
top5:  0.021111704970603957

I got the same output after generating .pkl files on my own. Why is the accuracy only 0.5% & 2.1%? Shouldn't it be like 98%? As I am a beginner, maybe it's a misunderstanding on my part. So apologies for that.
Note that I got the same result after generating .pkl files on my own.

[tauhidtamim]

Thanks for clarifying. Much appreciated.