eadst/mlvr

Multimodal Language Vehicle Retrieval (MLVR). The code is for our paper in the 7th AI City Challenge Track 2, Tracked-Vehicle Retrieval by Natural Language Descriptions, reaching the 2nd rank on the public leaderboard.

mlvr's Issues

/postprocessing/mcs.py

Hi Den：
About postprocessing section,
path_dict = {"baseline": "./matrix/vrm.npy", # video recognition module
"vcm": "./matrix/vcm.npy", # vehicle color module
"vtm": "./matrix/vtm.npy", # vehicle type module
"vmm": "./matrix/vmm.npy", # vehicle motion module
"vsm1": "./matrix/vsm1.npy", # vehicle surrounding module branch 1
"vsm2": "./matrix/vsm2.npy", # vehicle surrounding module branch 2
}
,you use these npy files to create final result.json.could you simply tell me your ideas about the keys to create these npy files since you only give other's reference code not your modified version.
Thank you. @eadst

crop_vehicle_bblx.py

Hi Den:

about
path = "C:/MLVR-main/data/test-tracks.json"
get_imgs("C:/MLVR-main/data/train/S01/c001/img1")==>this need img path ,right?

because have as below problem:
Traceback (most recent call last):
File "C:\Program Files\JetBrains\PyCharm Community Edition 2021.2.2\plugins\python-ce\helpers\pydev\pydevd.py", line 1483, in _exec
pydev_imports.execfile(file, globals, locals) # execute the script
File "C:\Program Files\JetBrains\PyCharm Community Edition 2021.2.2\plugins\python-ce\helpers\pydev_pydev_imps_pydev_execfile.py", line 18, in execfile
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "C:/MLVR-main/preprocessing/crop_vehicle_bbox.py", line 23, in
get_imgs("C:/MLVR-main/data/train/S01/c001/img1")
File "C:/MLVR-main/preprocessing/crop_vehicle_bbox.py", line 7, in get_imgs
with open(path, "r") as f:
PermissionError: [Errno 13] Permission denied: 'C:/MLVR-main/data/train/S01/c001/img1'

thank you

question about run vrm

Hi sir：
Thank you for a job well done.
When I run vrm again, the following error occurs. Do you have a solution?

FileNotFoundError: [Errno 2] No such file or directory: '/2t_disk/fly/MLVR/model/vrm/modules/bpe_simple_vocab_16e6.txt.gz'

create_vrm

with open('./aicity23/xclip/dataset/aicity/raw-captions.pkl', 'wb') as handle:
pickle.dump(aicity_dict, handle, protocol=pickle.HIGHEST_PROTOCOL)

with open('./aicity23/xclip/dataset/aicity/train_list.txt', 'w') as f:
    f.write(train_list)
with open('./aicity23/xclip/dataset/aicity/val_list.txt', 'w') as f:
    f.write(val_list)
with open('./aicity23/xclip/dataset/aicity/test_list.txt', 'w') as f:
    f.write(test_list)

Missing test_info.txt

I run code in VSM module. In vsm1.py, I can't find test_info.txt in test_caption2() function https://github.com/eadst/MLVR/blob/main/model/vsm/branch1/vsm1.py
I hope you will reply soon. Thanks @eadst