did you ever try same training using BERT or similar model instead of simple Word2Vec

[bbrattoli]

did you ever try same training using BERT or similar model instead of simple Word2Vec

[bbrattoli]

Hi! Sorry for the late reply, and thanks for your interest in my work 🙂 The beauty of word2vec is that it is straightforward: 1 word 1 encoding, no long sentences. Maybe Bert is too complex for this model.
I personally only used Word2vec to stay compatible with previous work and because improving the language model was not the scope of my work, but improving the computer vision model while keeping everything as previous protocol
However, I saw that follow-up work is actually using more complex language models, unfortunately, I cannot find the paper right now.

[pritamqu]

Thanks for your comment @bbrattoli, I tried both using word2vec and better models like BERT, and it seems word2vec works better.