eric-ai-lab/mitigate-gender-bias-in-image-search

Code for the EMNLP 2021 Oral paper "Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search" https://arxiv.org/abs/2109.05433

mitigate-gender-bias-in-image-search's Issues

Reproducing results

Hi, I'm having problems while trying to reproduce the numeric results using your code.
For CLIP I'm getting R1:29.66 R5:54.14 R10:65.24, which is different but very close to the results presented in the paper.
But for CLIP-clip I'm getting R1:23.82 R5:46.5 R10:56.56, which is much worse.

Thanks.

Data to reproduce clip_coco.py

Hi, thanks for sharing your code.
I'd like to use the clipping method you proposed. However, I couldn't find the male_word_bank.txt, female_word_bank.txt, coco_precomp/testall_ids.txt, coco_testall_caps.txt, data/gender_coco.npy files used in the clip_coco.py.
I also checked the https://github.com/mjskay/gender-in-image-search repo mentioned in README, but I couldn't find the data in the repo. Could you please guide and share the data needed to run clip_coco.py? Thanks!