About cifar10 performance on SimSiam

[hzzone]

About cifar10 performance on SimSiam

[kasteric]

I have tried many times, including using the .json included in the repo.

[kasteric]

Hi, do you have time for sharing the config file for cifar10_simsiam？I have run the experiments multiple times, but the performance is not satisfying. Seems like the representation gets collapsed... Specifically I have replace the projection_num_layers from 3 to 2, and the feat_dim is set to 2048. Is the feat_dim 2048 for k-means too? Thanks so much!

[Hzzone]

I have no time to rerun simsiam. There are some important tips on CIFAR if I remember correctly: 1. total bs 512 on single GPU; 2. projection_num_layers=2 instead 3, feat_dim 2048 (for k-means too); 4. weight decay 5e-4

[kasteric]

I have no time to rerun simsiam. There are some important tips on CIFAR if I remember correctly: 1. total bs 512 on single GPU; 2. projection_num_layers=2 instead 3, feat_dim 2048 (for k-means too); 4. weight decay 5e-4

Thanks for your fast and informative response! i will try on single card

[kasteric]

Thanks to your guidance! The problem has been solved!