Trying to reproduce, but extremely low performance

[angeloucn]

Trying to reproduce, but extremely low performance

[AngeLouCN]

Hi thank you for your interest. Could please share me more information about training, such as which dataset and label ratio? By the way, I have check the code and find I upload the wrong loss.py file and I will upload correct one soon.

[thanhnt-2658]

Thanks for your prompt response. I used the command python train_mms.py with no arguments so everything is default, the same went for python test.py. So the dataset is kvasir and the label ratio is 0.5

[AngeLouCN]

Hi, I have uploaded the correct one. You can try again and let me know what happened.

[thanhnt-2658]

Btw, I got an error while testing. In your 'test.py', I need to change line 31, 32 from preUnet to preUnet() in order to avoid the error.

[AngeLouCN]

Thanks, I will fix it.

[thanhnt-2658]

@AngeLouCN The results have not improved after I updated loss.py. Do you have any ideas?

[AngeLouCN]

I have updated the loss.py and fix some errors. And I test it right now it looks ok.

[thanhnguyentung95]

The latest loss.py did not resolve the issue. I attached the logs.

run.log

[thanhnguyentung95]

The following log is suspicious:
2022-10-04 09:22:56,623 Split Percentage : 1 Labeled Data Ratio : 0.5
2022-10-04 09:22:56,693 train_loader_1 53 train_loader_2 45 unlabeled_train_loader 101 val_loader 118

While the total number of train images is 472

[AngeLouCN]

Hi, I download my repository and run it. I find the dataloader in my PC is correct. (I use windows system)

[AngeLouCN]

Did you do something to organize the datasets?

[thanhnguyentung95]

I found that sorted() should be done in image_loader() instead of ObjDataset. May I make a PR for this?

[AngeLouCN]

I am not really sure what you mean. I can run with this code without any errors. Maybe you can try to modify the dataloader to load all of those images. And I think the performance will reach over 90%.

[thanhnt-2658]

Yes, I got over 92% now.

[AngeLouCN]

:) 👍

[EmarkZOU]

Yes, I got over 92% now.

Hello! I've encountered similar issues during my reproduction process. On one hand, there's significant filtering of images with sizes not matching trainsize, and on the other hand, the final training dice score is quite low. I would like to seek advice on how you handled such situations. Looking forward to your response! Thank you!