Pretrain with MIMIC-CXR Val Loss

[SinuoWang]

Pretrain with MIMIC-CXR Val Loss

[GravitySaika]

I am training on this dataset too, but your val_loss much bertter than me. Can u share some of your steps of training on it?

[SinuoWang]

I am training on this dataset too, but your val_loss much bertter than me. Can u share some of your steps of training on it?

Maybe you should check whether you modified the img transforms. It's good to use the tf that is specifically for MIMIC not Chexpert.

But you don't need to worry too much about the local val loss. I tested this model on some downstream tasks and got normal results, even the local val loss is super weird

[GravitySaika]

I am training on this dataset too, but your val_loss much bertter than me. Can u share some of your steps of training on it?

Maybe you should check whether you modified the img transforms. It's good to use the tf that is specifically for MIMIC not Chexpert.

But you don't need to worry too much about the local val loss. I tested this model on some downstream tasks and got normal results, even the local val loss is super weird

Sorry, I am not so familiar with these transforms. What is the tf means in your experiment. I also met some wired thing like the downstream tasks like binary classification on pnumonia troax always shows auroc=0.5 and any pic going through the model will become an all-none-tensor. The Adam lr never changed. I don't know is that normal.