kristpapadopoulos/keras-stochastic-weight-averaging

Keras callback function for stochastic weight averaging

keras-stochastic-weight-averaging's Issues

Would you like to give us an example to use swa callback?

Thank you so much for your code.
It will be great if you would like to upload an example to show how to use your callback. If I use learning_rate_schedular, may I combine your saw together? Because you said that your learning rate is a constant. Many thanks.

Which optimizer should I use?

Thanks for your code, but I am curious that which optimizer should I use? Can I use adam? Or I must use SGD? Thank you.

should we do something special for BN layers?

because in the swa (pytorch) https://github.com/timgaripov/swa
there is one step that use the data to update the BN layer? like
utils.bn_update(loaders['train'], swa_model)
is it necessary?