View Code? Open in Web Editor
NEW
This project forked from shivanandroy/simplet5
simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
License: MIT License
simplet5's Issues
Set learning rate as a parameter instead of hardcoded
|
return AdamW(self.parameters(), lr=0.0001) |
- Allow customizability for the output file names
- Update options to allow saving of last completed epoch only (currently: Every epoch or last epoch)
|
path = f"{self.outputdir}/simplet5-epoch-{self.current_epoch}-train-loss-{str(self.average_training_loss)}-val-loss-{str(self.average_validation_loss)}" |