aditya-malte/colab-xlnet-finetuning

Colab TPU - Compatible XLNet model code

colab-xlnet-finetuning's Issues

How to get the predictions from the XLNet

I have trained the model by doing some modifications in the yelp5processor. The model has been trained. Now I want to get the predictions of the test sentences for which I don't have the actual Y, I just want to retrieve the predicted Y values from the trained model.
If someone could give an example in the colab file that would be a lot helpful.
Any Help will be appreciated.

typo in data dir

Hi,
Thanks a lot for the notebook for TPU, I've tried and it is really fast!
BTW, there is a little typo in the notebook:
--data_dir=../"+TASK_DATA_DIR+"
there should be 2 "." :)

issue of Dir when eval

Hi, it's me again. Thanks for your notebook!

I just find that the init Weight should be in a different directory from the saved ckpt. Or there will be error when doing eval.
in the notebook, you put init weight in MODEL_DIR
I think in training:
--output_dir="+OUTPUT_DIR+"
--model_dir="+MODEL_DIR+"
should be:
--output_dir="+OUTPUT_DIR+"
--model_dir="+OUTPUT_DIR+"
to separate init weight from save ckpt.