questions about LSTM word language model example

[pytorch]

questions about LSTM word language model example

[apaszke]

1. Yes, that's true, but if you think it's unfair to compare that with other methods, you can modify it. It's meant to be an example and I think it makes perfect sense to keep the hidden state from the previous sentence, as it will likely increase the quality of generated text.

2. I don't understand the suggestion, it seems that you've just increased the batch twice, so it's not exactly equivalent. Of course larger batches lead to increased parallelism.

Please use issues for problem reports and feature requests. If you want to discuss anything or have a question, post on our forums.

[cloudygoose]

1. I don't know how to modify it, is there any way to block the gradient flow at a sentence beginning?
2. I recommend you to read the paper "Efficient GPU-based Training of Recurrent Neural Network Language Models Using Spliced Sentence Bunch".

[apaszke]

If you have any questions, please ask on the forums.