Throws error when running with rnn_dropout_embedding: true parameter

[rajatbhatnagar94]

Throws error when running with rnn_dropout_embedding: true parameter

[ibakarr]

Hi @rajatbhatnagar94 i'm experiencing the same issue. Were you able to find a way to use dropout?

[rajatbhatnagar94]

Hey @ibakarr
I did the following

In the dropout_hidden and dropout_embedding function, I replaced tf.shape(e) with (tf.shape(e)[0], tf.shape(e)[1]). You can use https://github.com/rajatbhatnagar94/nematus/blob/master/nematus/rnn_model.py#L57 for reference

You can make these changes in the nematus code or use my fork of nematus! https://github.com/rajatbhatnagar94/nematus/

Thanks!

Hope it helps

[ibakarr]

Yeah i used your fork and works well. Thanks!

[rsennrich]

thanks for reporting this; I fixed this in the Tensorflow 2 branch, which has now also been merged into master.

[sven1977]

Awesome! I had this error in a different repo, but also related to tf.shape.

For me, it helped replacing something like this (trying to fold time dim back into batch dim [B, T, ...] -> [B+T, ...]):

[-1] + list(tf.shape(model_out)[2:])

with

tf.concat([[-1], tf.shape(model_out)[2:]], axis=0))