Discussion about reversing the order of the source sentence

[littleflow3r]

Discussion about reversing the order of the source sentence

[bentrevett]

My only intuition is the same as the paper, that is, reversing the order of the input sentence reduces the path length of information between the beginning of the two sentences.

If you note, tutorials 2 and 3 do not reverse their input sentences. Potentially because their improved architecture/models were able to cope with this longer path of information? Although that is just a guess and I don't think I tried those models with reversed input sentences.

I don't believe I've seen a study on what languages benefit from reversing input sentences, it's definitely something that could do with researching.

Have you tried comparing the reversed and original results across a few random seeds to make sure you consistently get better results for the original order?

[littleflow3r]

I just realised that in my data (Japanese-English), the last word is the verb, which is quite important information from the sequence. Probably that's why reversing the order does not really work since the important information would be further separated then.

Have you tried comparing the reversed and original results across a few random seeds to make sure you consistently get better results for the original order?

Will do!

Thanks again!