Surprising results with no convergence

[dataislife]

Surprising results with no convergence

[jaanli]

Thanks @dataislife - mind emailing me a description of the model and sentence embedding data you are using? This is an interesting application and probably easiest over email :)

[garenkwan]

Hi, did you ever resolve this? I am facing a similar issue and cannot get the it to converge.

[jaanli]

Thanks @garenkwan - can you email me a description of the problem + data? I'm at [email protected].

(This is not designed for training on sentence embeddings, but I can try to help!)

[garenkwan]

Thanks for the comment @altosaar . I realized that my inputs and sentence embeddings use both positive and negative values in the input, however, I overlooked that fact that you have designed this for working on images which have inputs that are always positive and between 0 and 1.

To avoid the loss from blowing up, I rescaled the input values to be between 0 and 1 and it worked great!
But I've not tested on values greater than 1.