About loss_c in Multibox Loss

[lzx1413]

About loss_c in Multibox Loss

[lzx1413]

You can calculate the softmax loss once and generate a mask for postive instances and hard negtive instances. Then you can multiply them together to generate the valuable loss.

[hellojialee]

@taneslle , HI, have you figured it out why?

[lzx1413]

Because we want to get the softmax loss for each element. However, in the early version of Pytorch, this function is not supported and only the sum or average loss of all the elements is produced.

[hellojialee]

@lzx1413 Thank you so much for your replying! Now, we can control the 'reduce=False" to get the element -wise loss. So, do you mean we can just use the F.cross_entropy twice now? One for the hard negative mining, one for the calculation of the final conf_loss ?

[hellojialee]

Yes. Another issue is that if we can do it by using the F.cross_entropy twice. Will it change the input tensor's gradient because the forward pass of the same input is tracked. Thank you for your help again!

[lzx1413]

If you don't add the first softmax's loss to the final total loss, it will not affect the network.

[hellojialee]

Thank you.