Gradient of first layer updated twice?

[a1600012888]

Gradient of first layer updated twice?

[a1600012888]

Yes, you are right, thanks for pointing this out. These two lines are redundant.

We are computing the co-state ( at line 110) and the gradients of all the parameters at the same time using the same BP.

During our experiment stage, we also wondered whether it is necessary not to accumulate the gradients of the parameters in the first layer, so we add that two lines of code. But at that time, I did not realize that these two lines of code did not make a change.

Thanks for taking out time to read our code.