minhnhat93/lfa_sc

Matlab implementation of the paper "Learning fast approximations of sparse coding"

lfa_sc's Issues

About the Dictionary Learning

Hi, minhnhat93. I tested your implementation of the LISTA. During the dictionary learning part, I find some bugs. The dictionary couldn't be learned when I tried to fix them. Could you please help me with it?

Besides, according to the original paper of LISTA in parameter setting, the learning rate for LISTA training decays as 1/n (n-iter number), but the thing is when I did the exact same thing. The gradient is exploded to NaN. I guess it is the single-sample training strategy instead of mini-batch training causes this, making the gradient unstable. I notice you set extremely small learning rate, so there is no such problem. My question is if it is possible to deploy batch gradient descends to address this problem?

Looking forword to hearing from you!

The value of learning_rate.momentum

Hi, minhnhat93. I am confused about the value of learning_rate.momentum in your code lista_train.
Would you mind telling me how to choose the value? Thank you very much!