Questions on ICQ_softmax

[yiqinyang]

Questions on ICQ_softmax

[YiqinYang]

Dear qizhg,

Thanks for your comments.

1. The softmax approximation is an approximation method since it is easy to implement. You can also accurately calculate the re-weighting ratio. Please refer to the ICQ_mu.

2. We find the TD error will have a more stable performance. You can also adopt the Q-value, which will have a sound performance. Both two approaches have the same insights.

Sorry for the late reply, and Thanks again for your question!

Best

Yiqin