[Feature request] Hyperparameter optimization from pretrained agent

[dlr-rm]

[Feature request] Hyperparameter optimization from pretrained agent

[araffin]

Hello,
I'm unsure about such feature.
On one side, it seems to be a reasonable (even though unconventional) request. On the other side there are some behaviors that may be ill-defined.
For instance, if your pre-trained agent has a replay buffer size of 1e6, you should not change that during hyperparameter optimization. The same goes with other hyperparameters.

As a compromise you can fork this repo and create the feature in it (and post a link there ;)).

[Jonathan2021]

Not sure I will have enough time nor the courage to do so but maybe. Thanks for the reply anyways ;)