Ranger21 has undocumented required arguments

[kozistr]

Ranger21 has undocumented required arguments

[kozistr]

thanks for reporting. I missed it :(

num_iterations is for the total training steps!

how "num_iterations", "num_warm_up_iterations", "num_warm_down_iterations" was intended to be used?

It's because the Ranger21 optimizer schedules the learning rate with its own recipes (schedulers). Here's the source code Ranger21.

Ranger21 performs linear lr warmup and Explore-exploit lr scheduler.

I don't understand why this wasn't left to the scheduler

I agree with you. It'd be better to use lr scheduler that we want (not hard-coded in the optimizer).

If there is time, I'll try to refactor to remove the internal lr schedulers and implement them with the Pytorch compatible lr scheduler class or something else!

anyway, thanks for the reporting and the suggestion.

[kozistr]

Here are the previous Ranger21 optimizer related issues.

hope it helps you!

• #167
• #169

[kozistr]

I just added the missing parameters. you can check it from the latest documentation!

thank you