boettiger-lab/gym_climate

An :snake: OpenAI Gym to benchmark reinforcement learning solutions to climate change control problems :earth_americas: :robot:

gym_climate's Issues

Suggest to loosen the dependency on stable-baselines3

Hi, your project gym_climate(commit id: 43a30fe) requires "stable-baselines3==0.10.0" in its dependency. After analyzing the source code, we found that the following versions of stable-baselines3 can also be suitable, i.e., stable-baselines3 0.10.0a1, 0.11.0a4, 0.11.0a2, 0.11.0a1, since all functions that you directly (1 APIs: stable_baselines3.common.env_checker.check_env) or indirectly (propagate to -1 stable-baselines3's internal APIs and 24 outsider APIs) used from the package have not been changed in these versions, thus not affecting your usage.

Therefore, we believe that it is quite safe to loose your dependency on stable-baselines3 from "stable-baselines3==0.10.0" to "stable-baselines3>=0.10.0a1,<=0.11.0a4". This will improve the applicability of gym_climate and reduce the possibility of any further dependency conflict with other projects.

May I pull a request to further loosen the dependency on stable-baselines3?

By the way, could you please tell us whether such an automatic tool for dependency analysis may be potentially helpful for maintaining dependencies easier during your development?

large integrated assessment models

a few more very large modern cost-benefit models are referenced in https://doi.org/10.1038/s41586-021-03386-6. In particular, the FUND model co-maintainer is also here in Berkeley in ERG: https://github.com/fund-model/MimiFUND.jl , http://www.fund-model.org/

(these probably aren't easily translated into a gym model, though note that rllib has an API for training against external simulation applications https://docs.ray.io/en/latest/rllib-env.html#external-agents-and-applications. probably not something we could make headway on directly but perhaps an illustrative example for more 'grand challenge' flavor problems. )

Also, of course the individual modules of these integrated models are not necessarily particularly complex. I think this is the biodiversity module: https://github.com/fund-model/MimiFUND.jl/blob/master/src/components/ImpactBioDiversityComponent.jl