littlewebcat/drl-base-ems

DRL-Base-EMS for HEVs

drl-base-ems's Issues

About The Gym Env

Hello, thanks for your open source. I was wondering where you got your vehicle reinforcement learning environment? I'd like to see if there's any documentation on it. I looked on the NERL/FASTsim website but couldn't find it.

TypeError: reset() got an unexpected keyword argument 'seed'

When I run all the control algorithms, there is an issue with the seeds
"Traceback (most recent call last):
File "D:\OneDrive - mail.nwpu.edu.cn\HEVpy\DRL-Base-EMS-main\Continuous Algorithms\ppo.py", line 191, in
test_ppo()
File "D:\OneDrive - mail.nwpu.edu.cn\HEVpy\DRL-Base-EMS-main\Continuous Algorithms\ppo.py", line 115, in test_ppo
train_collector = Collector(
File "E:\anaconda3\envs\torch2\lib\site-packages\tianshou\data\collector.py", line 80, in init
self.reset(False)
File "E:\anaconda3\envs\torch2\lib\site-packages\tianshou\data\collector.py", line 131, in reset
self.reset_env(gym_reset_kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\tianshou\data\collector.py", line 147, in reset_env
obs, info = self.env.reset(**gym_reset_kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\tianshou\env\venvs.py", line 277, in reset
self.workers[i].send(None, **kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\tianshou\env\worker\dummy.py", line 36, in send
self.result = self.env.reset(**kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\shimmy\openai_gym_compatibility.py", line 106, in reset
return self.gym_env.reset(seed=seed, options=options)
File "E:\anaconda3\envs\torch2\lib\site-packages\gym\wrappers\time_limit.py", line 68, in reset
return self.env.reset(**kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\gym\wrappers\order_enforcing.py", line 42, in reset
return self.env.reset(**kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\gym\wrappers\env_checker.py", line 45, in reset
return env_reset_passive_checker(self.env, **kwargs)
File "E:\anaconda3\envs\torch2\lib\site-packages\gym\utils\passive_env_checker.py", line 192, in env_reset_passive_checker
result = env.reset(**kwargs)
TypeError: reset() got an unexpected keyword argument 'seed'"

name 'sim_drive_sub' is not defined

Hello There

Thanks for making this repo available. I am exploring this repo. I tried running the code and using vehcile_discrete.py . I loaded the udss.csv and the FASTSim_py_veh_db.csv file works fine until here.

However, when I ran the following code :

output = sim_drive(cyc, veh)

I get the error : name 'sim_drive_sub' is not defined. I tried looking for this function , seems like this function is missing . Could you please help ?

`NameError Traceback (most recent call last)
Cell In [7], line 1
----> 1 output = sim_drive(cyc, veh)

File ~\Anaconda3\envs\rllib\Lib\site-packages\gym\envs\classic_control\vehicle_discrete.py:329, in sim_drive(cyc, veh)
326 if cyc_num=='one':
327 # one cycle
328 sim_count += 1
--> 329 output = sim_drive_sub(cyc, veh, initSoc)
330 ess2fuelKwh = abs( output['ess2fuelKwh'] )
331 else:
332 ##########################################################################
333 ##########################################################################
334 ##########################################################################
335 # multiple cycle

NameError: name 'sim_drive_sub' is not defined`

Please upload Requirement file

Hello Thanks for making this open . Could you please upload requirement file with this . I have tried to run this but getting errors , potentialy due to mismathced versions of the libraries I am using . It will help if you could please upload the requirements file .

Thanks

There seem to be some questions about the environment

I'm sorry but there seems to be something wrong with the environment, and the actions assigned according to the reinforcement learning agent seem to be difficult to really adopt.