Questions of reward every step output

[semitable]

Questions of reward every step output

[semitable]

It should give you rewards at every time step (at a typical gym-interface fashion).

Do note that this is a (somewhat) sparse-reward environment. Non-zero rewards are given only upon successfully delivering a requested shelf.

[POJIANWU]

It should give you rewards at every time step (at a typical gym-interface fashion).

Do note that this is a (somewhat) sparse-reward environment. Non-zero rewards are given only upon successfully delivering a requested shelf.

Thanks for your reply!Another question that is when I run the test_obs_space_2 in test_env.py,I meet this error"assert len(gym.spaces.flatten(s, o)) == env._obs_length E assert 133 == 116".What should I do?Hope for your soon reply!