osudrl/apex

A continuous deep reinforcement learning framework for robotics

apex's Issues

OSError: [Errno 28] No space left on device

I'm running into out of storage issues while training (the "PPO" algorithm) as follows:

2022-08-24 11:57:32,014 WARNING worker.py:1404 -- Traceback (most recent call last):
File "python/ray/_raylet.pyx", line 896, in ray._raylet.spill_objects_handler
File "python/ray/_raylet.pyx", line 899, in ray._raylet.spill_objects_handler
File "/home/xxx/anaconda3/envs/mujoco_env/lib/python3.7/site-packages/ray/external_storage.py", line 662, in spill_objects
return _external_storage.spill_objects(object_refs, owner_addresses)
File "/home/xxx/anaconda3/envs/mujoco_env/lib/python3.7/site-packages/ray/external_storage.py", line 303, in spill_objects
return self._write_multiple_objects(f, object_refs, owner_addresses, url)
File "/home/xxx/anaconda3/envs/mujoco_env/lib/python3.7/site-packages/ray/external_storage.py", line 151, in _write_multiple_objects
written_bytes = f.write(payload)
OSError: [Errno 28] No space left on device
An unexpected internal error occurred while the IO worker was spilling objects: [Errno 28] No space left on device

Approximately how much space is required for the "apex" project to train. thanks

Requesting simple RDPG example

Hi, could you help me get a simple RDPG example using, say, Pendulum-v0 working?

I tried to invoke using the following on an Ubuntu + Pytorch 1.4.1 system, but am running into errors:

python apex.py rdpg --env_name Pendulum-v0 --run_name pendulum_rdpg

I fixed several pathname related issues, but am still running into missing modules etc.

Traceback (most recent call last):
  File "apex.py", line 116, in <module>
    run_experiment(args)
  File "/home/apex/rl/algos/dpg.py", line 208, in run_experiment
    from rl.policies.critic import FF_Critic, LSTM_Critic
ImportError: cannot import name 'FF_Critic' from 'rl.policies.critic' (/home/apex/rl/policies/critic.py)

Thanks in advance!

Failed to open file

Is sensor delay taken into consideration?

When updating observations, Cassie gets current qpos and qvel. Is sensor delay of the observation taken into consideration in the environment?

cannot open shared object file: No such file or directory

I configured my mujoco200 and mujoco_py currently.But when I run the 'apex.py' or the command you provide,it always error as follows：Failed to load /home/eduradoxu/.mujoco/mujoco200_linux/bin/libmujoco200nogl.so. I think the error is due for the libcassiemujoco.so.

ERROR: Could not open activation key file (null)

Hey, I'm trying to use your cassie_standing_env, but I'm getting this error:
ERROR: Could not open activation key file (null)

I have a mujoco key, and it looks like this means that the directory we're looking for the key in is (null), as in, it isn't searching an actual directory. Any idea what's going on here? I can run cassie-mujoco-sim but not the version in this repo (which seems to be more recent, with walking trajectories).

Thanks!
Deirdre