awarelab/continual_world

continual_world's Issues

support for meta-World v2

Hello!

Amazing work!

I'm currently working on continual-world but using the meta-world v2 envs.
I'm getting really different results.
Is it on your roadmap to add support for it and rerun the experiments?
I think this is important, as meta-world v1 was found to be problematic and IFRC there was some bugs in the rewards function of some tasks.

Thanks again for this work. I've been thinking for a while about doing CRL research on meta-world, your paper was a blessing.

Issue with env.step

First of all, thanks for making this repository available to everyone!

I am facing a problem related to running continual world and maybe you can help. I followed the docker instructions in the readme and set up and built the container. Inside the container, when I run

python3 run_single.py --seed 0 --steps 2e3 --log_every 250 --task hammer-v1 --logger_output tsv tensorboard

I get the following error, which complains about the number of arguments returned by env.step():

/usr/local/lib/python3.6/dist-packages/gym/spaces/box.py:127: UserWarning: WARN: Box bound precision lowered by casting to float32
  logger.warn(f"Box bound precision lowered by casting to {self.dtype}")
Traceback (most recent call last):
  File "run_single.py", line 62, in <module>
    main(logger, **args)
  File "run_single.py", line 53, in main
    sac.run()
  File "/continualworld/continualworld/sac/sac.py", line 560, in run
    next_obs, reward, done, info = self.env.step(action)
  File "/continualworld/continualworld/utils/wrappers.py", line 19, in step
    obs, reward, done, info = self.env.step(action)
  File "/usr/local/lib/python3.6/dist-packages/gym/wrappers/time_limit.py", line 50, in step
    observation, reward, terminated, truncated, info = self.env.step(action)
ValueError: not enough values to unpack (expected 5, got 4)

I edited the file /usr/local/lib/python3.6/dist-packages/gym/wrappers/time_limit.py and removed the truncated return value and after this the script run_single.py runs fine.

    def step(self, action):
        """Steps through the environment and if the number of steps elapsed exceeds ``max_episode_steps`` then truncate.

        Args:
            action: The environment step action

        Returns:
            The environment step ``(observation, reward, terminated, truncated, info)`` with `truncated=True`
            if the number of steps elapsed >= max episode steps

        """
        observation, reward, terminated, info = self.env.step(action)
        #observation, reward, terminated, truncated, info = self.env.step(action)
        self._elapsed_steps += 1

        if self._elapsed_steps >= self._max_episode_steps:
            truncated = True

        # return observation, reward, terminated, truncated, info
        return observation, reward, terminated, info

I am not sure if this is an issue with a version of gym or something else. I am pretty sure I followed the exact steps described in the readme. Perhaps you can suggest a remedy so that I can run the example code without any hacks like changing the internals of llibrary functions? Thanks in advance.

Issue with installation

Hello，thanks for making this repository available to everyone!

I am facing a problem related to installing continual world, when I go to the main directory of this repo and run 'pip install .', I get the following error, which complains about the conflicting versions of mujoco-py that continualworld and metaworld rely on:

INFO: pip is looking at multiple versions of mujoco-py to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of continualworld to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install continualworld and continualworld==0.0.0 because these package versions have conflicting dependencies.

The conflict is caused by:
continualworld 0.0.0 depends on mujoco-py<2.2 and >=2.1
metaworld 0.0.0 depends on mujoco-py<2.1 and >=2.0

To fix this you could try to:

1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

Can someone help me please?

Dataset update request for experimental result

The link to the experimental result dateset is broken, can it be updated?

PyBullet bindings

Hello! Does Continual World have PyBullet bindings? MuJoCo license imposes certain restrictions which are not present in PyBullet. Thanks.

error when running the produce_results.py

I want to reproduce the experiment, but I encountered the following error when I run the produce_results.py:

2023-05-02 15:55:47.370703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll
Traceback (most recent call last):
  File "produce_results.py", line 83, in <module>
    main(args)
  File "produce_results.py", line 59, in main
    use_ci=args.use_ci,
  File "C:\Users\admin\Desktop\continualworld\results_processing\plots.py", line 421, in visualize_sequence
    output_file=output_file,
  File "C:\Users\admin\Desktop\continualworld\results_processing\plots.py", line 314, in plot_all_methods
    plot_fn(data, axes[0], "all methods", smoothen=smoothen)
  File "C:\Users\admin\Desktop\continualworld\results_processing\plots.py", line 156, in plot_current
    **lineplot_kwargs,
  File "C:\Users\admin\anaconda3\lib\site-packages\seaborn\_decorators.py", line 46, in inner_f
    return f(**kwargs)
  File "C:\Users\admin\anaconda3\lib\site-packages\seaborn\relational.py", line 710, in lineplot
    p.plot(ax, kwargs)
  File "C:\Users\admin\anaconda3\lib\site-packages\seaborn\relational.py", line 471, in plot
    for sub_vars, sub_data in self.iter_data(grouping_vars, from_comp_data=True):
  File "C:\Users\admin\anaconda3\lib\site-packages\seaborn\_core.py", line 983, in iter_data
    data = self.comp_data
  File "C:\Users\admin\anaconda3\lib\site-packages\seaborn\_core.py", line 1057, in comp_data
    comp_col.loc[orig.index] = pd.to_numeric(axis.convert_units(orig))
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\indexing.py", line 723, in __setitem__
    iloc._setitem_with_indexer(indexer, value, self.name)
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\indexing.py", line 1732, in _setitem_with_indexer
    self._setitem_single_block(indexer, value, name)
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\indexing.py", line 1959, in _setitem_single_block
    value = self._align_series(indexer, Series(value))
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\indexing.py", line 2096, in _align_series      
    ser = ser.reindex(obj.axes[0][indexer[0]], copy=True)._values
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\series.py", line 4580, in reindex
    return super().reindex(index=index, **kwargs)
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\generic.py", line 4819, in reindex
    axes, level, limit, tolerance, method, fill_value, copy
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\generic.py", line 4843, in _reindex_axes       
    allow_dups=False,
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\generic.py", line 4889, in _reindex_with_indexers
    copy=copy,
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\internals\managers.py", line 670, in reindex_indexer
    self.axes[axis]._validate_can_reindex(indexer)
  File "C:\Users\admin\anaconda3\lib\site-packages\pandas\core\indexes\base.py", line 3785, in _validate_can_reindex
    raise ValueError("cannot reindex from a duplicate axis")
ValueError: cannot reindex from a duplicate axis

It seems like a mistake in using seaborn, but I can't find where the problem is. Can someone help me please?