tviskaron/pogema-baselines

PPO and PyMARL baseline for Pogema environment

pogema-baselines's Issues

docker setup issue

Hi I'm having issues during the setup of pymarl and 2. appo baselines. I wonder if the libraries, esp the python version are the same in your setup?

1. here's the error message for pymarl:

Sending build context to Docker daemon  4.608kB
Step 1/7 : FROM  pytorch/pytorch
 ---> 1bfcece93725
Step 2/7 : ENV TZ=Asia/Taipei
 ---> Using cache
 ---> b4d8609ea11f
Step 3/7 : RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
 ---> Using cache
 ---> 4b59d5c757aa
Step 4/7 : RUN apt update && apt install build-essential ffmpeg libsm6 libxext6 git -y
 ---> Using cache
 ---> 4b5ecff702a5
Step 5/7 : ADD requirements.txt /tmp/
 ---> 65507e731d8e
Step 6/7 : RUN pip install -r /tmp/requirements.txt
 ---> Running in 58ff8471523b
Collecting git+https://github.com/oxwhirl/smac.git (from -r /tmp/requirements.txt (line 44))
  Cloning https://github.com/oxwhirl/smac.git to /tmp/pip-req-build-pub8p9w9
  Running command git clone --filter=blob:none --quiet https://github.com/oxwhirl/smac.git /tmp/pip-req-build-pub8p9w9
  Resolved https://github.com/oxwhirl/smac.git to commit 12614f1760427026cce82083dc3f0ab3ff1d939e
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting idna==2.7 (from -r /tmp/requirements.txt (line 1))
  Downloading idna-2.7-py2.py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.2/58.2 kB 2.9 MB/s eta 0:00:00
Collecting imageio==2.4.1 (from -r /tmp/requirements.txt (line 2))
  Downloading imageio-2.4.1.tar.gz (3.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 8.9 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpickle==0.9.6 (from -r /tmp/requirements.txt (line 3))
  Downloading jsonpickle-0.9.6.tar.gz (67 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.1/67.1 kB 6.0 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting kiwisolver==1.0.1 (from -r /tmp/requirements.txt (line 4))
  Downloading kiwisolver-1.0.1.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting matplotlib (from -r /tmp/requirements.txt (line 5))
  Obtaining dependency information for matplotlib from https://files.pythonhosted.org/packages/19/e5/a4ea514515f270224435c69359abb7a3d152ed31b9ee3ba5e63017461945/matplotlib-3.8.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading matplotlib-3.8.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB)
Collecting mock==2.0.0 (from -r /tmp/requirements.txt (line 6))
  Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.8/56.8 kB 10.2 MB/s eta 0:00:00
Collecting more-itertools==4.3.0 (from -r /tmp/requirements.txt (line 7))
  Downloading more_itertools-4.3.0-py3-none-any.whl (48 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.5/48.5 kB 10.2 MB/s eta 0:00:00
Collecting mpyq==0.2.5 (from -r /tmp/requirements.txt (line 8))
  Downloading mpyq-0.2.5.tar.gz (8.7 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting munch==2.3.2 (from -r /tmp/requirements.txt (line 9))
  Downloading munch-2.3.2.tar.gz (7.6 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (from -r /tmp/requirements.txt (line 10)) (1.26.0)
Collecting pathlib2==2.3.2 (from -r /tmp/requirements.txt (line 11))
  Downloading pathlib2-2.3.2-py2.py3-none-any.whl (16 kB)
Collecting pbr==4.3.0 (from -r /tmp/requirements.txt (line 12))
  Downloading pbr-4.3.0-py2.py3-none-any.whl (106 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 106.6/106.6 kB 10.9 MB/s eta 0:00:00
Requirement already satisfied: Pillow in /opt/conda/lib/python3.10/site-packages (from -r /tmp/requirements.txt (line 13)) (10.0.1)
Collecting pluggy==0.7.1 (from -r /tmp/requirements.txt (line 14))
  Downloading pluggy-0.7.1-py2.py3-none-any.whl (14 kB)
Collecting portpicker==1.2.0 (from -r /tmp/requirements.txt (line 15))
  Downloading portpicker-1.2.0.tar.gz (17 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting probscale==0.2.3 (from -r /tmp/requirements.txt (line 16))
  Downloading probscale-0.2.3-py2.py3-none-any.whl (448 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 448.2/448.2 kB 12.9 MB/s eta 0:00:00
Collecting protobuf==3.20.2 (from -r /tmp/requirements.txt (line 17))
  Downloading protobuf-3.20.2-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 7.5 MB/s eta 0:00:00
Collecting py==1.10.0 (from -r /tmp/requirements.txt (line 18))
  Downloading py-1.10.0-py2.py3-none-any.whl (97 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.6/97.6 kB 7.4 MB/s eta 0:00:00
Collecting pygame (from -r /tmp/requirements.txt (line 19))
  Obtaining dependency information for pygame from https://files.pythonhosted.org/packages/c8/c7/0d77e0e327bf09c12f445f92f5bad0b447375d7b836c5bac5255ead8436f/pygame-2.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Downloading pygame-2.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (13 kB)
Collecting pyparsing==2.2.2 (from -r /tmp/requirements.txt (line 20))
  Downloading pyparsing-2.2.2-py2.py3-none-any.whl (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.8/57.8 kB 5.4 MB/s eta 0:00:00
Collecting pysc2==3.0.0 (from -r /tmp/requirements.txt (line 21))
  Downloading PySC2-3.0.0-py3-none-any.whl (260 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 260.7/260.7 kB 7.1 MB/s eta 0:00:00
Collecting pytest==3.8.2 (from -r /tmp/requirements.txt (line 22))
  Downloading pytest-3.8.2-py2.py3-none-any.whl (209 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 209.9/209.9 kB 8.9 MB/s eta 0:00:00
Collecting python-dateutil==2.7.3 (from -r /tmp/requirements.txt (line 23))
  Downloading python_dateutil-2.7.3-py2.py3-none-any.whl (211 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 211.4/211.4 kB 10.1 MB/s eta 0:00:00
Collecting PyYAML==5.4 (from -r /tmp/requirements.txt (line 24))
  Downloading PyYAML-5.4.tar.gz (174 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 174.8/174.8 kB 10.7 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'error'
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [62 lines of output]
      /tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/config/setupcfg.py:293: _DeprecatedConfig: Deprecated config in `setup.cfg`
      !!
      
              ********************************************************************************
              The license_file parameter is deprecated, use license_files instead.
      
              This deprecation is overdue, please update your project and remove deprecated
              calls to avoid build errors in the future.
      
              See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
              ********************************************************************************
      
      !!
        parsed = self.parsers.get(option_name, lambda x: x)(value)
      running egg_info
      writing lib3/PyYAML.egg-info/PKG-INFO
      writing dependency_links to lib3/PyYAML.egg-info/dependency_links.txt
      writing top-level names to lib3/PyYAML.egg-info/top_level.txt
      Traceback (most recent call last):
        File "/opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 355, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 325, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in run_setup
          exec(code, locals())
        File "<string>", line 271, in <module>
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/__init__.py", line 103, in setup
          return distutils.core.setup(**attrs)
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 185, in setup
          return run_commands(dist)
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
          dist.run_commands()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
          self.run_command(cmd)
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/dist.py", line 989, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
          cmd_obj.run()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 318, in run
          self.find_sources()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 326, in find_sources
          mm.run()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 548, in run
          self.add_defaults()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 586, in add_defaults
          sdist.add_defaults(self)
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/sdist.py", line 113, in add_defaults
          super().add_defaults()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/sdist.py", line 251, in add_defaults
          self._add_defaults_ext()
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/sdist.py", line 336, in _add_defaults_ext
          self.filelist.extend(build_ext.get_source_files())
        File "<string>", line 201, in get_source_files
        File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 107, in __getattr__
          raise AttributeError(attr)
      AttributeError: cython_sources
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a non-zero code: 1

and here's the error message for appo:

Sending build context to Docker daemon  4.608kB
Step 1/7 : FROM pytorch/pytorch:1.9.0-cuda11.1-cudnn8-runtime
1.9.0-cuda11.1-cudnn8-runtime: Pulling from pytorch/pytorch
4bbfd2c87b75: Pull complete 
d2e110be24e1: Pull complete 
889a7173dcfe: Pull complete 
6009a622672a: Pull complete 
2befb7f36811: Pull complete 
d4526feb92ee: Pull complete 
Digest: sha256:e04020e1b6cc744659c70f5afdc0ab602486f24d74f9ba44929c14b7442dca31
Status: Downloaded newer image for pytorch/pytorch:1.9.0-cuda11.1-cudnn8-runtime
 ---> 12da3f8ec2ec
Step 2/7 : ENV TZ=Asia/Taipei
 ---> Running in 495b56a051f2
Removing intermediate container 495b56a051f2
 ---> f204a134417b
Step 3/7 : RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
 ---> Running in 538b075d852e
Removing intermediate container 538b075d852e
 ---> 9c9de04a099f
Step 4/7 : RUN apt update && apt install build-essential ffmpeg libsm6 libxext6 git -y
 ---> Running in 090e0232cad8

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Get:1 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]
Get:5 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [23.8 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1688 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3785 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [30.8 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2411 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1728 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [64.0 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [20.6 kB]
Get:17 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1637 kB]
Get:18 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [3373 kB]
Fetched 28.1 MB in 12s (2253 kB/s)
Reading package lists...
Building dependency tree...
Reading state information...
49 packages can be upgraded. Run 'apt list --upgradable' to see them.

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  .......
The following packages will be upgraded:
  gpgv perl-base
2 upgraded, 274 newly installed, 0 to remove and 47 not upgraded.
Need to get 138 MB of archives.
After this operation, 795 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 perl-base amd64 5.26.1-6ubuntu0.7 [1392 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 liblocale-gettext-perl amd64 1.07-3build2 [16.6 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxau6 amd64 1:1.0.8-1ubuntu1 [7556 B]
....
Get:268 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfile-fcntllock-perl amd64 0.22-3build2 [33.2 kB]
Get:269 http://archive.ubuntu.com/ubuntu bionic/main amd64 libgdk-pixbuf2.0-bin amd64 2.36.11-2 [7864 B]
Get:270 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librsvg2-common amd64 2.40.20-2ubuntu0.2 [5064 B]
Get:271 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libsasl2-modules amd64 2.1.27~101-g0780600+dfsg-3ubuntu2.4 [48.9 kB]
Get:272 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 mesa-va-drivers amd64 20.0.8-0ubuntu1~18.04.1 [2376 kB]
Get:273 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 mesa-vdpau-drivers amd64 20.0.8-0ubuntu1~18.04.1 [2496 kB]
Get:274 http://archive.ubuntu.com/ubuntu bionic/universe amd64 i965-va-driver amd64 2.1.0-0ubuntu1 [925 kB]
Get:275 http://archive.ubuntu.com/ubuntu bionic/universe amd64 va-driver-all amd64 2.1.0-3 [4376 B]
Get:276 http://archive.ubuntu.com/ubuntu bionic/main amd64 vdpau-driver-all amd64 1.1.1-3ubuntu1 [4674 B]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 138 MB in 48s (2840 kB/s)
(Reading database ... 5941 files and directories currently installed.)
Preparing to unpack .../perl-base_5.26.1-6ubuntu0.7_amd64.deb ...
Unpacking perl-base (5.26.1-6ubuntu0.7) over (5.26.1-6ubuntu0.5) ...
Setting up perl-base (5.26.1-6ubuntu0.7) ...
Selecting previously unselected package liblocale-gettext-perl.
(Reading database ... 5941 files and directories currently installed.)
Preparing to unpack .../00-liblocale-gettext-perl_1.07-3build2_amd64.deb ...
Unpacking liblocale-gettext-perl (1.07-3build2) ...
Selecting previously unselected package libxau6:amd64.
Preparing to unpack .../01-libxau6_1%3a1.0.8-1ubuntu1_amd64.deb ...
Unpacking libxau6:amd64 (1:1.0.8-1ubuntu1) ...
Selecting previously unselected package libbsd0:amd64.
Preparing to unpack .../02-libbsd0_0.8.7-1ubuntu0.1_amd64.deb ...
Unpacking libbsd0:amd64 (0.8.7-1ubuntu0.1) ...
Selecting previously unselected package libxdmcp6:amd64.
Preparing to unpack .../03-libxdmcp6_1%3a1.1.2-3_amd64.deb ...
Unpacking libxdmcp6:amd64 (1:1.1.2-3) ...

....

Selecting previously unselected package mesa-va-drivers:amd64.
Preparing to unpack .../242-mesa-va-drivers_20.0.8-0ubuntu1~18.04.1_amd64.deb ...
Unpacking mesa-va-drivers:amd64 (20.0.8-0ubuntu1~18.04.1) ...
Selecting previously unselected package mesa-vdpau-drivers:amd64.
Preparing to unpack .../243-mesa-vdpau-drivers_20.0.8-0ubuntu1~18.04.1_amd64.deb ...
Unpacking mesa-vdpau-drivers:amd64 (20.0.8-0ubuntu1~18.04.1) ...
Selecting previously unselected package i965-va-driver:amd64.
Preparing to unpack .../244-i965-va-driver_2.1.0-0ubuntu1_amd64.deb ...
Unpacking i965-va-driver:amd64 (2.1.0-0ubuntu1) ...
Selecting previously unselected package va-driver-all:amd64.
Preparing to unpack .../245-va-driver-all_2.1.0-3_amd64.deb ...
Unpacking va-driver-all:amd64 (2.1.0-3) ...
Selecting previously unselected package vdpau-driver-all:amd64.
Preparing to unpack .../246-vdpau-driver-all_1.1.1-3ubuntu1_amd64.deb ...
Unpacking vdpau-driver-all:amd64 (1.1.1-3ubuntu1) ...
Setting up libquadmath0:amd64 (8.4.0-1ubuntu1~18.04) ...
Setting up libnpth0:amd64 (1.5-3) ...
Setting up libedit2:amd64 (3.1-20170329-1) ...
Setting up libgomp1:amd64 (8.4.0-1ubuntu1~18.04) ...
Setting up libpgm-5.2-0:amd64 (5.2.122~dfsg-2) ...

....

Setting up krb5-locales (1.16-2ubuntu0.4) ...
Setting up publicsuffix (20180223.1310-1) ...
Setting up libapparmor1:amd64 (2.12-4ubuntu5.3) ...
Setting up xz-utils (5.2.2-1.3ubuntu0.1) ...
update-alternatives: using /usr/bin/xz to provide /usr/bin/lzma (lzma) in auto mode
update-alternatives: warning: skip creation of /usr/share/man/man1/lzma.1.gz because associated file /usr/share/man/man1/xz.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/unlzma.1.gz because associated file /usr/share/man/man1/unxz.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzcat.1.gz because associated file /usr/share/man/man1/xzcat.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzmore.1.gz because associated file /usr/share/man/man1/xzmore.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzless.1.gz because associated file /usr/share/man/man1/xzless.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzdiff.1.gz because associated file /usr/share/man/man1/xzdiff.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzcmp.1.gz because associated file /usr/share/man/man1/xzcmp.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzgrep.1.gz because associated file /usr/share/man/man1/xzgrep.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzegrep.1.gz because associated file /usr/share/man/man1/xzegrep.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzfgrep.1.gz because associated file /usr/share/man/man1/xzfgrep.1.gz (of link group lzma) doesn't exist
Setting up libheimbase1-heimdal:amd64 (7.5.0+dfsg-1ubuntu0.4) ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libfakeroot:amd64 (1.22-2ubuntu1) ...
Setting up libavc1394-0:amd64 (0.5.4-4build1) ...
Setting up libsqlite3-0:amd64 (3.22.0-1ubuntu0.7) ...
Setting up libzvbi-common (0.2.35-13) ...
Setting up libfribidi0:amd64 (0.19.7-2ubuntu0.1) ...
Setting up liblocale-gettext-perl (1.07-3build2) ...
Setting up libpciaccess0:amd64 (0.14-1) ...
Setting up libsensors4:amd64 (1:3.4.0-4ubuntu0.1) ...
Setting up shared-mime-info (1.9-2) ...
Setting up libxkbcommon0:amd64 (0.8.2-1~ubuntu18.04.1) ...
Setting up libvpx5:amd64 (1.7.0-3ubuntu0.18.04.1) ...
Setting up libmpc3:amd64 (1.1.0-1) ...
Setting up libgme0:amd64 (0.6.2-1) ...
Setting up libthai-data (0.1.27-2) ...
Setting up libxdmcp6:amd64 (1:1.1.2-3) ...
Setting up libgdbm-compat4:amd64 (1.14.1-6) ...
Setting up libbdplus0:amd64 (0.1.2-2) ...
Setting up libzvbi0:amd64 (0.2.35-13) ...
Setting up libkeyutils1:amd64 (1.5.9-9.2ubuntu2.1) ...
Setting up libsasl2-modules:amd64 (2.1.27~101-g0780600+dfsg-3ubuntu2.4) ...
Setting up libsamplerate0:amd64 (0.1.9-1) ...
Setting up libsndio6.1:amd64 (1.1.0-3) ...
Setting up libvorbis0a:amd64 (1.3.5-4.2) ...
Setting up x11-common (1:7.7+19ubuntu7.1) ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up libmpg123-0:amd64 (1.25.10-1) ...
Setting up libslang2:amd64 (2.3.1a-3ubuntu1) ...
Setting up libassuan0:amd64 (2.5.1-2) ...
Setting up xdg-user-dirs (0.17-1ubuntu1) ...
Setting up libwayland-cursor0:amd64 (1.16.0-1ubuntu1.1~18.04.4) ...
Setting up libgsm1:amd64 (1.0.13-4build1) ...
Setting up libmysofa0:amd64 (0.6~dfsg0-3+deb10u1build1) ...
Setting up libwayland-egl1:amd64 (1.16.0-1ubuntu1.1~18.04.4) ...
Setting up libitm1:amd64 (8.4.0-1ubuntu1~18.04) ...

...

Setting up librsvg2-common:amd64 (2.40.20-2ubuntu0.2) ...
Setting up libchromaprint1:amd64 (1.4.3-1) ...
Setting up libavformat57:amd64 (7:3.4.11-0ubuntu0.1) ...
Setting up libavfilter6:amd64 (7:3.4.11-0ubuntu0.1) ...
Setting up libavdevice57:amd64 (7:3.4.11-0ubuntu0.1) ...
Setting up ffmpeg (7:3.4.11-0ubuntu0.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
Processing triggers for libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...
Removing intermediate container 090e0232cad8
 ---> d1301a6d56ee
Step 5/7 : ADD requirements.txt /tmp/
 ---> f24d29446f5c
Step 6/7 : RUN pip install -r /tmp/requirements.txt
 ---> Running in ab027b7830d3
Collecting gym==0.21.0
  Downloading gym-0.21.0.tar.gz (1.5 MB)
Collecting numpy>=1.21.5
  Downloading numpy-1.21.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
Collecting pydantic>=1.8.2
  Downloading pydantic-2.5.1-py3-none-any.whl (381 kB)
Collecting wandb==0.12.1
  Downloading wandb-0.12.1-py2.py3-none-any.whl (1.7 MB)
Collecting torch==1.8.1
  Downloading torch-1.8.1-cp37-cp37m-manylinux1_x86_64.whl (804.1 MB)
ERROR: Exception:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 438, in _error_catcher
    yield
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
    data = self._fp.read(amt) if not fp_closed else b""
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
    data = self.__fp.read(amt)
  File "/opt/conda/lib/python3.7/http/client.py", line 461, in read
    n = self.readinto(b)
  File "/opt/conda/lib/python3.7/http/client.py", line 505, in readinto
    n = self.fp.readinto(b)
  File "/opt/conda/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/opt/conda/lib/python3.7/ssl.py", line 1071, in recv_into
    return self.read(nbytes, buffer)
  File "/opt/conda/lib/python3.7/ssl.py", line 929, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 180, in _main
    status = self.run(options, args)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 204, in wrapper
    return func(self, options, args)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 319, in run
    reqs, check_supported_wheels=not options.target_dir
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 128, in resolve
    requirements, max_rounds=try_to_avoid_resolution_too_deep
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 473, in resolve
    state = resolution.resolve(requirements, max_rounds=max_rounds)
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 341, in resolve
    name, crit = self._merge_into_criterion(r, parent=None)
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _merge_into_criterion
    if not criterion.candidates:
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/structs.py", line 139, in __bool__
    return bool(self._sequence)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in __bool__
    return any(self)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 129, in <genexpr>
    return (c for c in iterator if id(c) not in self._incompatible_ids)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 33, in _iter_built
    candidate = func()
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 205, in _make_candidate_from_link
    version=version,
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 312, in __init__
    version=version,
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 151, in __init__
    self.dist = self._prepare()
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 234, in _prepare
    dist = self._prepare_distribution()
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 318, in _prepare_distribution
    self._ireq, parallel_builds=True
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 508, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 552, in _prepare_linked_requirement
    self.download_dir, hashes
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 243, in unpack_url
    hashes=hashes,
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 102, in get_http_url
    from_path, content_type = download(link, temp_dir.path)
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/network/download.py", line 157, in __call__
    for chunk in chunks:
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/cli/progress_bars.py", line 152, in iter
    for x in it:
  File "/opt/conda/lib/python3.7/site-packages/pip/_internal/network/utils.py", line 86, in response_chunks
    decode_content=False,
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 541, in read
    raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
  File "/opt/conda/lib/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 443, in _error_catcher
    raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.
The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a non-zero code: 2

---

I found some relevant errors for pymarl by installing setuptools==65.5.0, but it didn't help in this case.
refernce

And in appo, torch==1.8.1 seems to be unfound:

Collecting torch==1.8.1
  Downloading torch-1.8.1-cp37-cp37m-manylinux1_x86_64.whl (804.1 MB)

Credentials to Asynchronous PPO

What is the paper of Asynchronous PPO that the algorithm is based on?
I cannot find it, unfortunately.

How to run ?

Hello,I want to run your code .Can you tell me the step?Thanks.

visualize

Hello, I ran your code and displayed the results on the terminal and wandb. How can I visualize the environment? I would appreciate it if you could answer.

New issue when running 32X32 and 64X64

When I run 32X32 and 64X64, the program is killed by the system. I don't know if you have such a question?

Issue in running main.py

Hi There,

I am trying to run the main.py file within the pymarl directory using the default parameter of configs\debug.yaml with Python 3.8.10 on Windows 11

However, I am encountering a "process died" message as shown below.

Here are the logs (I hope this is enough information for you to go by):
PS C:\Users\rohit\Documents\pogema-baselines\pymarl> python .\main.py
[DEBUG 23:06:57] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
usage: training_run.py [-h] [--config_path CONFIG_PATH]
[--raw_config RAW_CONFIG]
training_run.py: error: unrecognized arguments: {grid_config: {FREE: 0, OBSTACLE: 1, MOVES: [[0, 0], [-1, 0], [1, 0], [0, -1], [0, 1]], on_target: finish, seed: null, size: 8, density: 0.3, num_agents: 8, obs_radius: 5, agents_xy: n
ull, targets_xy: null, collision_system: priority, persistent: false, observation_type: default, map: null, empty_outside: true, map_name: custom, integration: null, max_episode_steps: 64, auto_reset: null}}, agent_params: {agent: r
nn, rnn_hidden_dim: 64, obs_agent_id: true, obs_last_action: true, repeat_id: 1, label: default_label}, rl_params: {gamma: 0.99, batch_size: 32, lr: 0.0005, critic_lr: 0.0005, optim_alpha: 0.99, optim_eps: 1e-05, grad_norm_clip: 10.
0}, logging: {use_tensorboard: true, save_model: true, save_model_interval: 10000000, checkpoint_path: , evaluate: false, load_step: 0, save_replay: false, local_results_path: results, use_wandb: false, project_name: Pogema-PyMARL-D
ebug}, settings: {batch_size_run: 1, test_nepisode: 0, test_interval: 2000, test_greedy: true, log_interval: 2000, runner_log_interval: 2000, learner_log_interval: 2000, t_max: 10000, use_cuda: true, buffer_cpu_only: true, mac: basi
c_mac, env: pogema}, algo_settings: {QMIX: {action_selector: epsilon_greedy, epsilon_start: 1.0, epsilon_finish: 0.05, epsilon_anneal_time: 50000, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q
, learner: q_learner, double_q: true, name: qmix, mixer: qmix, mixing_embed_dim: 32, hypernet_layers: 2, hypernet_embed: 64}, VDN: {action_selector: epsilon_greedy, epsilon_start: 1.0, epsilon_finish: 0.05, epsilon_anneal_time: 5000
0, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q, learner: q_learner, double_q: true, name: vdn, mixer: vdn}, IQL: {action_selector: epsilon_greedy, epsilon_start: 1.0, epsilon_finish: 0.05, e
psilon_anneal_time: 50000, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q, learner: q_learner, double_q: true, name: iql, mixer: null}, QTRAN: {action_selector: epsilon_greedy, epsilon_start: 1
.0, epsilon_finish: 0.05, epsilon_anneal_time: 50000, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q, learner: qtran_learner, double_q: true, name: qtran, mixer: qtran_base, mixing_embed_dim: 6
4, qtran_arch: qtran_paper, opt_loss: 1, nopt_min_loss: 0.1, network_size: small}, COMA: {action_selector: multinomial, epsilon_start: 0.5, epsilon_finish: 0.01, epsilon_anneal_time: 100000, runner: parallel, buffer_size: 1, target_update_interval: 200, agent_output_type: q, learner: q_learner, double_q: true, name: coma, mask_before_softmax: false, batch_size_run: 1, batch_size: 1, mixer: null}}, algo: QMIX}'
[INFO 23:07:00] git.cmd Ignored error after process had died: OSError(9, 'The handle is invalid', None, 6, None)
[INFO 23:07:00] git.cmd Ignored error after process had died: OSError(9, 'The handle is invalid', None, 6, None)

Custom environment in config

In the config files, e.g.

algo:
  grid_search: [ QMIX, VDN, IQL, ]
settings:
  t_max: 8000000
logging:
  use_wandb: True
  project_name: "Pogema-32x32-PyMARL"
env_args:
  grid_config:
    map_name:
      grid_search: [Easy32x32, Normal32x32, Hard32x32, ExtraHard32x32]

the environments are predefined by pogema library. Is it possible to pass a custom environment (GridConfig) here with different map size, FOV, obstacle density, etc?