tviskaron / pogema-baselines Goto Github PK
View Code? Open in Web Editor NEWPPO and PyMARL baseline for Pogema environment
PPO and PyMARL baseline for Pogema environment
Hi There,
I am trying to run the main.py file within the pymarl directory using the default parameter of configs\debug.yaml with Python 3.8.10 on Windows 11
However, I am encountering a "process died" message as shown below.
Here are the logs (I hope this is enough information for you to go by):
PS C:\Users\rohit\Documents\pogema-baselines\pymarl> python .\main.py
[DEBUG 23:06:57] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:58] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--cached', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'diff', '--abbrev=40', '--full-index', '--raw'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=None)
[DEBUG 23:06:59] git.cmd Popen(['git', 'cat-file', '--batch-check'], cwd=C:\Users\rohit\Documents\pogema-baselines, universal_newlines=False, shell=None, istream=)
usage: training_run.py [-h] [--config_path CONFIG_PATH]
[--raw_config RAW_CONFIG]
training_run.py: error: unrecognized arguments: {grid_config: {FREE: 0, OBSTACLE: 1, MOVES: [[0, 0], [-1, 0], [1, 0], [0, -1], [0, 1]], on_target: finish, seed: null, size: 8, density: 0.3, num_agents: 8, obs_radius: 5, agents_xy: n
ull, targets_xy: null, collision_system: priority, persistent: false, observation_type: default, map: null, empty_outside: true, map_name: custom, integration: null, max_episode_steps: 64, auto_reset: null}}, agent_params: {agent: r
nn, rnn_hidden_dim: 64, obs_agent_id: true, obs_last_action: true, repeat_id: 1, label: default_label}, rl_params: {gamma: 0.99, batch_size: 32, lr: 0.0005, critic_lr: 0.0005, optim_alpha: 0.99, optim_eps: 1e-05, grad_norm_clip: 10.
0}, logging: {use_tensorboard: true, save_model: true, save_model_interval: 10000000, checkpoint_path: , evaluate: false, load_step: 0, save_replay: false, local_results_path: results, use_wandb: false, project_name: Pogema-PyMARL-D
ebug}, settings: {batch_size_run: 1, test_nepisode: 0, test_interval: 2000, test_greedy: true, log_interval: 2000, runner_log_interval: 2000, learner_log_interval: 2000, t_max: 10000, use_cuda: true, buffer_cpu_only: true, mac: basi
c_mac, env: pogema}, algo_settings: {QMIX: {action_selector: epsilon_greedy, epsilon_start: 1.0, epsilon_finish: 0.05, epsilon_anneal_time: 50000, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q
, learner: q_learner, double_q: true, name: qmix, mixer: qmix, mixing_embed_dim: 32, hypernet_layers: 2, hypernet_embed: 64}, VDN: {action_selector: epsilon_greedy, epsilon_start: 1.0, epsilon_finish: 0.05, epsilon_anneal_time: 5000
0, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q, learner: q_learner, double_q: true, name: vdn, mixer: vdn}, IQL: {action_selector: epsilon_greedy, epsilon_start: 1.0, epsilon_finish: 0.05, e
psilon_anneal_time: 50000, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q, learner: q_learner, double_q: true, name: iql, mixer: null}, QTRAN: {action_selector: epsilon_greedy, epsilon_start: 1
.0, epsilon_finish: 0.05, epsilon_anneal_time: 50000, runner: episode, buffer_size: 5000, target_update_interval: 200, agent_output_type: q, learner: qtran_learner, double_q: true, name: qtran, mixer: qtran_base, mixing_embed_dim: 6
4, qtran_arch: qtran_paper, opt_loss: 1, nopt_min_loss: 0.1, network_size: small}, COMA: {action_selector: multinomial, epsilon_start: 0.5, epsilon_finish: 0.01, epsilon_anneal_time: 100000, runner: parallel, buffer_size: 1, target_update_interval: 200, agent_output_type: q, learner: q_learner, double_q: true, name: coma, mask_before_softmax: false, batch_size_run: 1, batch_size: 1, mixer: null}}, algo: QMIX}'
[INFO 23:07:00] git.cmd Ignored error after process had died: OSError(9, 'The handle is invalid', None, 6, None)
[INFO 23:07:00] git.cmd Ignored error after process had died: OSError(9, 'The handle is invalid', None, 6, None)
In the config files, e.g.
algo:
grid_search: [ QMIX, VDN, IQL, ]
settings:
t_max: 8000000
logging:
use_wandb: True
project_name: "Pogema-32x32-PyMARL"
env_args:
grid_config:
map_name:
grid_search: [Easy32x32, Normal32x32, Hard32x32, ExtraHard32x32]
the environments are predefined by pogema library. Is it possible to pass a custom environment (GridConfig) here with different map size, FOV, obstacle density, etc?
What is the paper of Asynchronous PPO that the algorithm is based on?
I cannot find it, unfortunately.
Hi I'm having issues during the setup of pymarl and 2. appo baselines. I wonder if the libraries, esp the python version are the same in your setup?
Sending build context to Docker daemon 4.608kB
Step 1/7 : FROM pytorch/pytorch
---> 1bfcece93725
Step 2/7 : ENV TZ=Asia/Taipei
---> Using cache
---> b4d8609ea11f
Step 3/7 : RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
---> Using cache
---> 4b59d5c757aa
Step 4/7 : RUN apt update && apt install build-essential ffmpeg libsm6 libxext6 git -y
---> Using cache
---> 4b5ecff702a5
Step 5/7 : ADD requirements.txt /tmp/
---> 65507e731d8e
Step 6/7 : RUN pip install -r /tmp/requirements.txt
---> Running in 58ff8471523b
Collecting git+https://github.com/oxwhirl/smac.git (from -r /tmp/requirements.txt (line 44))
Cloning https://github.com/oxwhirl/smac.git to /tmp/pip-req-build-pub8p9w9
Running command git clone --filter=blob:none --quiet https://github.com/oxwhirl/smac.git /tmp/pip-req-build-pub8p9w9
Resolved https://github.com/oxwhirl/smac.git to commit 12614f1760427026cce82083dc3f0ab3ff1d939e
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting idna==2.7 (from -r /tmp/requirements.txt (line 1))
Downloading idna-2.7-py2.py3-none-any.whl (58 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.2/58.2 kB 2.9 MB/s eta 0:00:00
Collecting imageio==2.4.1 (from -r /tmp/requirements.txt (line 2))
Downloading imageio-2.4.1.tar.gz (3.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 8.9 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpickle==0.9.6 (from -r /tmp/requirements.txt (line 3))
Downloading jsonpickle-0.9.6.tar.gz (67 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.1/67.1 kB 6.0 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting kiwisolver==1.0.1 (from -r /tmp/requirements.txt (line 4))
Downloading kiwisolver-1.0.1.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting matplotlib (from -r /tmp/requirements.txt (line 5))
Obtaining dependency information for matplotlib from https://files.pythonhosted.org/packages/19/e5/a4ea514515f270224435c69359abb7a3d152ed31b9ee3ba5e63017461945/matplotlib-3.8.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading matplotlib-3.8.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB)
Collecting mock==2.0.0 (from -r /tmp/requirements.txt (line 6))
Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.8/56.8 kB 10.2 MB/s eta 0:00:00
Collecting more-itertools==4.3.0 (from -r /tmp/requirements.txt (line 7))
Downloading more_itertools-4.3.0-py3-none-any.whl (48 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.5/48.5 kB 10.2 MB/s eta 0:00:00
Collecting mpyq==0.2.5 (from -r /tmp/requirements.txt (line 8))
Downloading mpyq-0.2.5.tar.gz (8.7 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting munch==2.3.2 (from -r /tmp/requirements.txt (line 9))
Downloading munch-2.3.2.tar.gz (7.6 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (from -r /tmp/requirements.txt (line 10)) (1.26.0)
Collecting pathlib2==2.3.2 (from -r /tmp/requirements.txt (line 11))
Downloading pathlib2-2.3.2-py2.py3-none-any.whl (16 kB)
Collecting pbr==4.3.0 (from -r /tmp/requirements.txt (line 12))
Downloading pbr-4.3.0-py2.py3-none-any.whl (106 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 106.6/106.6 kB 10.9 MB/s eta 0:00:00
Requirement already satisfied: Pillow in /opt/conda/lib/python3.10/site-packages (from -r /tmp/requirements.txt (line 13)) (10.0.1)
Collecting pluggy==0.7.1 (from -r /tmp/requirements.txt (line 14))
Downloading pluggy-0.7.1-py2.py3-none-any.whl (14 kB)
Collecting portpicker==1.2.0 (from -r /tmp/requirements.txt (line 15))
Downloading portpicker-1.2.0.tar.gz (17 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting probscale==0.2.3 (from -r /tmp/requirements.txt (line 16))
Downloading probscale-0.2.3-py2.py3-none-any.whl (448 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 448.2/448.2 kB 12.9 MB/s eta 0:00:00
Collecting protobuf==3.20.2 (from -r /tmp/requirements.txt (line 17))
Downloading protobuf-3.20.2-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 7.5 MB/s eta 0:00:00
Collecting py==1.10.0 (from -r /tmp/requirements.txt (line 18))
Downloading py-1.10.0-py2.py3-none-any.whl (97 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.6/97.6 kB 7.4 MB/s eta 0:00:00
Collecting pygame (from -r /tmp/requirements.txt (line 19))
Obtaining dependency information for pygame from https://files.pythonhosted.org/packages/c8/c7/0d77e0e327bf09c12f445f92f5bad0b447375d7b836c5bac5255ead8436f/pygame-2.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading pygame-2.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (13 kB)
Collecting pyparsing==2.2.2 (from -r /tmp/requirements.txt (line 20))
Downloading pyparsing-2.2.2-py2.py3-none-any.whl (57 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.8/57.8 kB 5.4 MB/s eta 0:00:00
Collecting pysc2==3.0.0 (from -r /tmp/requirements.txt (line 21))
Downloading PySC2-3.0.0-py3-none-any.whl (260 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 260.7/260.7 kB 7.1 MB/s eta 0:00:00
Collecting pytest==3.8.2 (from -r /tmp/requirements.txt (line 22))
Downloading pytest-3.8.2-py2.py3-none-any.whl (209 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 209.9/209.9 kB 8.9 MB/s eta 0:00:00
Collecting python-dateutil==2.7.3 (from -r /tmp/requirements.txt (line 23))
Downloading python_dateutil-2.7.3-py2.py3-none-any.whl (211 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 211.4/211.4 kB 10.1 MB/s eta 0:00:00
Collecting PyYAML==5.4 (from -r /tmp/requirements.txt (line 24))
Downloading PyYAML-5.4.tar.gz (174 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 174.8/174.8 kB 10.7 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [62 lines of output]
/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/config/setupcfg.py:293: _DeprecatedConfig: Deprecated config in `setup.cfg`
!!
********************************************************************************
The license_file parameter is deprecated, use license_files instead.
This deprecation is overdue, please update your project and remove deprecated
calls to avoid build errors in the future.
See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
********************************************************************************
!!
parsed = self.parsers.get(option_name, lambda x: x)(value)
running egg_info
writing lib3/PyYAML.egg-info/PKG-INFO
writing dependency_links to lib3/PyYAML.egg-info/dependency_links.txt
writing top-level names to lib3/PyYAML.egg-info/top_level.txt
Traceback (most recent call last):
File "/opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
main()
File "/opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 355, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=['wheel'])
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 325, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in run_setup
exec(code, locals())
File "<string>", line 271, in <module>
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/__init__.py", line 103, in setup
return distutils.core.setup(**attrs)
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/dist.py", line 989, in run_command
super().run_command(command)
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 318, in run
self.find_sources()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 326, in find_sources
mm.run()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 548, in run
self.add_defaults()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/egg_info.py", line 586, in add_defaults
sdist.add_defaults(self)
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/command/sdist.py", line 113, in add_defaults
super().add_defaults()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/sdist.py", line 251, in add_defaults
self._add_defaults_ext()
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/command/sdist.py", line 336, in _add_defaults_ext
self.filelist.extend(build_ext.get_source_files())
File "<string>", line 201, in get_source_files
File "/tmp/pip-build-env-n3p39bt_/overlay/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 107, in __getattr__
raise AttributeError(attr)
AttributeError: cython_sources
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a non-zero code: 1
Sending build context to Docker daemon 4.608kB
Step 1/7 : FROM pytorch/pytorch:1.9.0-cuda11.1-cudnn8-runtime
1.9.0-cuda11.1-cudnn8-runtime: Pulling from pytorch/pytorch
4bbfd2c87b75: Pull complete
d2e110be24e1: Pull complete
889a7173dcfe: Pull complete
6009a622672a: Pull complete
2befb7f36811: Pull complete
d4526feb92ee: Pull complete
Digest: sha256:e04020e1b6cc744659c70f5afdc0ab602486f24d74f9ba44929c14b7442dca31
Status: Downloaded newer image for pytorch/pytorch:1.9.0-cuda11.1-cudnn8-runtime
---> 12da3f8ec2ec
Step 2/7 : ENV TZ=Asia/Taipei
---> Running in 495b56a051f2
Removing intermediate container 495b56a051f2
---> f204a134417b
Step 3/7 : RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
---> Running in 538b075d852e
Removing intermediate container 538b075d852e
---> 9c9de04a099f
Step 4/7 : RUN apt update && apt install build-essential ffmpeg libsm6 libxext6 git -y
---> Running in 090e0232cad8
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Get:1 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [83.3 kB]
Get:5 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [23.8 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1688 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3785 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [30.8 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2411 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1728 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [64.0 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [20.6 kB]
Get:17 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1637 kB]
Get:18 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [3373 kB]
Fetched 28.1 MB in 12s (2253 kB/s)
Reading package lists...
Building dependency tree...
Reading state information...
49 packages can be upgraded. Run 'apt list --upgradable' to see them.
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
.......
The following packages will be upgraded:
gpgv perl-base
2 upgraded, 274 newly installed, 0 to remove and 47 not upgraded.
Need to get 138 MB of archives.
After this operation, 795 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 perl-base amd64 5.26.1-6ubuntu0.7 [1392 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 liblocale-gettext-perl amd64 1.07-3build2 [16.6 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxau6 amd64 1:1.0.8-1ubuntu1 [7556 B]
....
Get:268 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfile-fcntllock-perl amd64 0.22-3build2 [33.2 kB]
Get:269 http://archive.ubuntu.com/ubuntu bionic/main amd64 libgdk-pixbuf2.0-bin amd64 2.36.11-2 [7864 B]
Get:270 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librsvg2-common amd64 2.40.20-2ubuntu0.2 [5064 B]
Get:271 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libsasl2-modules amd64 2.1.27~101-g0780600+dfsg-3ubuntu2.4 [48.9 kB]
Get:272 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 mesa-va-drivers amd64 20.0.8-0ubuntu1~18.04.1 [2376 kB]
Get:273 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 mesa-vdpau-drivers amd64 20.0.8-0ubuntu1~18.04.1 [2496 kB]
Get:274 http://archive.ubuntu.com/ubuntu bionic/universe amd64 i965-va-driver amd64 2.1.0-0ubuntu1 [925 kB]
Get:275 http://archive.ubuntu.com/ubuntu bionic/universe amd64 va-driver-all amd64 2.1.0-3 [4376 B]
Get:276 http://archive.ubuntu.com/ubuntu bionic/main amd64 vdpau-driver-all amd64 1.1.1-3ubuntu1 [4674 B]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 138 MB in 48s (2840 kB/s)
(Reading database ... 5941 files and directories currently installed.)
Preparing to unpack .../perl-base_5.26.1-6ubuntu0.7_amd64.deb ...
Unpacking perl-base (5.26.1-6ubuntu0.7) over (5.26.1-6ubuntu0.5) ...
Setting up perl-base (5.26.1-6ubuntu0.7) ...
Selecting previously unselected package liblocale-gettext-perl.
(Reading database ... 5941 files and directories currently installed.)
Preparing to unpack .../00-liblocale-gettext-perl_1.07-3build2_amd64.deb ...
Unpacking liblocale-gettext-perl (1.07-3build2) ...
Selecting previously unselected package libxau6:amd64.
Preparing to unpack .../01-libxau6_1%3a1.0.8-1ubuntu1_amd64.deb ...
Unpacking libxau6:amd64 (1:1.0.8-1ubuntu1) ...
Selecting previously unselected package libbsd0:amd64.
Preparing to unpack .../02-libbsd0_0.8.7-1ubuntu0.1_amd64.deb ...
Unpacking libbsd0:amd64 (0.8.7-1ubuntu0.1) ...
Selecting previously unselected package libxdmcp6:amd64.
Preparing to unpack .../03-libxdmcp6_1%3a1.1.2-3_amd64.deb ...
Unpacking libxdmcp6:amd64 (1:1.1.2-3) ...
....
Selecting previously unselected package mesa-va-drivers:amd64.
Preparing to unpack .../242-mesa-va-drivers_20.0.8-0ubuntu1~18.04.1_amd64.deb ...
Unpacking mesa-va-drivers:amd64 (20.0.8-0ubuntu1~18.04.1) ...
Selecting previously unselected package mesa-vdpau-drivers:amd64.
Preparing to unpack .../243-mesa-vdpau-drivers_20.0.8-0ubuntu1~18.04.1_amd64.deb ...
Unpacking mesa-vdpau-drivers:amd64 (20.0.8-0ubuntu1~18.04.1) ...
Selecting previously unselected package i965-va-driver:amd64.
Preparing to unpack .../244-i965-va-driver_2.1.0-0ubuntu1_amd64.deb ...
Unpacking i965-va-driver:amd64 (2.1.0-0ubuntu1) ...
Selecting previously unselected package va-driver-all:amd64.
Preparing to unpack .../245-va-driver-all_2.1.0-3_amd64.deb ...
Unpacking va-driver-all:amd64 (2.1.0-3) ...
Selecting previously unselected package vdpau-driver-all:amd64.
Preparing to unpack .../246-vdpau-driver-all_1.1.1-3ubuntu1_amd64.deb ...
Unpacking vdpau-driver-all:amd64 (1.1.1-3ubuntu1) ...
Setting up libquadmath0:amd64 (8.4.0-1ubuntu1~18.04) ...
Setting up libnpth0:amd64 (1.5-3) ...
Setting up libedit2:amd64 (3.1-20170329-1) ...
Setting up libgomp1:amd64 (8.4.0-1ubuntu1~18.04) ...
Setting up libpgm-5.2-0:amd64 (5.2.122~dfsg-2) ...
....
Setting up krb5-locales (1.16-2ubuntu0.4) ...
Setting up publicsuffix (20180223.1310-1) ...
Setting up libapparmor1:amd64 (2.12-4ubuntu5.3) ...
Setting up xz-utils (5.2.2-1.3ubuntu0.1) ...
update-alternatives: using /usr/bin/xz to provide /usr/bin/lzma (lzma) in auto mode
update-alternatives: warning: skip creation of /usr/share/man/man1/lzma.1.gz because associated file /usr/share/man/man1/xz.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/unlzma.1.gz because associated file /usr/share/man/man1/unxz.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzcat.1.gz because associated file /usr/share/man/man1/xzcat.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzmore.1.gz because associated file /usr/share/man/man1/xzmore.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzless.1.gz because associated file /usr/share/man/man1/xzless.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzdiff.1.gz because associated file /usr/share/man/man1/xzdiff.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzcmp.1.gz because associated file /usr/share/man/man1/xzcmp.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzgrep.1.gz because associated file /usr/share/man/man1/xzgrep.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzegrep.1.gz because associated file /usr/share/man/man1/xzegrep.1.gz (of link group lzma) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/lzfgrep.1.gz because associated file /usr/share/man/man1/xzfgrep.1.gz (of link group lzma) doesn't exist
Setting up libheimbase1-heimdal:amd64 (7.5.0+dfsg-1ubuntu0.4) ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libfakeroot:amd64 (1.22-2ubuntu1) ...
Setting up libavc1394-0:amd64 (0.5.4-4build1) ...
Setting up libsqlite3-0:amd64 (3.22.0-1ubuntu0.7) ...
Setting up libzvbi-common (0.2.35-13) ...
Setting up libfribidi0:amd64 (0.19.7-2ubuntu0.1) ...
Setting up liblocale-gettext-perl (1.07-3build2) ...
Setting up libpciaccess0:amd64 (0.14-1) ...
Setting up libsensors4:amd64 (1:3.4.0-4ubuntu0.1) ...
Setting up shared-mime-info (1.9-2) ...
Setting up libxkbcommon0:amd64 (0.8.2-1~ubuntu18.04.1) ...
Setting up libvpx5:amd64 (1.7.0-3ubuntu0.18.04.1) ...
Setting up libmpc3:amd64 (1.1.0-1) ...
Setting up libgme0:amd64 (0.6.2-1) ...
Setting up libthai-data (0.1.27-2) ...
Setting up libxdmcp6:amd64 (1:1.1.2-3) ...
Setting up libgdbm-compat4:amd64 (1.14.1-6) ...
Setting up libbdplus0:amd64 (0.1.2-2) ...
Setting up libzvbi0:amd64 (0.2.35-13) ...
Setting up libkeyutils1:amd64 (1.5.9-9.2ubuntu2.1) ...
Setting up libsasl2-modules:amd64 (2.1.27~101-g0780600+dfsg-3ubuntu2.4) ...
Setting up libsamplerate0:amd64 (0.1.9-1) ...
Setting up libsndio6.1:amd64 (1.1.0-3) ...
Setting up libvorbis0a:amd64 (1.3.5-4.2) ...
Setting up x11-common (1:7.7+19ubuntu7.1) ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up libmpg123-0:amd64 (1.25.10-1) ...
Setting up libslang2:amd64 (2.3.1a-3ubuntu1) ...
Setting up libassuan0:amd64 (2.5.1-2) ...
Setting up xdg-user-dirs (0.17-1ubuntu1) ...
Setting up libwayland-cursor0:amd64 (1.16.0-1ubuntu1.1~18.04.4) ...
Setting up libgsm1:amd64 (1.0.13-4build1) ...
Setting up libmysofa0:amd64 (0.6~dfsg0-3+deb10u1build1) ...
Setting up libwayland-egl1:amd64 (1.16.0-1ubuntu1.1~18.04.4) ...
Setting up libitm1:amd64 (8.4.0-1ubuntu1~18.04) ...
...
Setting up librsvg2-common:amd64 (2.40.20-2ubuntu0.2) ...
Setting up libchromaprint1:amd64 (1.4.3-1) ...
Setting up libavformat57:amd64 (7:3.4.11-0ubuntu0.1) ...
Setting up libavfilter6:amd64 (7:3.4.11-0ubuntu0.1) ...
Setting up libavdevice57:amd64 (7:3.4.11-0ubuntu0.1) ...
Setting up ffmpeg (7:3.4.11-0ubuntu0.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
Processing triggers for libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...
Removing intermediate container 090e0232cad8
---> d1301a6d56ee
Step 5/7 : ADD requirements.txt /tmp/
---> f24d29446f5c
Step 6/7 : RUN pip install -r /tmp/requirements.txt
---> Running in ab027b7830d3
Collecting gym==0.21.0
Downloading gym-0.21.0.tar.gz (1.5 MB)
Collecting numpy>=1.21.5
Downloading numpy-1.21.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
Collecting pydantic>=1.8.2
Downloading pydantic-2.5.1-py3-none-any.whl (381 kB)
Collecting wandb==0.12.1
Downloading wandb-0.12.1-py2.py3-none-any.whl (1.7 MB)
Collecting torch==1.8.1
Downloading torch-1.8.1-cp37-cp37m-manylinux1_x86_64.whl (804.1 MB)
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 438, in _error_catcher
yield
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
data = self._fp.read(amt) if not fp_closed else b""
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
data = self.__fp.read(amt)
File "/opt/conda/lib/python3.7/http/client.py", line 461, in read
n = self.readinto(b)
File "/opt/conda/lib/python3.7/http/client.py", line 505, in readinto
n = self.fp.readinto(b)
File "/opt/conda/lib/python3.7/socket.py", line 589, in readinto
return self._sock.recv_into(b)
File "/opt/conda/lib/python3.7/ssl.py", line 1071, in recv_into
return self.read(nbytes, buffer)
File "/opt/conda/lib/python3.7/ssl.py", line 929, in read
return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 180, in _main
status = self.run(options, args)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 204, in wrapper
return func(self, options, args)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 319, in run
reqs, check_supported_wheels=not options.target_dir
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 128, in resolve
requirements, max_rounds=try_to_avoid_resolution_too_deep
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 473, in resolve
state = resolution.resolve(requirements, max_rounds=max_rounds)
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 341, in resolve
name, crit = self._merge_into_criterion(r, parent=None)
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _merge_into_criterion
if not criterion.candidates:
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/resolvelib/structs.py", line 139, in __bool__
return bool(self._sequence)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in __bool__
return any(self)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 129, in <genexpr>
return (c for c in iterator if id(c) not in self._incompatible_ids)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 33, in _iter_built
candidate = func()
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 205, in _make_candidate_from_link
version=version,
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 312, in __init__
version=version,
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 151, in __init__
self.dist = self._prepare()
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 234, in _prepare
dist = self._prepare_distribution()
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 318, in _prepare_distribution
self._ireq, parallel_builds=True
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 508, in prepare_linked_requirement
return self._prepare_linked_requirement(req, parallel_builds)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 552, in _prepare_linked_requirement
self.download_dir, hashes
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 243, in unpack_url
hashes=hashes,
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 102, in get_http_url
from_path, content_type = download(link, temp_dir.path)
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/network/download.py", line 157, in __call__
for chunk in chunks:
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/cli/progress_bars.py", line 152, in iter
for x in it:
File "/opt/conda/lib/python3.7/site-packages/pip/_internal/network/utils.py", line 86, in response_chunks
decode_content=False,
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream
data = self.read(amt=amt, decode_content=decode_content)
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 541, in read
raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
File "/opt/conda/lib/python3.7/contextlib.py", line 130, in __exit__
self.gen.throw(type, value, traceback)
File "/opt/conda/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 443, in _error_catcher
raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.
The command '/bin/sh -c pip install -r /tmp/requirements.txt' returned a non-zero code: 2
I found some relevant errors for pymarl by installing setuptools==65.5.0, but it didn't help in this case.
refernce
And in appo, torch==1.8.1 seems to be unfound:
Collecting torch==1.8.1
Downloading torch-1.8.1-cp37-cp37m-manylinux1_x86_64.whl (804.1 MB)
Hello, I ran your code and displayed the results on the terminal and wandb. How can I visualize the environment? I would appreciate it if you could answer.
When I run 32X32 and 64X64, the program is killed by the system. I don't know if you have such a question?
it seems that fails due to gym python requirement.
Here the log:
[4/4] RUN pip install -r /tmp/requirements.txt:
0.814 Collecting gym==0.21.0 (from -r /tmp/requirements.txt (line 1))
1.040 Downloading gym-0.21.0.tar.gz (1.5 MB)
1.393 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 4.4 MB/s eta 0:00:00
1.459 Preparing metadata (setup.py): started
1.591 Preparing metadata (setup.py): finished with status 'error'
1.596 error: subprocess-exited-with-error
1.596
1.596 × python setup.py egg_info did not run successfully.
1.596 │ exit code: 1
1.596 ╰─> [1 lines of output]
1.596 error in gym setup command: 'extras_require' must be a dictionary whose values are strings or lists of strings containing valid project/version requirement specifiers.
1.596 [end of output]
1.596
1.596 note: This error originates from a subprocess, and is likely not a problem with pip.
1.598 error: metadata-generation-failed
1.598
1.598 × Encountered error while generating package metadata.
1.598 ╰─> See above for output.
1.598
1.598 note: This is an issue with the package mentioned above, not pip.
1.598 hint: See above for details.
ERROR: failed to solve: process "/bin/sh -c pip install -r /tmp/requirements.txt" did not complete successfully: exit code: 1
Hello,I want to run your code .Can you tell me the step?Thanks.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.