seungjaeryanlee/playing-hard-exploration-games-by-watching-youtube

[WIP] Playing Hard Exploration Games by Watching YouTube (Aytar et al., 2018)

Playing Hard Exploration Games by Watching YouTube

A PyTorch implementation of Playing Hard Exploration Games by Watching YouTube (Aytar et al., 2018)

Installation

First, install FFMPEG for skvideo.io.

sudo apt-get install ffmpeg

Then, install Python packages using requirements.txt.

pip install -r requirements.txt

Download Video and Audio

To train TDC and CMC, you need videos and audios. Because of their size, they are not included in the repository.

Running get_av.sh should automatically download and extract video and audio to data/. You can also download them from my public Google Drive folder.

Download Pretrained Embedders

I have saved TDC and CMC networks that have been trained with videos above. Because of their size, they are not included in the repository.

Running get_pretrained_models.sh should automatically download saved parameters to saves/. You can also download them from my public Google Drive folder.

playing-hard-exploration-games-by-watching-youtube's Issues

Got runtime error

When I run "retrain-embeddings.py", I got:

RuntimeError: invalid argument 0: Sizes of tensors must match except in dimension 0. Got 12 and 9 in dimension 1 at /Users/soumith/b101_2/2019_02_08/wheel_build_dirs/wheel_3.7/pytorch/aten/src/TH/generic/THTensorMoreMath.cpp:1307

Setup pre-commit

Check this link for setup instructions.