Giter Site home page Giter Site logo

mttgdd / robotcardataset-scraper Goto Github PK

View Code? Open in Web Editor NEW
47.0 3.0 23.0 48 KB

Downloads files matching patterns from the Oxford Robotcar Dataset website

License: Other

Python 98.11% Dockerfile 1.89%
robotics vision learning datasets website python laser lidar gps stereo

robotcardataset-scraper's Introduction

Introduction

This script can be used to perform sequenced downloads of various sensors logs for the robotcar-dataset https://robotcar-dataset.robots.ox.ac.uk/.

The code is tested for Python3 on Ubuntu 16.04.

Getting started

A prebuilt docker image is available with:

docker pull matthewgadd/robotcar-dataset-scraper:latest

Otherwise, you can build the docker image from scratch:

wget https://raw.githubusercontent.com/matthewgadd/RobotCarDataset-Scraper/master/Dockerfile
docker build -t matthewgadd/robotcar-dataset-scraper:latest .

Example usage

Mount your downloads dir through the docker image:

docker run --rm -it -w /RobotCarDataset-Scraper -v $HOME/Downloads:/Downloads matthewgadd/robotcar-dataset-scraper:latest

The script

python get_datasets.py

parses the html for the complete dataset listing and scrapes each dataset page and retrieves the available files (tar) for download. With the example output file datasets.csv provided, you should then run:

python scrape_mrgdatashare.py --downloads_dir /Downloads --datasets_file datasets.csv --username USERNAME --password PASSWORD

If you do not need the full dataset, you can use --choice_sensors and --choice_runs_file options to download parts of the dataset on your own needs.

  • --choice_sensors option can receive multiple sensor names in tags, stereo_centre, stereo_left, stereo_right, vo, mono_left, mono_right, mono_rear, lms_front, lms_rear, ldmrs, gps, all.
  • --choice_runs_file option receive a .txt file that contains the names of runs you want to download, we provide an example filea sample file example_list.txt .

for example you can download "stereo_centre", "vo" and "lms_front" data of "2014-05-19-13-20-57" and "2014-06-26-09-31-18" by the following command:

python scrape_mrgdatashare.py --choice_sensors stereo_centre,vo,lms_front --choice_runs_file example_list.txt --downloads_dir /Downloads --datasets_file datasets.csv --username USERNAME --password PASSWORD

robotcardataset-scraper's People

Contributors

f-barto avatar master-cai avatar mttgdd avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

robotcardataset-scraper's Issues

HTML in tar file

Hello,

Thank you for the recent improvements on the script, it is much more straight forward to use and the tqdm is very much appreciated.

I've run the script with the following command:
python scrape_mrgdatashare.py --downloads_dir download_dir --datasets_file datasets.csv --username ****** --password *******

with datasets.csv:

2014-05-06-12-54-54,tags,vo,gps
2014-05-06-13-09-52,tags,vo,gps
2014-05-06-13-14-58,tags,vo,gps
2014-05-06-13-17-51,tags,vo,gps
2014-05-14-13-46-12,tags,vo,gps
2014-05-14-13-50-20,tags,vo,gps
2014-05-14-13-53-47,tags,vo,gps
2014-05-14-13-59-05,tags,vo,gps
2014-05-19-12-51-39,tags,vo,gps
2014-05-19-13-05-38,tags,vo,gps
2014-05-19-13-20-57,tags,vo,gps
2014-06-23-15-14-44,tags,vo,gps
2014-11-21-16-07-03,tags,vo,gps
2014-12-16-09-14-09,tags,vo,gps
2014-12-17-18-18-43,tags,vo,gps
2015-02-03-08-45-10,tags,vo,gps
2015-02-03-19-43-11,tags,vo,gps
2015-02-27-18-09-02,tags,vo
2015-08-14-14-54-57,tags,vo,gps

The first three sequences are effectively downloaded and extracted. However, the remaining sequences raise an error such as failed when unzipping local_file_path: download_dir/2014-05-14-13-46-12_vo.tar.

So I commented the clearing of the tar and when I cat the tar file it prints the following, which seems to be the login page. The throttle is at the default value and I've tried to reduce the chunks_per_period to 500 but the issue remained.
(Please find the console output after this)

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
    <head>
        <title>RobotCar Dataset Downloads |
        Login</title>
        <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.0/jquery.min.js"></script>

        <link rel="stylesheet" type="text/css" href="//cdn.datatables.net/1.10.12/css/jquery.dataTables.css">
        <link rel="stylesheet" href="/static/styles.css" type="text/css">
        <meta name="viewport" content="width=device-width, initial-scale=1">
        <script src="https://ajax.googleapis.com/ajax/libs/webfont/1.5.18/webfont.js"></script>
        <script>
            WebFont.load({
                google: {
                    families: [ 'Lato:400,700,400italic:latin', 'Volkhov::latin' ]
                }
            });
        </script>
        <script type="text/javascript" charset="utf8" src="//cdn.datatables.net/1.10.12/js/jquery.dataTables.js"></script>

        <noscript>
            <link href='http://fonts.googleapis.com/css?family=Lato:400,700,400italic%7CVolkhov' rel='stylesheet' type='text/css'>
        </noscript>

        <script>
          (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
          (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
          m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
          })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');

          ga('create', 'UA-76346605-1', 'auto');
          ga('send', 'pageview');
        </script>
    </head>
    <body>
        <h1>Login</h1>
        <div id="content">


    <form method="post" action="."><input type='hidden' name='csrfmiddlewaretoken' value='w1UBVEYMOeqz96RaxlQtBeWdBEzrmGVy8gUp6lrsSCkS9vblx2DABX4bn3vl2BKk' />
        <tr><th><label for="id_username">Username:</label></th><td><input autofocus="" id="id_username" maxlength="254" name="username" type="text" required /></td></tr>
<tr><th><label for="id_password">Password:</label></th><td><input id="id_password" name="password" type="password" required /></td></tr>
        <input type="submit" value="Login" />
        <input type="hidden" name="next" value="/download/?filename=datasets/2015-08-14-14-54-57/2015-08-14-14-54-57_gps.tar" />
    </form>
    <a href="/forgotten/password/">Forgotten your password?</a>
    <a href="/register">Register</a>

        </div>
        <div id="footer">
            <a rel="license" href="http://creativecommons.org/licenses/by-nc-sa/4.0"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png" /></a><p>This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-nc-sa/4.0">Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License</a>.</p>
            <h2>Not from an academic institution?</h2>
            <p>You need to have an academic email address to register. For example, ending with .edu or .ac.uk.</p>
            <p>If you are from a non-academic organisation or you are interested in using the Database or the Software commercially,
               please contact Oxford University Innovations Limited to negotiate a licence.
               Contact details are <a href="mailto:[email protected]">[email protected]</a>
               quoting reference PC/14257.
             </p>
        </div>
    </body>
</html>
python scrape_mrgdatashare.py --downloads_dir /mnt/c/Users/fbartocc/Documents/test_oxford --datasets_file datasets.csv --username ****** --password *******
ScrapeMRGDatashare is starting...
reading datasets_file: /mnt/c/Users/fbartocc/Documents/dev_local/RobotCarDataset-Scraper/datasets.csv
got num_datasets: 19
got csrf_middleware_token: OzZQa6mcnNHWPTYfZruK8ZrWVPnoFxX3yj9jaBp6W9KEbXTlGP7Sj1B5ZnDxuDXA
Logged in!
num_chunks_in_period: 0, period_seconds: 600
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-12-54-54/2014-05-06-12-54-54_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-12-54-54_tags.tar
100%|███████████████████████████████████████████████████████████████████████████████| 10.0/10.0 [00:00<00:00, 14.6kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-12-54-54_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-12-54-54/2014-05-06-12-54-54_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-12-54-54_vo.tar
100%|█████████████████████████████████████████████████████████████████████████████████| 440/440 [00:00<00:00, 4.20kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-12-54-54_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-12-54-54/2014-05-06-12-54-54_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-12-54-54_gps.tar
100%|█████████████████████████████████████████████████████████████████████████████| 1.98k/1.98k [00:00<00:00, 4.55kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-12-54-54_gps.tar
tidying up dataset: 2014-05-06-12-54-54
num_chunks_in_period: 2430, period_seconds: 599
pausing for throttle for period_seconds: 599...
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-09-52/2014-05-06-13-09-52_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-09-52_tags.tar
100%|███████████████████████████████████████████████████████████████████████████████| 10.0/10.0 [00:00<00:00, 15.6kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-09-52_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-09-52/2014-05-06-13-09-52_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-09-52_vo.tar
100%|█████████████████████████████████████████████████████████████████████████████████| 430/430 [00:00<00:00, 3.25kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-09-52_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-09-52/2014-05-06-13-09-52_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-09-52_gps.tar
100%|█████████████████████████████████████████████████████████████████████████████| 1.94k/1.94k [00:00<00:00, 4.54kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-09-52_gps.tar
tidying up dataset: 2014-05-06-13-09-52
num_chunks_in_period: 4810, period_seconds: -1
resetting period throttle...
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-14-58/2014-05-06-13-14-58_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-14-58_tags.tar
100%|███████████████████████████████████████████████████████████████████████████████| 10.0/10.0 [00:00<00:00, 14.5kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-14-58_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-14-58/2014-05-06-13-14-58_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-14-58_vo.tar
100%|█████████████████████████████████████████████████████████████████████████████████| 240/240 [00:00<00:00, 5.28kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-14-58_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-14-58/2014-05-06-13-14-58_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-14-58_gps.tar
100%|█████████████████████████████████████████████████████████████████████████████| 1.04k/1.04k [00:00<00:00, 4.20kKB/s]unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-14-58_gps.tar
tidying up dataset: 2014-05-06-13-14-58
num_chunks_in_period: 1290, period_seconds: 600
pausing for throttle for period_seconds: 600...
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-17-51/2014-05-06-13-17-51_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_tags.tar
2.00KB [00:00, 4.17kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-17-51/2014-05-06-13-17-51_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_vo.tar
2.00KB [00:00, 3.01kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-13-17-51/2014-05-06-13-17-51_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_gps.tar
2.00KB [00:00, 3.32kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-06-13-17-51_gps.tar
tidying up dataset: 2014-05-06-13-17-51
num_chunks_in_period: 1296, period_seconds: -1
resetting period throttle...
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-46-12/2014-05-14-13-46-12_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_tags.tar
2.00KB [00:00, 2.08kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-46-12/2014-05-14-13-46-12_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_vo.tar
2.00KB [00:00, 4.30kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-46-12/2014-05-14-13-46-12_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_gps.tar
2.00KB [00:00, 4.26kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-46-12_gps.tar
tidying up dataset: 2014-05-14-13-46-12
num_chunks_in_period: 6, period_seconds: 599
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-50-20/2014-05-14-13-50-20_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_tags.tar
2.00KB [00:00, 3.81kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-50-20/2014-05-14-13-50-20_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_vo.tar
2.00KB [00:00, 3.55kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-50-20/2014-05-14-13-50-20_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_gps.tar
2.00KB [00:00, 3.10kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-50-20_gps.tar
tidying up dataset: 2014-05-14-13-50-20
num_chunks_in_period: 12, period_seconds: 598
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-53-47/2014-05-14-13-53-47_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_tags.tar
2.00KB [00:00, 3.32kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-53-47/2014-05-14-13-53-47_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_vo.tar
2.00KB [00:00, 2.98kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-53-47/2014-05-14-13-53-47_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_gps.tar
2.00KB [00:00, 3.16kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-53-47_gps.tar
tidying up dataset: 2014-05-14-13-53-47
num_chunks_in_period: 18, period_seconds: 597
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-59-05/2014-05-14-13-59-05_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_tags.tar
2.00KB [00:00, 3.81kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-59-05/2014-05-14-13-59-05_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_vo.tar
2.00KB [00:00, 3.94kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-14-13-59-05/2014-05-14-13-59-05_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_gps.tar
2.00KB [00:00, 3.25kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-14-13-59-05_gps.tar
tidying up dataset: 2014-05-14-13-59-05
num_chunks_in_period: 24, period_seconds: 596
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-12-51-39/2014-05-19-12-51-39_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_tags.tar
2.00KB [00:00, 2.88kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-12-51-39/2014-05-19-12-51-39_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_vo.tar
2.00KB [00:00, 2.84kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-12-51-39/2014-05-19-12-51-39_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_gps.tar
2.00KB [00:00, 3.45kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-12-51-39_gps.tar
tidying up dataset: 2014-05-19-12-51-39
num_chunks_in_period: 30, period_seconds: 595
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-13-05-38/2014-05-19-13-05-38_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_tags.tar
2.00KB [00:00, 2.33kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-13-05-38/2014-05-19-13-05-38_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_vo.tar
2.00KB [00:00, 3.13kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-13-05-38/2014-05-19-13-05-38_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_gps.tar
2.00KB [00:00, 2.54kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-05-38_gps.tar
tidying up dataset: 2014-05-19-13-05-38
num_chunks_in_period: 36, period_seconds: 593
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-13-20-57/2014-05-19-13-20-57_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_tags.tar
2.00KB [00:00, 2.73kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-13-20-57/2014-05-19-13-20-57_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_vo.tar
2.00KB [00:00, 4.32kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-19-13-20-57/2014-05-19-13-20-57_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_gps.tar
2.00KB [00:00, 3.98kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-05-19-13-20-57_gps.tar
tidying up dataset: 2014-05-19-13-20-57
num_chunks_in_period: 42, period_seconds: 592
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-06-23-15-14-44/2014-06-23-15-14-44_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_tags.tar
2.00KB [00:00, 3.35kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-06-23-15-14-44/2014-06-23-15-14-44_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_vo.tar
2.00KB [00:00, 3.07kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-06-23-15-14-44/2014-06-23-15-14-44_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_gps.tar
2.00KB [00:00, 3.59kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-06-23-15-14-44_gps.tar
tidying up dataset: 2014-06-23-15-14-44
num_chunks_in_period: 48, period_seconds: 591
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-11-21-16-07-03/2014-11-21-16-07-03_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_tags.tar
2.00KB [00:00, 3.40kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-11-21-16-07-03/2014-11-21-16-07-03_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_vo.tar
2.00KB [00:00, 2.79kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-11-21-16-07-03/2014-11-21-16-07-03_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_gps.tar
2.00KB [00:00, 3.66kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-11-21-16-07-03_gps.tar
tidying up dataset: 2014-11-21-16-07-03
num_chunks_in_period: 54, period_seconds: 590
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-12-16-09-14-09/2014-12-16-09-14-09_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_tags.tar
2.00KB [00:00, 2.41kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-12-16-09-14-09/2014-12-16-09-14-09_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_vo.tar
2.00KB [00:00, 3.87kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-12-16-09-14-09/2014-12-16-09-14-09_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_gps.tar
2.00KB [00:00, 3.78kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-16-09-14-09_gps.tar
tidying up dataset: 2014-12-16-09-14-09
num_chunks_in_period: 60, period_seconds: 589
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-12-17-18-18-43/2014-12-17-18-18-43_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_tags.tar
2.00KB [00:00, 2.90kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-12-17-18-18-43/2014-12-17-18-18-43_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_vo.tar
2.00KB [00:00, 3.50kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-12-17-18-18-43/2014-12-17-18-18-43_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_gps.tar
2.00KB [00:00, 3.21kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2014-12-17-18-18-43_gps.tar
tidying up dataset: 2014-12-17-18-18-43
num_chunks_in_period: 66, period_seconds: 587
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-03-08-45-10/2015-02-03-08-45-10_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_tags.tar
2.00KB [00:00, 3.45kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-03-08-45-10/2015-02-03-08-45-10_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_vo.tar
2.00KB [00:00, 2.50kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-03-08-45-10/2015-02-03-08-45-10_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_gps.tar
2.00KB [00:00, 3.09kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-08-45-10_gps.tar
tidying up dataset: 2015-02-03-08-45-10
num_chunks_in_period: 72, period_seconds: 586
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-03-19-43-11/2015-02-03-19-43-11_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_tags.tar
2.00KB [00:00, 3.17kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-03-19-43-11/2015-02-03-19-43-11_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_vo.tar
2.00KB [00:00, 3.92kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-03-19-43-11/2015-02-03-19-43-11_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_gps.tar
2.00KB [00:00, 3.02kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-03-19-43-11_gps.tar
tidying up dataset: 2015-02-03-19-43-11
num_chunks_in_period: 78, period_seconds: 585
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-27-18-09-02/2015-02-27-18-09-02_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-27-18-09-02_tags.tar
2.00KB [00:00, 3.13kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-27-18-09-02_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-27-18-09-02_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-02-27-18-09-02/2015-02-27-18-09-02_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-27-18-09-02_vo.tar
2.00KB [00:00, 3.53kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-27-18-09-02_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-02-27-18-09-02_vo.tar
tidying up dataset: 2015-02-27-18-09-02
num_chunks_in_period: 82, period_seconds: 584
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-08-14-14-54-57/2015-08-14-14-54-57_tags.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_tags.tar
2.00KB [00:00, 3.72kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_tags.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_tags.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-08-14-14-54-57/2015-08-14-14-54-57_vo.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_vo.tar
2.00KB [00:00, 2.57kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_vo.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_vo.tar
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2015-08-14-14-54-57/2015-08-14-14-54-57_gps.tar
downloading local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_gps.tar
2.00KB [00:00, 4.96kKB/s]
unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_gps.tar
failed when unzipping local_file_path: /mnt/c/Users/fbartocc/Documents/test_oxford/2015-08-14-14-54-57_gps.tar
tidying up dataset: 2015-08-14-14-54-57
ScrapeMRGDatashare is finished!

Python3 bytes literals

Hello,
First I would like to thank you for your work on this dataset.

When just doing a git clone and running the provided command with my username and password I get the following error:

ScrapeMRGDatashare is starting...
got num_datasets: 1
got num_file_patterns: 1
got csrf_middleware_token: 8fAsEHXhYm3FOIS9zWZo9RnptirdfVGFfVGvpCMERgoB1CxZQTwhCAHZ9LaVBVrT
got status_code: 200
Logged in!
num_chunks_in_period: 0, period_seconds: 600
creating dataset: 2014-05-06-12-54-54
requesting file_url: http://mrgdatashare.robots.ox.ac.uk:80/download/?filename=datasets/2014-05-06-12-54-54/2014-05-06-12-54-54_vo.tar
got status_code: 200
downloading local_file_path: /mnt/c/Users/fbartocc/Downloads/2014-05-06-12-54-54/2014-05-06-12-54-54_vo.tar
Traceback (most recent call last):
  File "scrape_mrgdatashare.py", line 990, in <module>
    file_was_found = scraper.scrape(url_handler)
  File "scrape_mrgdatashare.py", line 454, in scrape
    if "File not found." in chunk:
TypeError: a bytes-like object is required, not 'str'

Correct me if I am wrong, but just changing "File not found." to b"File not found." would do the trick.

Originally posted by @F-Barto in #1 (comment)

Program doesn't download

Usually the program just skips everything and nothing is downloaded. Sometimes, if I'm lucky, one of many files is downloaded.
I simply call the program with python with a custom datasets.txt-file (every dataset) and file_patterns.txt (stereo_centre_01 to stereo_centre_20, gps).

Thanks for help.

Problem of downlod Robocar dataset

Hi,
Thanks for your work that performs an automatic download of all datasets. But when I run the code as below:
python scrape_mrgdatashare.py --downloads_dir /Downloads --datasets_file datasets.csv --username USERNAME --password PASSWORD
Then the code is always stuck in here as below:
WechatIMG161
Could you help me to solve this issue? Thanks.

Build the docker Error

Hello,

Thank you for the recent improvements on the script,
When I download the dataset,when i run # docker build -t robotcar-dataset-scraper .
I get this problem,I do not know how to solve it
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial/InRelease Temporary failure resolving 'archive.ubuntu.com'
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial-updates/InRelease Temporary failure resolving 'archive.ubuntu.com'
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial-backports/InRelease Temporary failure resolving 'archive.ubuntu.com'
W: Failed to fetch http://security.ubuntu.com/ubuntu/dists/xenial-security/InRelease Temporary failure resolving 'security.ubuntu.com'
W: Some index files failed to download. They have been ignored, or old ones used instead.
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package software-properties-common
The command '/bin/sh -c apt-get -y update && apt-get install -y software-properties-common && apt-get -y update && apt-get install -y git python-pip python3-pip' returned a non-zero code: 100

Username and Password ?

Hello,

Thanks for your work!

I was wondering why do we need to pass username and password?
also which credentials are you referring to ? local to system ?

Syntax Error

Hi, I wonder when I run the get_dataset.py, I got the following issue like the following,

root@de6775a680b2:/RobotCarDataset-Scraper# python3 get_datasets.py
Traceback (most recent call last):
File "get_datasets.py", line 15, in
from scrape_mrgdatashare import datasets_url
File "/RobotCarDataset-Scraper/scrape_mrgdatashare.py", line 272
print(f"Got html file as result. Wait {self.reloging_duration} seconds and re-loging...")

Could you please check it again? Thank you!

Can't Download Dataset

Hi, I tried using this scrape_mrgdatashare.py to download data as shown in the README, however, it kept failing.

The command that I used
python scrape_mrgdatashare.py --choice_sensors stereo_centre,vo --choice_runs_file example_list.txt --downloads_dir /Downloads --datasets_file datasets.csv --username <my-username> --password <my-password>

My example_list.txt

2014-12-17-18-18-43

The error message

requests.exceptions.ConnectionError: HTTPSConnectionPool(host='mrgdatashare.robots.ox.ac.uk', port=443): 
Max retries exceeded with url: / 
(Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fae0c22b470>: 
Failed to establish a new connection: [Errno 113] No route to host',))

It looked like a network error so I tried to download the GPS data from sequence 2015-02-03-19-43-11 from the website directly, using the link below:
https://mrgdatashare.robots.ox.ac.uk/download/?filename=datasets/2015-02-03-19-43-11/2015-02-03-19-43-11_gps.tar
but the address was unreachable.

Can you please help? Thanks!

image
image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.