MNIST datset can't be download by the code!

[fedml-ai]

MNIST datset can't be download by the code!

[RaymondTseng]

Hi @seanmcneely
You can try the following commands.

rm MNIST.zip
rm -rf mnist
wget --no-check-certificate -r "https://drive.google.com/uc?export=download&id=1cU_LcBAUZvfZWveOMhG4G5Fg9uFXhVdf" -O MNIST.zip
unzip MNIST.zip
rm MNIST.zip

[chaoyanghe]

I checked the downloading in US, it works well. Is it because you cannot access to Google Drive? If not, I guess if it is blocked by GFW. If this is the case, let me put another download link for users in China mainland.

[weiyikang]

I can access to the Google Drive, and can download the cifar-10 by the code, while the MNIST is not available by the code.

[chaoyanghe]

@weiyikang please pull the latest code, all datasets can be downloaded by script.

[weiyikang]

In the latest code, the error also occurs. But I can download the mnist.zip manually by the link in download_and_unzip.sh, then unzip the mnist.zip. The error using 'sh download_and_unzip.sh' as follow:

By manually download mnist.zip and unzip by the guide of download_and_unzip.sh, all going well.

[chaoyanghe]

your log shows "Network is unreachable"

[weiyikang]

The reason is that computer without vpn can't access the google drive. Baidu yun can be accessed in china instead of google drive.

[chaoyanghe]

@weiyikang so please help to create a baidu yun link and a downloading script for our users. Thanks.

[sedonalewis]

I am having this issue as well from within the US. Could the zip be corrupt? It downloads fine but cannot be unzipped

[chaoyanghe]

@seanmcneely did you download from MAC?

[sedonalewis]

I used the download and unzip script for MNIST:

wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet
--save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1cU_LcBAUZvfZWveOMhG4G5Fg9uFXhVdf' -O-
| sed -rn 's/.confirm=([0-9A-Za-z_]+)./\1\n/p')&id=1cU_LcBAUZvfZWveOMhG4G5Fg9uFXhVdf" -O MNIST.zip && rm -rf /tmp/cookies.txt

[sedonalewis]

This works! No problems unzipping now.