chi0tzp/yfcc100m-downloader

yfcc100m-downloader's Issues

I see it can just download first 1000 image directory, may it should support more.

I see it can just download first 1000 image directory, may it should support more.

Originally posted by @guanfuchen in #1 (comment)

how can we get metadata from YFCC100M?

I see image and index, but which I can find the metadata containing the file description?

Error while running download_index.py

Hi, when running "download_index.py", there is an error:
0%| | 0/1000 [00:00<?, ?it/s]#.Download image directories...
2%|▏ | 15/1000 [12:04<14:32:49, 53.17s/it]Traceback (most recent call last):
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 1319, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "E:\Anaconda\envs\pytorch\lib\http\client.py", line 1252, in request
self._send_request(method, url, body, headers, encode_chunked)
File "E:\Anaconda\envs\pytorch\lib\http\client.py", line 1298, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "E:\Anaconda\envs\pytorch\lib\http\client.py", line 1247, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "E:\Anaconda\envs\pytorch\lib\http\client.py", line 1026, in _send_output
self.send(msg)
File "E:\Anaconda\envs\pytorch\lib\http\client.py", line 966, in send
self.connect()
File "E:\Anaconda\envs\pytorch\lib\http\client.py", line 1422, in connect
server_hostname=server_hostname)
File "E:\Anaconda\envs\pytorch\lib\ssl.py", line 423, in wrap_socket
session=session
File "E:\Anaconda\envs\pytorch\lib\ssl.py", line 870, in _create
self.do_handshake()
File "E:\Anaconda\envs\pytorch\lib\ssl.py", line 1139, in do_handshake
self._sslobj.do_handshake()
FileNotFoundError: [Errno 2] No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "E:/PycharmProject/YFCC100M-Downloader-master/download_index.py", line 65, in
urllib.request.urlretrieve(root_url + cur_img_dir, cur_img_dir_index)
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 247, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 525, in open
response = self._open(req, data)
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 543, in _open
'_open', req)
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 503, in _call_chain
result = func(*args)
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 1362, in https_open
context=self._context, check_hostname=self._check_hostname)
File "E:\Anaconda\envs\pytorch\lib\urllib\request.py", line 1321, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [Errno 2] No such file or directory>
2%|▏ | 15/1000 [12:09<13:18:21, 48.63s/it]