johnnay/forecastveg

A Machine Learning Approach to Forecasting Remotely Sensed Vegetation Health in Python

forecastveg's Issues

"Cannot download MOD09A1..."

python -u 0_matrix_construction.py 1 data/test ###### #####  'h27v07' 2014-01-30 2014-01-01 data/test/ModisTest2.tif

Receives this error message in the log:

2016-09-27 08:33:39,703 - INFO - Starting new HTTP connection (1): e4ftl01.cr.usgs.gov
2016-09-27 08:33:40,825 - DEBUG - Setting read timeout to 30
2016-09-27 08:33:41,111 - DEBUG - "GET /MOLT/MOD09A1.005 HTTP/1.1" 301 252
2016-09-27 08:33:41,113 - DEBUG - Setting read timeout to 30
2016-09-27 08:33:41,679 - DEBUG - "GET /MOLT/MOD09A1.005/ HTTP/1.1" 200 None
2016-09-27 08:33:42,577 - DEBUG - The number of days to download is: 4
2016-09-27 08:33:42,578 - DEBUG - The url is: http://e4ftl01.cr.usgs.gov/MOLT/MOD09A1.005/2014.01.25
2016-09-27 08:33:42,578 - INFO - Starting new HTTP connection (1): e4ftl01.cr.usgs.gov
2016-09-27 08:33:43,250 - DEBUG - Setting read timeout to 30
2016-09-27 08:33:43,535 - DEBUG - "GET /MOLT/MOD09A1.005/2014.01.25 HTTP/1.1" 301 263
2016-09-27 08:33:43,536 - DEBUG - Setting read timeout to 30
2016-09-27 08:33:47,255 - DEBUG - "GET /MOLT/MOD09A1.005/2014.01.25/ HTTP/1.1" 200 None
2016-09-27 08:33:48,434 - DEBUG - The number of file to download is: 2
2016-09-27 08:33:49,272 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:33:55,339 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:01,181 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:06,800 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:12,405 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:18,477 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:24,533 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:30,147 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:35,754 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:41,364 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:47,138 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:52,744 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...
2016-09-27 08:34:58,355 - ERROR - Cannot download MOD09A1.A2014025.h27v07.005.2014038222848.hdf. Retrying...

However, I can see and download this hdf here, so I don't think it's a login issue (I've tried with both an institutional account and personal; both work):

http://e4ftl01.cr.usgs.gov/MOLT/MOD09A1.005/2014.01.25/

I get the same error when setting "spectral" to "0":

2016-09-27 08:53:10,474 - INFO - Starting new HTTP connection (1): e4ftl01.cr.usgs.gov
2016-09-27 08:53:10,815 - DEBUG - Setting read timeout to 30
2016-09-27 08:53:11,101 - DEBUG - "GET /MOLT/MOD11A2.005 HTTP/1.1" 301 252
2016-09-27 08:53:11,103 - DEBUG - Setting read timeout to 30
2016-09-27 08:53:11,620 - DEBUG - "GET /MOLT/MOD11A2.005/ HTTP/1.1" 200 None
2016-09-27 08:53:12,521 - DEBUG - The number of days to download is: 4
2016-09-27 08:53:12,521 - DEBUG - The url is: http://e4ftl01.cr.usgs.gov/MOLT/MOD11A2.005/2014.01.25
2016-09-27 08:53:12,522 - INFO - Starting new HTTP connection (1): e4ftl01.cr.usgs.gov
2016-09-27 08:53:12,845 - DEBUG - Setting read timeout to 30
2016-09-27 08:53:13,135 - DEBUG - "GET /MOLT/MOD11A2.005/2014.01.25 HTTP/1.1" 301 263
2016-09-27 08:53:13,135 - DEBUG - Setting read timeout to 30
2016-09-27 08:53:18,553 - DEBUG - "GET /MOLT/MOD11A2.005/2014.01.25/ HTTP/1.1" 200 None
2016-09-27 08:53:20,098 - DEBUG - The number of file to download is: 2
2016-09-27 08:53:20,753 - ERROR - Cannot download MOD11A2.A2014025.h27v07.005.2014038224438.hdf.xml. Retrying...
2016-09-27 08:53:26,597 - ERROR - Cannot download MOD11A2.A2014025.h27v07.005.2014038224438.hdf.xml. Retrying...
2016-09-27 08:53:32,205 - ERROR - Cannot download MOD11A2.A2014025.h27v07.005.2014038224438.hdf.xml. Retrying...
2016-09-27 08:53:38,038 - ERROR - Cannot download MOD11A2.A2014025.h27v07.005.2014038224438.hdf.xml. Retrying...
2016-09-27 08:53:43,671 - ERROR - Cannot download MOD11A2.A2014025.h27v07.005.2014038224438.hdf.xml. Retrying...
2016-09-27 08:53:49,285 - ERROR - Cannot download MOD11A2.A2014025.h27v07.005.2014038224438.hdf.xml. Retrying...

The "listfile... .txt "s are empty.

Am I doing something wrong? For the .tif I just used Earth Engine to download a rectangle of modis imagery from eastern Thailand -- within the h27v07 tile. It's 500m, sinusoidal, and a single layer (NDVI).

Thanks!
Adam