bilelomrani1/s5p-analysis

Example of preliminary analysis and data exploration of Sentinel-5P satellite data

s5p-analysis's Issues

L3 resampling

I can not seem to get the converting into L3 to work. Downloading works greart, but after several tries I still get:

Converting into L3 products

Launched 8 processes
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/home/mye/anaconda3/envs/s5p/lib/python3.7/multiprocessing/pool.py", line 121, in worker
result = (True, func(*args, **kwds))
File "/home/mye/evdc/s5p-tools/s5p_tools/preprocess.py", line 32, in _process_file
operations=pre_commands)
File "/home/mye/anaconda3/envs/s5p/lib/python3.7/site-packages/harp/_harppy.py", line 1187, in import_product
raise CLibraryError()
harp._harppy.CLibraryError: syntax error, unexpected ';', expecting $end
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "s5p-tools/s5p-request.py", line 306, in
num_workers=args.num_workers)
File "s5p-tools/s5p-request.py", line 151, in main
num_workers=num_workers)
File "/home/mye/evdc/s5p-tools/s5p_tools/preprocess.py", line 73, in convert_to_l3_products
desc="Converting", leave=False, total=len(filenames)))
File "/home/mye/anaconda3/envs/s5p/lib/python3.7/site-packages/tqdm/std.py", line 1174, in iter
for obj in iterable:
File "/home/mye/anaconda3/envs/s5p/lib/python3.7/multiprocessing/pool.py", line 748, in next
raise value
harp._harppy.CLibraryError: syntax error, unexpected ';', expecting $end

--shape not an option

in "python s5p-tools/s5p-request.py L2__NO2___ --aoi geojson/france.geojson --shp shp/fr-regions.shp --date 20200601 20200608"
the --shp does not seem to be a valid option.

s5p-compress "some chunks keys are not dimensions on this object"

Hello, apologies for raising a new issue. I have come across an error when attempting the s5p-compress script. I have tried to use every product or band name from the official documentation (https://sentinels.copernicus.eu/web/sentinel/technical-guides/sentinel-5p/level-2/products/main-variables) but the error exists.

Any ideas would be greatly appreciated. Sorry for raising the issue in this repository.

python s5p-tools-master\s5p-compress.py L2_data\S5P_OFFL_L2__O3_____20190503T070549_20190503T084720_08043_01_010107_20190509T084742.nc atmosphere_mole_content_of_ozone

C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rasterio_init_.py:228: NotGeoreferencedWarning: Dataset has no geotransform, gcps, or rpcs. The identity matrix be returned.
s = DatasetReader(path, driver=driver, sharing=sharing, **kwargs)
C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rioxarray_io.py:841: NotGeoreferencedWarning: Dataset has no geotransform, gcps, or rpcs. The identity matrix be returned.
warnings.warn(str(rio_warning.message), type(rio_warning.message))
C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rasterio_init_.py:228: NotGeoreferencedWarning: Dataset has no geotransform, gcps, or rpcs. The identity matrix be returned.
s = DatasetReader(path, driver=driver, sharing=sharing, **kwargs)
C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rioxarray_io.py:841: NotGeoreferencedWarning: Dataset has no geotransform, gcps, or rpcs. The identity matrix be returned.
warnings.warn(str(rio_warning.message), type(rio_warning.message))
Traceback (most recent call last):
File "s5p-tools-master\s5p-compress.py", line 184, in
export_dir=EXPORT_DIR,
File "s5p-tools-master\s5p-compress.py", line 38, in main
DS = rioxarray.open_rasterio(netcdf_file, chunks={"time": chunk_size})
File "C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rioxarray_io.py", line 857, in open_rasterio
**open_kwargs,
File "C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rioxarray_io.py", line 631, in _load_subdatasets
**open_kwargs,
File "C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rioxarray_io.py", line 942, in open_rasterio
result = _prepare_dask(result, riods, filename, chunks)
File "C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\rioxarray_io.py", line 682, in _prepare_dask
return result.chunk(chunks, name_prefix=name_prefix, token=token)
File "C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\xarray\core\dataarray.py", line 1136, in chunk
chunks, name_prefix=name_prefix, token=token, lock=lock
File "C:\Users\shekhar\anaconda3\envs\TropomiDataSet\lib\site-packages\xarray\core\dataset.py", line 2188, in chunk
f"some chunks keys are not dimensions on this object: {bad_dims}"
ValueError: some chunks keys are not dimensions on this object: {'time'}