kleok/insar4sm

Interferometric Synthetic Aperture Radar for Soil Moisture

insar4sm's Issues

ERA5-land file and sand_soilgrids, clay_soilgrids

Dear kleok,

I was trying to test your software and I stumbled into a few problems.

I was trying to understand what products are required to download for the ERA5-land product. Here are a few questions.

• There are 2 products, hourly data and monthly averaged data. Which one should I select?

• Also which variables should I attach to download?

• My dataset consists of data from 2020-2023, the hourly data only allows me to download one year-one month data. Is there another way to download the data all together, if that's the data that is needed. Also what time should I put, should I put all of them?

• If the product is the monthly averaged, which variables and parameters should I select?

• I know that there is a limitation to how much data can be downloaded, is there another way to merge the data if needed?

• In regards to the sand_soilgrids and clay_soilgrids downloaded from https://soilgrids.org/ what depth do I need to download?

Thank you in advance.

I hope you can assist me in your software.

A.P.

Slow or too much data?

Hi @kleok,

I am running your soil moisture code on a ISCE TopsStack. The soil inversion is taking a very long time however (after 1 day it is at 35% and 7-8 day completion).
The tops stack is about 750 GB in size, and my AOI is roughly 4-5 times larger than your example image of the ford dry lake, over a period of about 14 months of Sentinel-1 data.
(I previously ran it on a small 2km x 2km sample and it worked)

I am running it on a medium sized cluster (64 cores, 128 GB RAM).
It seems to be using all the cores, but they are only at 30-40% capacity.
It is only using about 1/3 of the available RAM.

Do you know what the bottleneck in the code would be? Read/write speeds?
If it is not # cores, RAM, or IO speeds, then it is possibly the code somewhere?
It would be great if I could achieve some sort of speedup. If you could point me in the right direction that would be great.

INSAR4SM_point.py and ISMN data

Dear kleok,

1. Regarding ISMN data download, the csv data I downloaded did not have the 'Datetime' column, resulting in an error in the program:

• INSAR4SM_point.py", line 162, in
  IMSN_df.index = pd.to_datetime(IMSN_df['Datetime'])
  KeyError: 'Datetime'

  How to download ISMN data correctly?

2. Whether the geometry data of SM_polygons.geojson in the SM file obtained by running INSAR4SM_app.py is extracted and stored in the IMSN_polygon variable?

Thank you for your kind consideration.Looking forward to your reply!
Best wish!
Aihui

How can I get a result like Figure 3 in your article?

Hello,

When I run INSAR4SM completely, I get a shp file, but it stores data in the form of points. How should I convert it to the result like Figure 3 in your paper？

Kind regards,
Zhiwei Song

AttributeError: 'NoneType' object has no attribute 'strftime'

Hi all,

I get this error when I run the command of INSAR4SM_app.py

$ INSAR4SM_app.py number of SLCs discovered: 23 creating directory: /INSAR4SM_estimations_test/INSAR4SM_estimations_test/INSAR4SM_datasets/slcs write vrt file for each SLC ... creating stack directory: /INSAR4SM_estimations_test/INSAR4SM_estimations_test/INSAR4SM_datasets/coreg_stack write vrt file for stack directory creating geometry directory: /INSAR4SM_estimations_test/INSAR4SM_estimations_test/INSAR4SM_datasets/geometry write vrt file for geometry dataset Traceback (most recent call last): File "~/software/InSAR4SM/INSAR4SM_app.py", line 95, in <module> stack.get_dry_SARs() File "~/software/InSAR4SM/insar4sm/classes.py", line 107, in get_dry_SARs self.dry_date_sel, self.dry_dates, self.meteo_sel_df = find_dry_SARs(self.meteo_df, File "~/software/InSAR4SM/insar4sm/meteo_funcs.py", line 50, in find_dry_SARs dry_date_str = dry_datetime.strftime('%Y%m%d') AttributeError: 'NoneType' object has no attribute 'strftime'

Any advice is appreciated!
Thanks,
Yang, Song