Giter Site home page Giter Site logo

kleok / insar4sm Goto Github PK

View Code? Open in Web Editor NEW
40.0 40.0 9.0 51.7 MB

Interferometric Synthetic Aperture Radar for Soil Moisture

Home Page: https://insar4sm.readthedocs.io/en/latest/

License: Other

Python 100.00%
coherence insar interferometry sar sentinel-1 soil-moisture

insar4sm's Issues

AttributeError: 'NoneType' object has no attribute 'strftime'

Hi all,

I get this error when I run the command of INSAR4SM_app.py

$ INSAR4SM_app.py number of SLCs discovered: 23 creating directory: /INSAR4SM_estimations_test/INSAR4SM_estimations_test/INSAR4SM_datasets/slcs write vrt file for each SLC ... creating stack directory: /INSAR4SM_estimations_test/INSAR4SM_estimations_test/INSAR4SM_datasets/coreg_stack write vrt file for stack directory creating geometry directory: /INSAR4SM_estimations_test/INSAR4SM_estimations_test/INSAR4SM_datasets/geometry write vrt file for geometry dataset Traceback (most recent call last): File "~/software/InSAR4SM/INSAR4SM_app.py", line 95, in <module> stack.get_dry_SARs() File "~/software/InSAR4SM/insar4sm/classes.py", line 107, in get_dry_SARs self.dry_date_sel, self.dry_dates, self.meteo_sel_df = find_dry_SARs(self.meteo_df, File "~/software/InSAR4SM/insar4sm/meteo_funcs.py", line 50, in find_dry_SARs dry_date_str = dry_datetime.strftime('%Y%m%d') AttributeError: 'NoneType' object has no attribute 'strftime'

Any advice is appreciated!
Thanks,
Yang, Song

Slow or too much data?

Hi @kleok,

I am running your soil moisture code on a ISCE TopsStack. The soil inversion is taking a very long time however (after 1 day it is at 35% and 7-8 day completion).
The tops stack is about 750 GB in size, and my AOI is roughly 4-5 times larger than your example image of the ford dry lake, over a period of about 14 months of Sentinel-1 data.
(I previously ran it on a small 2km x 2km sample and it worked)

I am running it on a medium sized cluster (64 cores, 128 GB RAM).
It seems to be using all the cores, but they are only at 30-40% capacity.
It is only using about 1/3 of the available RAM.

Do you know what the bottleneck in the code would be? Read/write speeds?
If it is not # cores, RAM, or IO speeds, then it is possibly the code somewhere?
It would be great if I could achieve some sort of speedup. If you could point me in the right direction that would be great.

ERA5-land file and sand_soilgrids, clay_soilgrids

Dear kleok,

I was trying to test your software and I stumbled into a few problems.

I was trying to understand what products are required to download for the ERA5-land product. Here are a few questions.

  • There are 2 products, hourly data and monthly averaged data. Which one should I select?

  • Also which variables should I attach to download?

  • My dataset consists of data from 2020-2023, the hourly data only allows me to download one year-one month data. Is there another way to download the data all together, if that's the data that is needed. Also what time should I put, should I put all of them?

  • If the product is the monthly averaged, which variables and parameters should I select?

  • I know that there is a limitation to how much data can be downloaded, is there another way to merge the data if needed?

  • In regards to the sand_soilgrids and clay_soilgrids downloaded from https://soilgrids.org/ what depth do I need to download?

Thank you in advance.

I hope you can assist me in your software.

A.P.

INSAR4SM_point.py and ISMN data

Dear kleok,

  1. Regarding ISMN data download, the csv data I downloaded did not have the 'Datetime' column, resulting in an error in the program:
  • INSAR4SM_point.py", line 162, in
    IMSN_df.index = pd.to_datetime(IMSN_df['Datetime'])
    KeyError: 'Datetime'

    How to download ISMN data correctly?

  1. Whether the geometry data of SM_polygons.geojson in the SM file obtained by running INSAR4SM_app.py is extracted and stored in the IMSN_polygon variable?

Thank you for your kind consideration.Looking forward to your reply!
Best wish!
Aihui

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.