fredriknk/ffr_analysis

FFR Analysis Program

Written by Lars Molstad

The FFR analysis program is a python based interpreter for files generated by the Field Flux Robot.

The program is structured in the following way:

ffr_analysis
│   README.md   
|   metno_client_id.txt
└───Prog  #DO NOT CHANGE
│      
└───example_data  #example data for testing of regression functions without actual FFR data
|   │   file021.txt
|
└───Users #Individual folders for each use case of the program 
    |
    └───LarsM
    |
    └───...
    |
    └───Fredrik
        |   config.yml
        |   specific_options.pickle
    

Where each user folder will represent a specific field or method for analysing data.

If downloading the FFR analysis program for the first time, a few things have to be done before you can run the program.

1. Download the Anaconda package with spyder IDE
2. Clone the ffr_analysis repo
3. Create a file with a config.yml file with the paths to your data folders The yml config file should have a structure like this:

PATHS:
    RAWDATA: C:\path\to\rawdata\folder\
    MANUAL: C:\path\to\manual\measurements\file.xlsx
    LOGGER_PATH: C:\path\to\combined\logger\file.xlsx

4. Create a user at met.no and put the client id in a file named: metno_client_id.txt in the ffr_analysis top folder

ffr_analysis's Issues

Soilmoisture Data import

Request: make it easier to see 0 degrees in the Cumsum plot

It could be with just a simple black line or by making all value above 0 red and all below blue (or something else)

Persistant settings in filter selection

Request: A function or checkbox to show something is wrong with the measurement

Additionally it would be nice to be able to exclude a measuremetn if it is very wrong (so two checkboxes)

Suggestion: The different plotting functions should have names

Capture_Analysis.bat vil ikke kjøre

C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts>cd "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\Users\Capture"

C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\Users\Capture>call C:\NMBU\Miniconda3\python.exe "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\Users\Capture\field_experiment.py"
2024-03-20 17:07:14,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): frost.met.no:443
2024-03-20 17:07:28,824 - urllib3.connectionpool - DEBUG - https://frost.met.no:443 "GET /observations/v0.jsonld?sources=SN17850&elements=air_temperature%2C+max%28air_temperature+PT1H%29%2C+min%28air_temperature+PT1H%29%2C+sum%28precipitation_amount+PT1H%29&referencetime=2024-03-19%2F2024-03-20 HTTP/1.1" 500 795
Didn't retrieve data from frost.met.no.
2024-03-20 17:07:28,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): frost.met.no:443
2024-03-20 17:07:43,545 - urllib3.connectionpool - DEBUG - https://frost.met.no:443 "GET /observations/v0.jsonld?sources=SN17850&elements=air_temperature%2C+max%28air_temperature+PT1H%29%2C+min%28air_temperature+PT1H%29%2C+sum%28precipitation_amount+PT1H%29&referencetime=2015-01-01%2F2015-01-31 HTTP/1.1" 500 795
Didn't retrieve data from frost.met.no.
Traceback (most recent call last):
File "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\Users\Capture\field_experiment.py", line 81, in
update_weather_data()
File "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\prog\weather_data_from_metno.py", line 137, in update_weather_data
new_data = get_ty(time.localtime(last_date - 86400), stop)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\prog\weather_data_from_metno.py", line 112, in get_ty
ty = remove_duplicates(ty + new_data)
~~~^~~~~~~~~~
TypeError: can only concatenate list (not "NoneType") to list

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\Users\Capture\field_experiment.py", line 83, in
make_data_file()
File "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\prog\weather_data_from_metno.py", line 121, in make_data_file
ty = get_ty(start, stop)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\prog\weather_data_from_metno.py", line 112, in get_ty
ty = remove_duplicates(ty + new_data)
~~~^~~~~~~~~~
TypeError: can only concatenate list (not "NoneType") to list

C:\Users\sigridk\OneDrive - Norwegian University of Life Sciences\Documents\Python Scripts\ffr_analysis\Users\Capture>pause
Press any key to continue . . .