Giter Site home page Giter Site logo

csv2little_r's Introduction

# csv2little_r

DESCRIPTION:
This procedure is designed to convert csv data file format into LITTLE_R
that WRFDA will ingest (http://www2.mmm.ucar.edu/wrf/users/wrfda/).
From WRFDA Tutorial:
'LITTLE_R is an ASCII-based observation file format, in use since the MM5 era. 
Because raw observation data files have many possible formats (such as ASCII, 
BUFR, PREPBUFR, MADIS, and HDF) LITTLE_R is designed to be an intermediate 
format so that WRFDA might be able to assimilate as many observation types as 
possible in a universal manner. It is a report-based file format, so all 
manner of observation types can easily be "cat-ted" together into an 
easy-to-read and -edit text file.'
Input file is supposed to be like this:
Chieti;14.181;42.377;20111025_0630;139
Teramo;13.711;42.656;20111025_0530;207
L_Aquila;13.432;42.339;20111025_0530;180
i.e.
NAME;LON;LAT;YYYYMMDD_hhmm;VARIABLE_VALUE
where variable can be one of the following:
WIND SPEED (SPD)
WIND DIRECTION (DIR)
TEMPERATURE (TMP)
PRESSURE (BAR)
RELATIVE HUMIDITY (IGR)
ZONAL WIND (UWND)
MERIDIONAL WIND (VWND)
THICKNESS (THICK)
where
pressure is in hPa
temperature is in K
wind speed is in m/s
wind direction is in degrees
relative humidity is in %
zonal and meridional wind are in m/s (actually they were not tested)
thickness is in m (actually it was not tested)

SYSTEM REQUIREMENTS:
* Linux system
* /bin/bash
* a Fortran compiler (gfortran worked for me..no other compilers were tested..)

INSTALL:
* tar/unzip the source code
* cd csv2little_r
* you have the following dir/files:
  - configure: - checks for system features and copies files and directories to the working directoy
  - env: contains configuration parameters for the procedure
  - src: contains a Bash procedure and the fortran
* run ./configure /path/to/where/you/want/working/directory

RUN:
* cd env
* edit the 'test.env' file according to your needs (if any). The file has minimal comments, if your are in doubts write me at [email protected]
* cd ../srs
* sh csv2little_r.sh INPUTFILE_with_PATH SPD|DIR|TMP|BAR|IGR|UWND|VWND|THICK
  example:
  sh csv2little_r.sh ../data/sample.file.wind WND
  
TODO:
this is a very first attempt so a lot of stuff to improve the procedure is needed.
Nevertheless the procedure works in most cases.
Feel free to contribute

MAINTAINER(S):
valcap [email protected]

csv2little_r's People

Contributors

valcap avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

csv2little_r's Issues

converting the pressure variable to little_r

Dear Valcap,
I'm using your script from github to add observations in little r format for later use with wrfda, and I particularly use metar reports. When I executed the script for the pressure variable (BAR), I got some error messages in the log file saying : "Note: The following floating-point exceptions are signaling: IEEE_OVERFLOW_FLAG".
The problem is that the script produces the little_r file, but there is no pressure data inside, but rather asterisks. How can I solve this?
Please find attached the csv file, the output and the log files.
bizerte_bar.csv
bizerte_pressure-output.txt
csv2little_r_20211213.log

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.