valcap / csv2little_r Goto Github PK
View Code? Open in Web Editor NEWThis procedure is designed to convert csv data file format into LITTLE_R that WRFDA will ingest
This procedure is designed to convert csv data file format into LITTLE_R that WRFDA will ingest
# csv2little_r DESCRIPTION: This procedure is designed to convert csv data file format into LITTLE_R that WRFDA will ingest (http://www2.mmm.ucar.edu/wrf/users/wrfda/). From WRFDA Tutorial: 'LITTLE_R is an ASCII-based observation file format, in use since the MM5 era. Because raw observation data files have many possible formats (such as ASCII, BUFR, PREPBUFR, MADIS, and HDF) LITTLE_R is designed to be an intermediate format so that WRFDA might be able to assimilate as many observation types as possible in a universal manner. It is a report-based file format, so all manner of observation types can easily be "cat-ted" together into an easy-to-read and -edit text file.' Input file is supposed to be like this: Chieti;14.181;42.377;20111025_0630;139 Teramo;13.711;42.656;20111025_0530;207 L_Aquila;13.432;42.339;20111025_0530;180 i.e. NAME;LON;LAT;YYYYMMDD_hhmm;VARIABLE_VALUE where variable can be one of the following: WIND SPEED (SPD) WIND DIRECTION (DIR) TEMPERATURE (TMP) PRESSURE (BAR) RELATIVE HUMIDITY (IGR) ZONAL WIND (UWND) MERIDIONAL WIND (VWND) THICKNESS (THICK) where pressure is in hPa temperature is in K wind speed is in m/s wind direction is in degrees relative humidity is in % zonal and meridional wind are in m/s (actually they were not tested) thickness is in m (actually it was not tested) SYSTEM REQUIREMENTS: * Linux system * /bin/bash * a Fortran compiler (gfortran worked for me..no other compilers were tested..) INSTALL: * tar/unzip the source code * cd csv2little_r * you have the following dir/files: - configure: - checks for system features and copies files and directories to the working directoy - env: contains configuration parameters for the procedure - src: contains a Bash procedure and the fortran * run ./configure /path/to/where/you/want/working/directory RUN: * cd env * edit the 'test.env' file according to your needs (if any). The file has minimal comments, if your are in doubts write me at [email protected] * cd ../srs * sh csv2little_r.sh INPUTFILE_with_PATH SPD|DIR|TMP|BAR|IGR|UWND|VWND|THICK example: sh csv2little_r.sh ../data/sample.file.wind WND TODO: this is a very first attempt so a lot of stuff to improve the procedure is needed. Nevertheless the procedure works in most cases. Feel free to contribute MAINTAINER(S): valcap [email protected]
Dear Valcap,
I'm using your script from github to add observations in little r format for later use with wrfda, and I particularly use metar reports. When I executed the script for the pressure variable (BAR), I got some error messages in the log file saying : "Note: The following floating-point exceptions are signaling: IEEE_OVERFLOW_FLAG".
The problem is that the script produces the little_r file, but there is no pressure data inside, but rather asterisks. How can I solve this?
Please find attached the csv file, the output and the log files.
bizerte_bar.csv
bizerte_pressure-output.txt
csv2little_r_20211213.log
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.