heikekonow/hamp_processing

Processing for HAMP data sets

hamp_processing

Processing for HAMP data sets

This software processess measurement data from the HALO Microwave Package (HAMP) and additional data (aircraft attitude and location data, dropsonde profiles).

• data is regridded onto a uniform grid
• data is quality checked
• output files are netcdf

hamp_processing's Issues

time correction for radiometer

implement correction for time offsets in different radiometer modules and at different times within one module

Check time synchronicity for radar and radiometers

Include existing code for checks and add values to lookup table

Include bias corrected brightness temperatures

Work with the corrected radiometer data

Use high freq bahamas data

manage outputs

set two different kinds of output: operational and debugging

decide on Doppler velocity

Should it be included?

Implement naming scheme

Set scheme for output file names

height above geoid?

altitude is now based on wgs84 ellipsoid

Do something with 4 Hz radiometer data

possibility: average all four values with the same time stamp to generate 1 Hz resolution

check bahamas for outliers

fill missing radiometer data with missing value

for flights without any radiometer measurements, still keep the structure with (freq, time) and fill all time steps with missing value -888

in file unifyGrid_radiometer

radar_mira processing

Add readme

Add readme information to code

remove radar clutter

remove radiometer data below min alt and during turns

remove radiometer outliers

Look through all radiometer measurements; identify spikes; produce an outlier-free dataset

Time in seconds since 2020-01-01

Change time to seconds since 2020-01-01 to avoid leap seconds

radar noise mask entry

add noise flag to radar data quality mask,
some manual identification is necessary

Use quality controlled dropsonde data

Change code to work with Geet's data set

Create radar data masks

create masks for land/sea, calibration
see run_makeRadarMasks.m

remove radar side lobes

interpolate data gaps

differences in time in radar and bahamas

float inaccuracies at least on 18.2.

Do unification with full seconds instead of sdn

Time unification

• use time in unix time format and round to full seconds for unification to avoid numerical deviations < 1 second
• do this for all instruments (radar, radiometer, dropsondes)

version 0.5 processing

Implement new processing in run script; add config file to determine what to process

Radiometer time correction on unified time

apply the time correction later in the code so that it is applied to the uniTime variable and not the raw time

check time synchronicity for radar and radiometers

clean up code

check radar interpolation method

check interpolation method in regriddFlightAngles (l:26, 36); linear or nearest

remove radar and radiometer errors

Work with recalibrated radar data

wait for recalculated radar moments

set fill value, missing value

missing value in clouds (radar)

The 1 second gaps in the radar every couple of seconds that stem from the regridding of the data onto a uniform 1 s grid should be filled with the fill value ("no measurement", NaN) over the entire profile. They are, however, filled with NaN where a cloud would be and above with -888 which is currently the fill value that indicates "no cloud"

Variable names and attributes

Set meaningful attributes for variables (long_name, units, etc.)

Set variable names

check if folder structure exists

Fix time offset issue between radar and BAHAMAS

there is some time offset between the two systems; on 20200205 the offset was approx. 8 seconds

add interpolation flag