laccore/data-aggregator-and-renamer

A collection of scripts and GUI front-end that takes machine output files and combines, assigns names, and exports data.

data-aggregator-and-renamer's Issues

Create GUI

Create a GUI, offering choice between aggregating whole-core, split-core, and xrf data.

Eventually the functionality of https://github.com/skydeo/csdco-coreid-assigner should be brought into this software.

XYZ can easily break with different columns

Need to come up with a much better system for importing and aggregating data. currently will break if it sees a file without the exact columns it expects

Better handle empty columns when exporting XRF data by SiteHole

Add filter values

Some way to specify values in specific columns that should be ignored (e.g., ~>= -300 MS)

ignore

Create Pyinstaller files for building

Optionally export XRF data by sitehole

I already have a script that opens an Excel file and splits and exports by hole, so it should just require a bit of tweaking and adding an option flag to the script and GUI

Rename portion: export as Excel

Aggregated MSCL data doesn't include first data row of each input file

This occurs when we drop rows 1 and 2 after initial loading and cleaning. It appears the intention is to drop the units row and single blank row that precedes the first data row, but the units row is actually row 0. There is no need to explicitly drop the blank row, it is removed by the line df = df[~df.eq("").all(1)] # removes empty rows (inconsistent number across files)

Update XRF file searching

Based on example project at XRF\GLAD9\GLAD9-PET06-1

Error in pyinstaller built executable

No such file or directory: 'mscl_units.txt'

Not getting the same error for the associated headers.txt file, and it seems to correctly assign units anyway.

Switch to pandas for renamer

Currently operates using lists, I think there's efficiency and code readability gains to be had by switching to pandas. Also what the aggregation tools use, so consistency would be good.

MSCL-XYZ default naming convention

In the MSCL-XYZ tab, the Data Directory Naming Convention default should be "-part", not "-p".

Create set of demo data

Including

• MSCL
• XYZ
• Core list file

Remember last-used Browse directory

When Browse button is clicked, should return to the last selected Browse directory.