hylasoft-usa/tcdatamigrator

tcdatamigrator's Issues

Home Screen Buttons Load Time

When Clicking a button from the home screen, there is a noticeable delay before the resulting page loads, investigate this issue.

CSV Splt Validation

After CSVs have been written, read them all back in and count the rows vrs the expected.

Browse Buttons

Anywhere files can be specified by path, add a browse button, defaulting to the known CSV location from the default settings.

Save Import Files upon completion

When complete for CSV2TCXML or TCXML_import archive the files used (import.csv,import.csv.log and tcxml_import files) for traceability

Tab Index on Manual Header Input

Set the tab index on form fields in the Manual Header Input page to allow for easier navigation between header inputs

CSV Splitting

Provide an option to "chunk" csv files being created by row count. This will aid in debugging during import operations

Filtered Entries

Move filtered entities to their own folder so that they do not get run as part of the whole import process (assuming splitting is also occurring). Be sure to move this folder and its entire contents during the archival process.

Filter multiple columns

Add the ability to filter entries based on find operations on entire datasets, or on specific columns/column sets more easily. Currently, the only way to do this is to create a compound filter with multiple of the same clause on different columns. (EG if Column A contains | or Column B contains | or ...)

Use 'Temp' folder for imports

For imports, default the path of stored files to the system's 'temp' folder to ensure that files and documents do not clutter the system. The temp folder is much easier to clean and is often deleted at regular intervals.

Form Validations

Add Validations to all forms that require input in all required fields before proceeding is allowable

Oracle Table Prefetch

Provide a mechanism for filtering out system level tables when using an Oracle Datasource.

Exception Handling: File is inaccessible

When attempting to write a CSV file, if the file is opened elsewhere the application crashes. Find a better way to handle this (perhaps print an error and ask the user to close the file and retry)

Oracle Column Names to CSV Headers

Currently, when using an ORACLE datasource, CSV headers are being improperly formatted. This is because ORACLE returns names of columns in all caps, which is not valid for the csv2tcxml tool.

Import time logs

Add the actual time log from the generated log file (siemens) to the application specific log file.

Column Specific Replace

For the replace functionality, add two new options. One for 'Global' replace, allowing for replacements to take place anywhere within the data, and a column specific version that restricts search /replace functions to a single column or list of columns.

Add Entity Type - Oracle

Because of Oracle restrictions, the process of adding a new entity to be migrated can be confusing. Add a function that allows for the addition of new entities to the database without the need to directly interact with the database interface. (PrefixJunction, ColumnToHeader)

Application Status Feedback

When importing TCXML, no feedback is given via the cmd window, thus no feedback is available in the UI application. Find a way to represent (and/or check) that the application is still running. While the application is still running, disable the import button so that multiple imports are not inadvertently started at one time

Multithreading for CSV2TCXML

Investigate the issue in which multiple (100s or 1000s) of messages on the CSV2TCXML thread crash out the UI thread.

Autofilter for Date Rules

Add an automatic filter for date rules. Add the following filters:

• If ReleaseDate is before CreationDate

• If Release Status is not empty and Release Date is empty

Import Validation

Upon Completion of an import, query the TC Database and check if the number of items imported is equal to the number we were supposed to have imported

Auto-replace all special characters

From the CSV2tcxml manual, replace all special characters with their character code equivalents.

Columns Not Loaded on First Run

Columns for the First table in the drop down will not load on the first run of this application, selecting this table causes an unhandled exception.

TCXML_IMPORT Complete feedback

In some instances, when TCXML_IMPORT takes a long time (15+ mins) the application never receives visual feedback that the import has completed.

TCXML Error Logs/Summary

Upon completion (regardless of success or failure) the TCXML_IMPORT utility writes a set of application logs that detail key statistics. The problem is that these error logs are incredibly large and difficult to read. Parse these logs and split them into small understandable logging that can be used to track and resolve errors.

Autofilter for separator

Upon CSV creation, search for the default separator globally and filter out entries that contain this character