Current plan to split this repository

[HealthyPear]

Current plan to split this repository

[bregeon]

As I expected, these scripts are the heritage of Tino, and we do not want to start from these:

• There is not much added value in the delete/download/upload files script, and if we really need such dedicated scripts it's better to use the Dirac API rather than wrapping the Dirac scripts.
• example_configuration.cfg and submit_jobs_new_scheme.py fully mix configurations linked to the GRID aspects, and configurations of the various protopipe applications, what make these 2 files not human readable.

We really need to sit down and talk the protopipe workflow from scratch to understand how to interface this correctly to CTADIRAC.

As an example, the DL1 Data Handler job interface can be found here:

• https://github.com/cta-observatory/CTADIRAC/blob/master/Interfaces/API/Prod3DL1DataHandlerJob.py
• https://github.com/cta-observatory/CTADIRAC/blob/master/Interfaces/test/prod3_dl1_data_handler_launcher.py

This interface is not perfect, but a priori, the protopipe interface should look quite similar.

Note also, that I expect that we'll have one interface per tool, e.g. one for DL0 to DL1, one for DL1 to DL2, one for DL2 to DL3, then may be also one for merging. These interfaces will likely inherit from a common protopipe interface.