Merged job logging of parallel commands.

[ssadedin]

Merged job logging of parallel commands.

[lonsbio]

From [email protected] on 2012-07-11T16:59:37Z

Thanks for logging this. I agree it's something that needs to be addressed, as it goes to the issue of reproducibility. I will see what can be done in small ways to address it in the short term and think about more comprehensive solutions in the longer term (I am actually thinking the 'bpipe' command itself might be a part of this in the sense it could be used to query logs for any stage of any run, such as 'bpipe log , or bpipe log (to show the log for command that produced the file), - but that needs bigger internal changes).

Labels: -Priority-Medium Priority-High

[lonsbio]

From [email protected] on 2012-10-08T18:21:38Z

I would like to agree with the initial poster. For reproducibility as well as traceability and archival purposes a "one log per input" would be quite essential. I would for example like to integrate these files in our LIMS to trace the processing an individual file, i.e. a individual samples, has gone through. Combining that with the version tracker integrated in bpipe would be quite powerful.