Config files not available from the Configs link in web queries

[katilp]

Config files not available from the Configs link in web queries

[vkuznet]

Kati, I confirm that this issue exists. Turns out that we somehow wiped out reqmgr2 maps in DAS backends. I requested a solution but it may take a while. So far I don't know the time estimate since it depends on our cmsweb operator (Lina) to perform such action.

[vkuznet]

Kati, we have deployed new DASMaps and I can see config links for your second dataset, but I don't see configs for first dataset you provided. It may happen that we do not have configs in place. But I think the issue is solved. Please try out second link you provided (AOD dataset) and let me know.

[katilp]

OK, thanks! The second is fine, that's already very good. However, I'll follow up the first case as well.
It looks that for a dataset in a major Run2 production e.g.

https://cmsweb.cern.ch/das/request?instance=prod/global&input=config+dataset%3D%2FADDGravToGG_MS-3000_NED-2_KK-1_M-1000To2000_13TeV-sherpa%2FRunIIFall15MiniAODv2-PU25nsData2015v1_76X_mcRun2_asymptotic_v12-v1%2FMINIAODSIM

the config file is present, I'll try to see if the dataset before was somehow particular, or maybe it is a problem with more recent campaigns..

[vkuznet]

Maps were deployed to show configs. At this point I'm closing the ticket since technical issue is resolved. If there is a missing configs it is operational issue, i.e. somebody didn't put config in a first place.

[katilp]

Can this be re-opened as I observed some other irregularities now concerning also the collision data?
There we would really need to keep the reco configs as for DP we say we can rely on a single copy of AOD because "AOD can always be regenerated from RAW which is kept in two copies". That's problematic without having the configs.

Example:

2010 AOD does not have the configs:
https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=config+dataset%3D%2FMu%2FRun2010B-Apr21ReReco-v1%2FAOD

I cannot confirm whether they have ever been available (we did not extract them at the time of the release but we would now like to do it now to complete the information)

I believe they can be retraced if the corresponding cmsDriver command can be found but it would be preferable to have this backed up in CMSDAS.

However, the 2011 configs which were available (and we have extracted them to CODP) are available
https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=config+dataset%3D%2FSingleMu%2FRun2011A-12Oct2013-v1%2FAOD

[vkuznet]

Kati, now you need to understand that nothing I can do in DAS about it. If there is no data in underlying system, e.g. reqmgr2 or dbs, DAS cannot magically get it. It is issue with data injection and not data look-up. Somehow for whatever reason this information about configs were not injected and therefore we can't look it up now. I understand that you may need this info but it is a wrong place to ask for it now. DAS queries DBS/ReqMgr2 and if these system does not provide it DAS can't do anything about it. I suggest that place your question to the following forums: [email protected] [email protected] [email protected] Best, Valentin.

…

On 0, Kati Lassila-Perini ***@***.***> wrote: Can this be re-opened as I observed some other irregularities now concerning also the collision data? There we would really need to keep the reco configs as for DP we say we can rely on a single copy of AOD because "AOD can always be regenerated from RAW which is kept in two copies". That's problematic without having the configs. Example: 2010 AOD does not have the configs: https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=config+dataset%3D%2FMu%2FRun2010B-Apr21ReReco-v1%2FAOD I cannot confirm whether they have ever been available (we did not extract them at the time of the release but we would now like to do it now to complete the information) I believe they can be retraced if the corresponding cmsDriver command can be found but it would be preferable to have this backed up in CMSDAS. However, the 2011 configs which were available (and we have extracted them to CODP) are available https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=config+dataset%3D%2FSingleMu%2FRun2011A-12Oct2013-v1%2FAOD -- You are receiving this because you modified the open/close state. Reply to this email directly or view it on GitHub: #4294 (comment)

[katilp]

OK, thanks, I understand.