Comments (7)
Hi.
let me also ask another question here.
In the "MassStorageFile" description, I find:
"namePattern" = "pattern of the file name ..."
while in the description of the "TaskChainInput", I find:
"include_file_mask" = "List of Regular expressions of which files ..."
"exclude_file_mask" = "List of Regular expressions of which files ..."
Am I really supposed to provide full-featured python "regular expressions" for the "TaskChainInput" and simple shell-like "file patterns" for the "MassStorageFile"?
For example, someting like r'.*_A_.*\.root'
for the "TaskChainInput" versus '*_A_*.root'
for the "MassStorageFile"?
Thanks in advance,
Best regards,
Jacek.
from ganga.
Hi Jacek,
This is correct - the Transform file masks take regular expression strings whereas the MassStorageFiles take Glob style file patterns. Sorry for this being confusing - I've opened another issue to attempt to make it a bit easier to use. In the meantime though, could you try with the regular expressions and see if that works?
Thanks,
Mark
from ganga.
linking the other issue #12
from ganga.
Hi,
thanks for the clarification.
I ran three tests (please correct me if my "regular expressions" are not right):
- apply only
indata.include_file_mask=[ r'oa_.*_B_.*\.root' ]
, - apply only
indata.exclude_file_mask=[ r'oa_.*_A_.*\.root' ]
, - apply both above properties simultaneously,
and in all cases "trf_second" gets all'oa_*_[AB]_*.root'
files as input.
Best regards,
Jacek.
from ganga.
hi Jacek,
The copying is actually done by the Task/Transform code which isn't included in the base class (specifically the createChainUnit
method in the Transform
class). Are you using CoreTransform
? If not, then you'll have to send me your code so I can see how this is being done as there seems to be some problems there.
Thanks,
Mark
from ganga.
HI,
thanks, very much, for your help.
Indeed, the Task/Transform code is "experiment specific", so I will need to talk to the original author.
For the moment you can close this issue.
Sorry for misleading.
Best regards,
Jacek.
from ganga.
Not a problem, please re-open the issue if we need to come back to this
from ganga.
Related Issues (20)
- Problems with running slc6 based GaudiExec HOT 9
- Wrong default value assigned to DiracFile object HOT 3
- GaudiExec applications not running in container HOT 9
- Make GaudiExec use the regular virtualization options HOT 2
- Ganga crashes when opening HOT 1
- Option to monitor a slice
- Update default platforms
- Registry slicing does not work
- Parametric submission for Executable jobs and Dirac?
- Speed up Dirac submission
- Ganga crashes when banned sites set to empty list HOT 5
- Job master kill error with failed subjobs HOT 3
- Remove `finaliseOnMaster`
- Make number of retries in BKQuery changeable
- respiting of a subjoin always fails HOT 10
- Exception when starting ganga version 8.7.9 HOT 4
- Add filters for tarfile extraction
- Syntax warning in Condor wrapper
- Make `runMonitoring` take more types HOT 2
- Interactive between DaVinci and Ganga have some problems
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ganga.