Comments (1)
From [email protected] on 2014-08-12T01:42:16Z
I assume what you are describing here is generalizing it where any prefix could be put in, so
part(1..10) or part("A","B","C") or section(1..10), etc.
Will produce jobs with variables part1,part2,... or partA, partB, ..., or section1,section2, section3...
That's a pretty good start. I would suggest that you consider also how to pass in pure numbers to each job with no prefix for the numbers, as well as pairs of numbers. I have used a number of tools that take a range in a format like:
myscript -r begin,end
So there are actually two numbers to update for each job. Obviously you can just wrap the job in a script that interprets a variable like part1 into the correct begin, end indices, but it'd be nice if there were a way to do it in a bpipe script.
I'm not sure how to do this syntactically that would be easy enough to parse. If parsing were no barrier, maybe something like:
Bpipe.run{
(0..500).each{begin->
end = begin + 1000
[my_parallel_task]
}
where begin and end become implicit variables for each instance of the parallel task.
from bpipe.
Related Issues (20)
- previous working version of bpipe script did not work in bpipe 0.9.9.8
- bpipe: line 762: 63827 Killed nohup bash -c "$LAUNCH_CMD" > /dev/null 2>&1 HOT 1
- transform incorrectly processes directory names instead of filenames HOT 4
- bpipe how to get the output path when the -d was defined
- Modify preamble text when using shebang HOT 4
- Install fails. HOT 2
- Conditional execution of steps
- Allow containers to have different paths to the external ones
- job failed due to global variable assignment HOT 2
- Regression with XMPP channel HOT 1
- Significant number of critical vulnerabilities reported in dependencies HOT 3
- Error when running on osx-arm64 HOT 2
- Problem with hostname resolution
- slurm scheduler not working with slurm-wlm-torque qstat HOT 5
- Installing error in Bpipe on M1 Mac HOT 2
- A fixed error reappeared HOT 2
- bpipe via Conda throws java.lang.NoClassDefFoundError
- Skip command start for "my command" due to probe mode HOT 1
- Activate conda environment and execute command
- Null PID reference HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bpipe.