Comments (3)
some other suggestions after using this a bit more:
random_op
might also be better named as something likeparallel_apply
or whatever, since there's no actual randomness (this confused me when i first found this method)- maybe you could allow specifying a reduce function so that it could take all the results and return a summary (like randomstats).
- is there a way to get around the wrapper functions in stats.py to allow methods more directly? e.g. if func is a method then automatically create a wrapper?
new_func = function(self, other, **kwargs){
return getattr(self, func.__name__)(other, **kwargs)
}
(or something like that --completely untested)
from pybedtools.
- good point
- also good point
- i think this will be complicated, see below.
Class methods are not well supported (maybe not supported at all?) across process boundaries because they can't be pickled (as pool.apply() complains). I don't know the details, but basically I found that you can only pass functions. I haven't tested the wrapping of a method in a function as you suggest though . . .
Also, class variables do not share state across processes. Importantly, this includes BedTool._TEMPFILES. I was getting all sorts of strange behavior using multiprocessing and pybedtools' existing auto-handling of temp files, and files were not being completely cleaned up.
So stats.py was my attempt to address both of these issues by having functions work on instances passed to the process (via the func args) and by being careful about cleaning up tempfiles.
Anyway, I agree that something like this would be useful but I think it will take some playing around with.
from pybedtools.
Thanks to your suggestions, I made a new, general way of applying any arbitrary BedTool method many times in parallel -- see 3f3673c. Eventually, I'd like to deprecate randomstats and the stuff in stats.py in favor of this since it's 1) a lot cleaner and 2) a lot more general.
from pybedtools.
Related Issues (20)
- Support Python 3.10 and 3.11 HOT 1
- "python setup.py bdist_wheel did not run successfully" when pip installing with python v3.11 HOT 8
- to_dataframe() creates 0th row with generic names in nucleotide_content HOT 2
- build failure under python 3.11 HOT 6
- pybedtools intersect error HOT 2
- Cannot create a BedTool object from list of regions that uses np.int64 coordinates
- remove historical py27 support HOT 1
- bedtools intersect reported incorrect interval intersection HOT 3
- Cythonizing files requires `language_level=2` to be set in cythonize() HOT 4
- pybedtools multi_bam_coverage assistance HOT 2
- "fastaFromBed" error HOT 2
- intersect with multiple -b arguments not working with -sorted HOT 1
- Unable to install pybedtools==0.9.1 in Python3.10 HOT 4
- Len modifying the Bedtools after a filter HOT 2
- Has pybedtools considered packaging bedtools? HOT 3
- how to mask gap regions for randomization? HOT 1
- Issue while doing pip install pybedtools HOT 3
- Inconsistent behaviour when using files from `pathlib.PosixPath` with BedTool functions...
- pybedtools.bedtool.Bedtool.sort()
- total_coverage giving a incorrect value
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pybedtools.