Comments (3)
We might not have it listed in the docs, I'll make a note to check for that in the future.
In terms of usage, I typically allocated 4GB per thread. For example, all of the benchmarking I have set up reserves 16 threads and 64GB memory. I also believe these resources requirements are the same in the human WGS workflow: https://github.com/PacificBiosciences/wdl-common/blob/fef058b879d04c15c3da2626b320afdd8ace6c2e/wdl/workflows/hiphase/hiphase.wdl#L118.
With that said, if you have an unusual sample, it's possible that you may need more memory. "Unusual" in this context usually means it has a much higher NG50 than we expect in a normal sample. Some examples where we've seen this issue pop up:
- Extremely high heterozygosity - I think we had a sample semi-recently had a much higher het/hom ratio than expected, leading to significantly longer phase blocks (NG50 was ~6MB in the end). IIRC, we had to bump the memory req. to get that sample through.
- Non-HiFi data - One example where someone was trying to run HiPhase with ONT datasets. Disregarding accuracy concerns, this will create larger putative phase blocks leading to higher peak memory usage per phase block.
- Usage error - For example, running global re-alignment without SVs will almost certainly be problematic.
Does the dataset you're using fall into one of the above categories? If not, is there anything else unusual about the dataset that you think could be influencing it? If the data is publicly available, or you're willing to share, I can also take a look to see if there's anything odd.
from hiphase.
This is very useful information, thanks! I don't think our data falls into one of those categories, but I also think we have been requesting a little less memory than that on average.
Unfortunately, it is protected data, so I cannot share, but if I run into it with open data I will be sure to share.
Please feel free to close, and I will come back if I can find some open data that gives me trouble.
from hiphase.
Sure thing! FWIW, there are a couple places we could likely tighten up memory, it just hasn't been a priority given the current state. If you're finding that memory consumption is burdensome, we could look into re-prioritizing that.
from hiphase.
Related Issues (20)
- Feature request: optional file containing read haplotype assignments HOT 1
- Question on tagging of supplemental alignments HOT 2
- Feature request: CRAM compatible HOT 6
- RUST error when phasing with SV VCF file HOT 7
- Poor utilization of threads (maybe user error?) HOT 6
- Error βthread '<unnamed>' panicked at 'assertion failed: `(left == right)`β occurred while HIPhase working HOT 7
- segmentation fault (core dumped) HOT 2
- Encountered max_edit_distance check HOT 6
- Recommendations for input vcf HOT 3
- A question about HP tag HOT 6
- reference letter case issue HOT 2
- Feature request: haplotag in phased VCF files HOT 2
- Running HiPhase with tumor-normal pair HOT 2
- Error while parsing VCF file: FORMAT columns HOT 3
- Phase vcf with pre phased reads HOT 6
- Normalization of INDELs: required or should be avoided HOT 3
- [Suggestion] reducing messages to STDOUT to speed up the utility HOT 3
- [Question] information in the filter column of vcfs HOT 2
- [Question] Phasing of rs36056539 in NA19226 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hiphase.