Comments (2)
Hello,
I would like to add that we are having a similar issue, resulting in Porechop failing on a library of ~5.5 million reads.
Thanks
from porechop.
I suspect this is a limitation of Porechop's somewhat simplistic design: it currently loads all reads into memory and then processes them. So if you have more reads than you can fit into memory, I'd expect it to crash. Does this fit with what you're seeing?
The workaround would be to split your input reads into multiple files and run Porechop on each - not very elegant but probably the only solution at the moment.
The real fix would be a redesign of how Porechop works. It could load reads as it handles them and then free up the memory when it's done with each read. This would obviously be better, but it would be a lot of work 😄 So I'll leave this issue open as an enhancement.
from porechop.
Related Issues (20)
- Fails to zip TEMP_*
- Custom adapters cannot be found when binning but can be found using trimming function HOT 1
- hie. is there anyone with the fasta sequences of the rapid barcode (RB) From RB01 to RB10. please help HOT 1
- Porechop demultiplexing error HOT 1
- Minimal length for custom barcodes
- Error: Porechop could not determine barcode orientation HOT 3
- OSError: [Errno 5] Input/output error
- citation HOT 2
- I would like to add custom barcodes, but retain native (Ligation kit) adapters HOT 2
- cpp_function error (again) HOT 2
- output isn't compressed
- Porechop Installation error
- installtion error
- installtion Error
- to discard or not to discard?.. reads with middle adapter
- Custom barcodes not found HOT 1
- Hi! Can you recommend a video to learn how to use porechop? HOT 1
- Demultiplexing - barcode bins HOT 3
- Number of reads increased after Porechop HOT 1
- porechop installation error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from porechop.