How long does it take to build msbwt?

[gengyuncong]

How long does it take to build msbwt?

[holtjma]

Yuncong,

It looks like you are building this using the BWT merge algorithm that is a part of MSBWT. While this method will work for those large Illumina datasets, I don't recommend it as it was not designed for large Illumina dataset and will take a prohibitively large amount of time to build the BWT that way. Instead, I recommend using ropebwt2 and converting to msbwt. That method should be able to build the BWT of a dataset that large in a matter of hours (usually I run them overnight and they're done by the time I get back to work the next day).

As a word of warning, we have not tested FMLRC using an Illumina dataset that large. Most of our tests were on organisms with smaller genomes and therefor smaller Illumina and PacBio inputs.

Matt

[fidelram]

Maybe you can add this info to the FMLRC README which mainly suggest using msbwt.

[holtjma]

@fidelram I just checked to make sure this was in the README for FMLRC. It is, but probably not emphasized as much as I would like. I'll look into promoting it more with the next commit.

@gengyuncong I'm closing this issue, feel free to re-open or start another issue if you have more questions regarding building the BWT