Post-pipeline tasks

[bitextor]

Post-pipeline tasks

[lpla]

FYI, we are managing our tasks on the "Projects" tab of Github: https://github.com/bitextor/bitextor/projects/1

That would help us to know what tasks have priority and who is doing them

[hieuhoang]

4. Add bicleaner training
5. Add training for bitextor's document and sentence aligner. (Just create dictionary?)

[hieuhoang]

6. Give slurm job descriptivve names. At the moment, they are all 'snakejob' which makes it difficult to identify and kill indivdual jobs
7. Allow and test different html->text methods. Tests different variations of the entire pipeline, eg. httrack v. creepy, nmt v. smt, marek aligners v. bitextor aligners

[mespla]

8. Convert doc_align.sh and bleualign.sh to Snakemake rules 9. Add deduplication before bicleaner 10. Add documentation for all options (also some guides to developers that want to contribute to the project) Missatge de Hieu Hoang <[email protected]> del dia dv., 23 de nov. 2018 a les 13:20:

…

1. Give slurm job descriptivve names. At the moment, they are all 'snakejob' which makes it difficult to identify and kill indivdual jobs 2. Allow and test different html->text methods. Tests different variations of the entire pipeline, eg. httrack v. creepy, nmt v. smt, marek aligners v. bitextor aligners — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#46 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AGOwSJrglZYAJSGCXqrpL9qXOkzZVwzoks5ux-ghgaJpZM4YwiGX> .

[hieuhoang]

11. Use requirements.txt in slurm/install.sh. At the moment, they both have separate lists of python requirements. Both need to correct and up to date

[lpla]

I added all tasks from last meeting and this issue to the Bitextor 7.0 Cycle "Projects" table: https://github.com/bitextor/bitextor/projects/1

Let's continue managing our tasks there, please.