usage: tokenizer.py [-h] -i INPUTFILE [-a ACRFILE]
This script will tokenize input file sentence wise How to Run?
python3 tokenizer.py -i=in.txt-acr=tam.txt
options:
-h, --help show this help message and exit
-i INPUTFILE, --input INPUTFILE
provide input file name
-a ACRFILE, --acr ACRFILE
provide acr file name like tam.acr,required=False
nagaraju291990 / sentence-tokenizer Goto Github PK
View Code? Open in Web Editor NEWsentence tokenizer