#Text Proceesing Tools some tools written in ipython notebook for processing text.
E.g. sentence segmentor for english chinese and by changing the training corpus it could be built as a universal segmentor.
Tool for tokenize Chinese into single character.
Rule-Based Chinese sentence segmentor