Topic: text-processing Goto Github

👇 Here are 1476 public repositories matching this topic...

aappleby / matcheroni
text-processing,A minimalist single-header library for building pattern-matchers, lexers, and parsers.
User: aappleby
lexer lexing parser parsing parsing-expression-grammar parsing-expression-grammars regex text-processing c cplusplus-20 pattern-matching regular-expression regular-expression-engine regular-expressions

abadojack / whatlanggo
text-processing,Natural language detection library for Go
User: abadojack
language go nlp text-processing

airbnb / artificial-adversary
text-processing,🗣️ Tool to generate adversarial text examples and test machine learning models against them
Organization: airbnb
machine-learning classification python python3 python2 text text-mining adversarial-examples spam spam-filtering spam-detection spam-classification text-classification text-analysis data-science data-mining text-processing black-box-benchmarking black-box-attacks metrics

andrewbihl / bsed
text-processing,Simple SQL-like syntax on top of Perl text processing.
User: andrewbihl
sed perl grep awk python text-processing csv domain-specific-language

anwarvic / dan-jurafsky--chris-manning--nlp
text-processing,My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.
User: anwarvic
autocorrector autocorrection regular-expression regular-expressions sentiment-analysis sentiment-classification ner named-entity-recognition parsing parser

assafmo / xioc
text-processing,Extract indicators of compromise from text, including "escaped" ones.
User: assafmo
ioc iocs extract extraction text-mining text-processing indicators-of-compromise command-line-tool command-line defang

birchb1024 / frangipanni
text-processing,Program to convert lines of text into a tree structure.
User: birchb1024
text-processing golang go tree-structure

burntsushi / aho-corasick
text-processing,A fast implementation of Aho-Corasick in Rust.
User: burntsushi
aho-corasick substring-matching finite-state-machine text-processing search

burntsushi / regex-automata
text-processing,A low level regular expression library that uses deterministic finite automata.
User: burntsushi
regex dfa automata text-processing regexp regex-engine rust nfa automaton

bytesparadise / libasciidoc
text-processing,A Golang library for processing Asciidoc files.
Organization: bytesparadise
golang library asciidoc text-processing

casics / nostril
text-processing,Nostril: Nonsense String Evaluator
Organization: casics
detector gibberish identifier-string identifiers inference mining-software-repositories nonsense nonsense-string-evaluator source-code text-processing

catatsuy / purl
text-processing,Streamlining Text Processing
User: catatsuy
grep-like regexp sed text-processing

cbaziotis / ekphrasis
text-processing,Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
User: cbaziotis
nlp text-processing nlp-library spelling-correction tokenizer tokenization word-segmentation word-normalization spell-corrector text-segmentation

chenghaomou / text-dedup
text-processing,All-in-one text de-duplication
User: chenghaomou
text-processing de-duplication nlp data-processing

chmln / sd
text-processing,Intuitive find & replace CLI (sed alternative)
User: chmln
cli command-line regex rust terminal text-processing

daac-tools / daachorse
text-processing,🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
Organization: daac-tools
Home Page: https://docs.rs/daachorse
search finite-state-machine text-processing aho-corasick substring-matching rust double-array no-std

derek73 / python-nameparser
text-processing,A simple Python module for parsing human names into their individual components
User: derek73
Home Page: http://nameparser.readthedocs.org/en/latest/
python text-processing text-parser python-module

fastnlp / fastnlp
text-processing,fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
Organization: fastnlp
Home Page: https://gitee.com/fastnlp/fastNLP
chinese-nlp deep-learning natural-language-processing nlp-library nlp-parsing text-classification text-processing

gagolews / stringi
text-processing,Fast and portable character string processing in R (with the Unicode ICU)
User: gagolews
Home Page: https://stringi.gagolewski.com/
stringi icu icu4c r regex regexp string-manipulation unicode natural-language-processing text-processing

google / diff-match-patch
text-processing,Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.
Organization: google
difference diff match patch text-processing

goplus / bpl
text-processing,Binary Processing Language
Organization: goplus
golang go text-processing binary-parser language bpl

hakatashi / japanese.js
text-processing,Util collection for Japanese text processing. Hiraganize, Katakanize, and Romanize.
User: hakatashi
Home Page: https://npmjs.org/package/japanese
japanese text-processing javascript utility romanize hiragana katakana

haven-jeon / pykospacing
text-processing,Automatic Korean word spacing with Python
User: haven-jeon
korean-nlp nlp text-processing spacing

helix-editor / nucleo
text-processing,A fast and convenient fuzzy matcher library for rust
Organization: helix-editor
fuzzy-matching fuzzy-search performance rust text-processing

himkt / konoha
text-processing,🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
User: himkt
Home Page: https://pypi.org/project/konoha
nlp text-processing mecab kytea sudachi sentencepiece natural-language-processing japanese janome

ikegami-yukino / jaconv
text-processing,Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
User: ikegami-yukino
Home Page: https://ikegami-yukino.github.io/jaconv/jaconv.html
japanese-language preprocessing text-processing japanese-kana pure-python character-converter julius transliteration

karolzak / support-tickets-classification
text-processing,This case study shows how to create a model for text analysis and classification and deploy it as a web service in Azure cloud in order to automatically classify support tickets. This project is a proof of concept made by Microsoft (Commercial Software Engineering team) in collaboration with Endava http://endava.com/en
User: karolzak
azure azure-machine-learning azure-app-service azure-web-app-service azure-webapp python pandas numpy machine-learning text-classification text-processing text-mining text-analysis classification classifier web-service model ml ai artificial-intelligence

kk7nc / text_classification
text-processing,Text Classification Algorithms: A Survey
User: kk7nc
text-classification nlp-machine-learning document-classification text-processing dimensionality-reduction rocchio-algorithm boosting-algorithms logistic-regression naive-bayes-classifier k-nearest-neighbours

larrykollar / unix-text-processing
text-processing,Recreated sources for the book "UNIX Text Processing," published in 1987.
User: larrykollar
gnu-troff unix utp utp-revival groff text-processing publishing formatting

learnbyexample / cli_text_processing_coreutils
text-processing,Example based guide for specialized text processing with GNU Coreutils
User: learnbyexample
Home Page: https://learnbyexample.github.io/cli_text_processing_coreutils/
command-line text-processing gnu coreutils ebook linux

learnbyexample / command-line-text-processing
text-processing,:zap: From finding text to search and replace, from sorting to beautifying text and more :art:
User: learnbyexample
command-line linux text-processing ebook sed grep perl awk ruby regex

learnbyexample / learn_ruby_oneliners
text-processing,Example based guide for text processing with Ruby from the command line
User: learnbyexample
Home Page: https://learnbyexample.github.io/learn_ruby_oneliners/
ruby ebooks command-line learn-by-doing exercises one-liners text-processing

linuxscout / pyarabic
text-processing,pyarabic
User: linuxscout
nlp-library arabic-language text-processing

lyeoni / prenlp
text-processing,Preprocessing Library for Natural Language Processing
User: lyeoni
nlp natural-language-processing text-processing text-preprocessing preprocessing-library

mycroftai / padatious
text-processing,A neural network intent parser
Organization: mycroftai
Home Page: http://padatious.readthedocs.io
intent-classification text-analysis language-processing intent text-processing language-detection

nihopa / nlpre
text-processing,Python library for Natural Language Preprocessing (NLPre)
Organization: nihopa
natural-language-processing nlp nlp-parsing python text-processing

open-i18n / rust-unic
text-processing,UNIC: Unicode and Internationalization Crates for Rust
Organization: open-i18n
Home Page: https://crates.io/crates/unic
unicode internationalization text-processing crates rust cldr locale-data unic unicode-characters unicode-algorithms

open-korean-text / open-korean-text
text-processing,Open Korean Text Processor - An Open-source Korean Text Processor
Organization: open-korean-text
korean korean-text-processing natural-language-processing text-processing tokenizer korean-tokenizer

pemistahl / lingua-go
text-processing,The most accurate natural language detection library for Go, suitable for short text and mixed-language text
User: pemistahl
natural-language-processing language-detection language-recognition language-classification language-identification language-processing nlp nlp-machine-learning golang-library go

proycon / pynlpl
text-processing,PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
User: proycon
Home Page: https://pypi.python.org/pypi/PyNLPl
nlp python computational-linguistics linguistics library folia machine-learning language-modelling search-algorithms evaluation-metrics text-processing nlp-library natural-language-processing

pymupdf / pymupdf
text-processing,PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
Organization: pymupdf
Home Page: https://pymupdf.readthedocs.io
mupdf xps pdf-documents epub ocr pdf font python data-science extract-data

pyparsing / pyparsing
text-processing,Python library for creating PEG parsers
Organization: pyparsing
parser-combinators parsing parsing-expression-grammar parsing-library peg-parsers python python-2 python-3 python2 python3 text-processing

randypen / textcluster
text-processing,短文本聚类预处理模块 Short text cluster
User: randypen
nlp text-processing text-mining cluster text-cluster text-clustering

roshan-research / hazm
text-processing,Persian NLP Toolkit
Organization: roshan-research
Home Page: https://www.roshan-ai.ir/hazm/
dependency-parser embeddings farsi lemmatization natural-language-processing nlp normalization persian persian-nlp pos-tagging python text-processing tokenizer

s3nh / text-detector
text-processing,Tool which allow you to detect and translate text.
User: s3nh
craft crnn text text-processing pytorch ocr-recognition deep-learning nlp recognition text-recognition

sstadick / hck
text-processing,A sharp cut(1) clone.
User: sstadick
rust command-line text-processing

textpipe / textpipe
text-processing,Textpipe: clean and extract metadata from text
Organization: textpipe
nlp named-entities named-entity-recognition text-processing text-analysis language-identification

textvec / textvec
text-processing,Text vectorization tool to outperform TFIDF for classification tasks
Organization: textvec
python nlp machine-learning text-analysis text-classification text-processing tf-idf natural-language-processing

wenet-e2e / wetextprocessing
text-processing,Text Normalization & Inverse Text Normalization
Organization: wenet-e2e
normalization production-ready text-processing

wzbsocialsciencecenter / tmtoolkit
text-processing,Text Mining and Topic Modeling Toolkit for Python with parallel processing power
Organization: wzbsocialsciencecenter
Home Page: https://tmtoolkit.readthedocs.io/
topic-modeling text-processing evaluation parallel-processing nlp socialscience python