kobikun Goto Github PK

ake-datasets

Large, curated set of benchmark datasets for evaluating automatic keyphrase extraction algorithms.

convlab

ctranslate2

Fast inference engine for OpenNMT models

dastrie

Static Double Array Trie (DASTrie)

dotfiles

extractor-wiki-data

extracting multiple-language data from wiki-data

gym

gym for execising

ivory

A Hadoop toolkit for web-scale information retrieval research

kenlm

KenLM: Faster and Smaller Language Model Queries

kobikun

Config files for my GitHub profile.

korean-sentence-splitter

Split Korean text into sentences using heuristic algorithm.

mpnet

MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf

ner

한국어 개체명 정의 및 표지 표준화 기술보고서와 이를 기반으로 제작된 개체명 형태소 말뭉치

niben

nihongo benkyo by chatbot

nltk

NLTK Source

numpy-study

numpy-study

opennmt-py

Open-Source Neural Machine Translation in PyTorch http://opennmt.net/

opensubtitles-parser

download, extract, parse and tokenize the opensubtitles dataset with this script

realchar

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖

sentence-transformers

Sentence Embeddings with BERT & XLNet

simstring

SimString

study

study ipython

subtitle_chatpair

chatting pair from subtitles

subword-nmt

Subword Neural Machine Translation

text

til

TIL

wiki

wiki docuements