taishi-i/awesome-japanese-nlp-resources

A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese

awesome-japanese-nlp-resources's Issues

.NET日本語形態素解析エンジンNMeCabが追加したい

こんにちは。
素晴らしいリポジトリを作ってくださってありがとうございます。

NMeCabが追加したいですけど、これは大丈夫でしょうか。

よろしくお願い致します。

Morphology analysis tool

• NMeCab - NMeCab: About Japanese morphological analyzer on .NET

Punctuation tools

Hi @taishi-i , thank you so much for this helpful list of resources.
Would you any tool that can perform punctuation in Japanese text?
Ideally a machine learning model that predicts where a puctuation is needed in a text.

Thanks

いくつかのリソースの紹介

こんにちは。
素晴らしいリポジトリで感動しました。（私の記事である『フリーで使える日本語の主な大規模言語モデルまとめ』もご紹介いただきありがとうございます！）

私が過去に GitHub でスターをつけたリソースのうち、まだこのリポジトリに載っていなさそうなものを僭越ながら書いてみます。

• atilika/kuromoji Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
• takuyaa/kuromoji.js JavaScript implementation of Japanese morphological analyzer
• daac-tools/vaporetto 🛥 Vaporetto: Very Accelerated POintwise pREdicTion based TOkenizer
• ku-nlp/bertknp A Japanese dependency parser based on BERT
• KoichiYasuoka/esupar Tokenizer POS-Tagger and Dependency-parser with BERT/RoBERTa/DeBERTa models for Japanese and other languages
• izuna385/jel Japanese Entity Linker.
• WorksApplications/chiVe Japanese word embedding with Sudachi and NWJC
• nttcslab/japanese-dialog-transformers Code for evaluating Japanese pretrained models provided by NTT Ltd.
• octanove/shiba Pytorch implementation and pre-trained Japanese model for CANINE, the efficient character-level transformer.
• reppy4620/Dialog A PyTorch Implementation of japanese chatbot using BERT and Transformer's decoder
• retarfi/language-pretraining BERT and ELECTRA models of PyTorch implementations for Japanese text.
• ou-medinfo/medbertjp Trials of pre-trained BERT models for the medical domain in Japanese.
• sociocom/MedNER-J Latest version of MedEX/J (Japanese disease name extractor)
• stockmarkteam/ner-wikipedia-dataset Wikipediaを用いた日本語の固有表現抽出データセット
• SkelterLabsInc/JaQuAD JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension (2022, Skelter Labs)
• tsuruoka-lab/BSD The Business Scene Dialogue corpus
• ikegami-yukino/dataset-list lists of text corpus and more (mainly Japanese)

このリポジトリの趣旨に合うものがあれば追加してみてください。

Request for inclusion: yomigana-ebook - a faster tool for adding kanji readings to ebooks

Hello,

I would like to bring your attention to a tool called yomigana-ebook that I have developed. This tool efficiently adds readings for kanji in eBooks and boasts a performance that is 4x faster when compared to furigana4epub, as observed on my computer. The implementation of both tools leverages the multiprocessing library.

I kindly request considering the inclusion of this tool in the list.

Thank you for your time and consideration.

p.s. the title and content is generated from chatgpt because of my poor english.