elbakerino/baistro

baistro · AI APIs

Some APIs around AI models.

• CPU only docker setup
• Expects preloaded models, no (annoying) auto-downloads
• Stats about token usages (partially/WIP)

Tasks & Models

💎 = most stable

⚗️ = very experimental / unstable

Vector Space Representations

by Sentence-Transformers

• Text / Sentences 💎
• Image
• Code 💎

Linguistic Analysis

by Stanza 💎

• Locale Identification
• Sentence Segmentation
• Token Classification (NER, POS, MWT)
• Sequence Classification (Sentiment)
• Lemmatization

Document Processing

• Image to Data (by donut) ⚗️
• Visual Document Question Answering (Image) (by donut)
• WIP Document Classification (Image) (by dit) ⚗️
  • (dataset) RVL-CDIP: "letter", "form", "email", "handwritten", "advertisement", "scientific report", "scientific publication", "specification", "file folder", "news article", "budget", "invoice", "presentation", "questionnaire", "resume", "memo"

NLI / QA / QAG / QG

general Natural Language Inference

• Question Answering
• Question Answer Generation ⚗️
• Question Generation ⚗️
• Question Natural Language Inference / QNLI 💎

Task Implementations

• Semantic Search 💎
• WIP Sentence Clustering
• todo Topic Clustering (by BERTopic)

DEV Notes

poetry lock --no-update
poetry install --sync
# poetry lock --no-update && poetry install --sync

Run in docker container cli:

docker compose run --rm baistro bash
poetry run cli

# download models:
poetry run cli download