ihearmycalls / inference Goto Github PK
View Code? Open in Web Editor NEWThis project forked from xorbitsai/inference
Xorbits Inference (Xinference) is a powerful and versatile library designed to serve LLMs, speech recognition models, and multimodal models, even on your laptop. It supports a variety of models compatible with GGML, such as llama, chatglm, baichuan, whisper, vicuna, orac, and many others.
License: Apache License 2.0