Comments (5)
你这个是依赖问题吧,XLMRobertaConverter 要求 protobuf,但没找到。
from inference.
你这个是依赖问题吧,XLMRobertaConverter 要求 protobuf,但没找到。
那就当如何安装?
from inference.
你可以搜索下 protobuf 安装,这个似乎和 xinference 无关了,先 close 这个 issue,后续还有问题可以 reopen。
from inference.
protobuf
pip install protobuf
Requirement already satisfied: protobuf in c:\soft\xx\lib\site-packages (4.25.3)
安装了,可是还是不行
from inference.
protobuf 要依赖二进制的执行文件,只是有 python 包是不行的。
from inference.
Related Issues (20)
- 请问一下xinference怎么更新版本,通过pip安装的Xinference,是卸载旧版本然后重新安装最新版本的方式吗? HOT 1
- 使用xinference框架部署qwen2-vl-2b-instruct疑似推理时精度下降 HOT 2
- 0.15.1版本Qwen2-7b-instruct 推理报错! HOT 1
- gpu版docker无法启动 HOT 2
- docker运行无法下载模型,变量已经更改.宿主机本地启动,就可以下载 HOT 1
- 用户调用模型一段时间后模型服务会自动挂掉,但是模型占用的显存依旧存在 HOT 1
- 模型输出了不该输出的信息
- xinference安装成功后,启动报错,通过浏览器无法打开xinference的界面 HOT 2
- 多张gpu有空闲但是提示某一块gpu没有内存 HOT 2
- FEAT: Qwen2.5 support function calling HOT 6
- client.launch_model api 建议增加 按最近默认配置启动的功能类似
- 建议增加对嵌入模型 jina-embeddings-v3 的支持 HOT 1
- 启动qwen2.5 14B vllm int8 版本ValueError: [address=0.0.0.0:37961, pid=352437] Marlin does not support weight_bits = uint8b128. Only types = [] are supported (for group_size = 128, min_capability = 70, zp = False) HOT 1
- SGlang部署qwen2.5失败Exception: Capture cuda graph failed: BatchPrefillWithPagedKVCache failed with error code no kernel image is available for execution on the device HOT 7
- 注册模型,报 Please fill in valid value for all fields
- install FAILED: vendor/llama.cpp/examples/llava/llama-minicpmv-cli HOT 1
- XF提示exceed limit
- 运行的GPU有资源,却提示别的GPU资源不够
- xinference vllm inference qwen2.5 128k 返回空
- 0.15.2版本xinference启动本地模型报错Model not found
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from inference.