Comments (7)
codingl2k1
commented on September 24, 2024
你用的是哪个版本的xinference？服务端有没有错误信息？
from inference.
simmoncn
commented on September 24, 2024
你用的是哪个版本的xinference？服务端有没有错误信息？
@codingl2k1 用的昨天发布的最新版0.8.5， debug信息打开了，没看到异常信息
from inference.
codingl2k1
commented on September 24, 2024
from inference.
codingl2k1
commented on September 24, 2024
"stream": true看着是正常的，我这里没办法复现你的问题。
from inference.
codingl2k1
commented on September 24, 2024
json的true是小写的，你确定post过去的是个合法的json吗？
from inference.
simmoncn
commented on September 24, 2024
json的true是小写的，你确定post过去的是个合法的json吗？
代码里定义的是Bool，所以赋值是大写的True，这个我刚才试的确还是报错，不过小写的是对的
from inference.
simmoncn
commented on September 24, 2024
我这边改了我的代码，应该可以了，多谢
from inference.
Related Issues (20)
- :Error code: 500 - {'detail': "[address=0.0.0.0:37059, pid=3614009] Tool response dicts require a 'name' key indicating the name of the called function!"} HOT 51
- 可以在有多余显存的GPU上再跑模型吗？
- 支持MiniCPM-Reranker
- Model qwen2-instruct cannot be run on engine vLLM HOT 3
- 已经缓存的声音模型不能通过过滤器显示出来
- 机器A访问部署在机器B上的xinference GET的相关接口会有限制吗？ HOT 2
- 注册whisper的时候出错 HOT 2
- 流式TTS不能流式输出，但是通过curl命令可以
- 安装成功后（能显示版本号和安装地址），运行提示xinference: command not found HOT 3
- 0.15.0视觉模型存在问题，最近会修复吗 HOT 7
- SenseVoiceSmall 离线环境启动报错 HOT 2
- launch qwen2-vl-2b-instruct报错，能不能帮忙看一下哇 HOT 1
- Server error: 400 - [address=0.0.0.0:36057, pid=4539] Trying to set a tensor of shape torch.Size([2048, 128]) in "weight" (which has shape torch.Size([2048, 1024])), this looks incorrect. HOT 2
- launch audio model-cosyvoice-300M-sft ERROR HOT 1
- Fish Speech 1.4 was released HOT 2
- cosyvoice并发处理请求报错：Exception: Parallel generation is not supported by llama-cpp-python HOT 4
- CosyVoice-300M-SFT无法生成较长的语音 HOT 2
- Xinference launch 不能指定一个端口启动模型
- xinference launch --help 中没有制定模型启动后的端口
- xinfer会话接口并发时，响应时间和并发数成比例 期望解答 HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from inference.