Comments (2)
mjzcng
commented on September 14, 2024
“AssertionError: vLLM only supports Linux platform (including WSL).”
遇到同样问题，vLLM只支持Linux，windows上需要在WSL环境下安装
from glm-4.
zRzRzRzRzRzRzR
commented on September 14, 2024
是的，windows的话只能运行transformers后端的demo，文档也已经说明了，请根据你的操作系统和basic demo 中的readme的要求进行安装
from glm-4.
Related Issues (20)
- P40上运行openai_api_server 回复乱码问题 HOT 1
- GLM4v-9b是否支持纯文本微调？
- openai api部署glm-4-9b-chat如何设置多gpu HOT 1
- RuntimeError: probability tensor contains either inf, nan or element < 0 HOT 6
- finetune_demo目录下lora.yaml种train.jsonl文件在哪？
- 单机多卡同时启动多个模型副本概率遇到问题
- 微调 GLM-4-9B-chat，自制数据集，提示 ValueError: 151337 is not in list HOT 2
- vllm搭载glm-4-9b-chat时指定guided_decoding运行报错
- 关于工具训练时候报错TypeError: 'NoneType' object is not iterable解决方法
- GLM-4-9B Chat-Finetuned到最后出现错误信息
- 想请问下glm-4v-9b支持 输入一段视频进行分析总结吗？ HOT 1
- apply_chat_template 错误
- 请教一下decoder部分 HOT 6
- Reproducing the results of THUDM/glm-4-9b-chat-1m on LongBench-Chat HOT 1
- GLM-4V-9b多GPU推理 HOT 1
- 你使用的哪个推理脚本
- GLM4对长文档作为训练数据的情况
- GLM4v首token时延较长是否有优化计划？ HOT 1
- 支持LongCite-glm4-9b模型 HOT 2
- glm-4v的模型文件中的ChatGLMModel类中1033行的inputs_embeds覆盖问题 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from glm-4.