Comments (5)
I just checked. Vulkan drivers are not installed. Let me install and then come back.
from ai00_server.
Ai00
requires Vulkan. Does your GPU support Vulkan and Do you have Vulkan driver installed? You may check vulkaninfo
.
from ai00_server.
@cryscan I have A10 G Nvidia card and driver version is 515.65.01 with CUDA 11.7. I want to know how can I install vulkan drivers? I don't seem to find any good article to install them.
from ai00_server.
https://developer.nvidia.com/vulkan-driver
https://docs.nvidia.com/grid/13.0/grid-vgpu-user-guide/index.html
https://browser.geekbench.com/vulkan-benchmarks
from ai00_server.
==========
VULKANINFO
==========
Vulkan Instance Version: 1.3.283
the some issues
2024-05-16T11:06:22.752Z INFO [ai00_server::middleware] type: SafeTensors
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
2024-05-16T11:06:22.802Z ERROR [ai00_server::middleware] reload model failed: failed to request device
2024-05-16T11:06:22.807Z INFO [ai00_server] server started at 0.0.0.0:65530 with tls
from ai00_server.
Related Issues (20)
- Feature request: NoRepeatNgram
- [bug] Penalty decay argument seems to be compulsory? HOT 1
- v0.4 前后端需求汇总
- 1.76环境ubuntu编译报错 HOT 2
- Issue starting server on Manjaro HOT 2
- ambiguous finish reason
- 0.3.24 outputs gibberish HOT 5
- Feature request: Huggingface tokenizer support HOT 1
- Documents should not be deployed if not finished HOT 3
- 怎么中断聊天 HOT 1
- 怎么中断聊天
- 使用ai00频繁爆语料 HOT 2
- 用openai的API库发送请求,返回HTTP400 HOT 3
- 聊天过程中,输入问题后,希望加入回车发送问题 HOT 2
- 2 bugs in mirostat sampler HOT 3
- Crash on chat: Cannot start a runtime from within a runtime. HOT 3
- V0.5 前后端需求
- Higher number of Num Tokens? HOT 5
- Apple版本中,“设置/选择后端”为空不知该怎么办 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai00_server.