Comments (3)
@gahoo 感谢建议。后续可能会改成如果超过某个长度,显示xyz...,同时光标移上去显示全名 的形式。
如果你有兴趣,非常欢迎给我们提PR修改。
from inference.
嗯……这个改动比较容易实施。不过,很多模型只是末尾后缀不一样,这样就不太容易一眼看出来了。比如-INT4
、-AWQ
之类的。
另外,是否考虑加一个修改或者reregister的按钮?
from inference.
Closed by #979
from inference.
Related Issues (20)
- QUESTIO目前xinference支持一个模型部署在多台机器上么? HOT 1
- bce-reranker-base 模型调用报错 CUDA-capable device(s) is/are busy or unavailable
- docker 0.10.3 版本 3060 显卡运行 llama-3-8b-instruct-q4_k_m 发送消息后持续阻塞
- langchain中Xinference Chat的支持 HOT 4
- 同一服务器下不同用户使用xinference服务时的模型识别BUG
- BUG: Fail to run model "bge-reranker-v2-minicpm-layerwise" with Xinference v0.11.0 version (docker images) HOT 8
- Download llama_cpp_python-0.2.75.tar.gz failure HOT 3
- docker cpu 版本,下载模型异常:Server error: 500 - [address=0.0.0.0:33434, pid=15] 'NoneType' object is not subscriptable HOT 5
- QUESTION xinference 接口最大能支持多大的并发呢?
- embedding模型launch_model,会重复加载 v0.11.1.1
- BUG: Accessing a wrong model can cause the entire Docker environment to crash. HOT 1
- 能否接入Qwen-Audio-Chat模型? HOT 2
- QUESTION:注册本地模型,启动时无法设置量化
- codeqwen1.5-7b-base,deepseek-coder-6.7b-base等base模型,在注册时无法找到对应的family,选other后,没有vllm引擎 HOT 2
- ENH: Registering custom rerank model support types HOT 1
- FEAT: cogvlm2_llama3 support
- internlm2-chat模型对话报错
- 致命错误:bad revision 'HEAD' HOT 2
- BUG cannot run model 'bge-reranker-v2-minicpm-layerwise' in the lastest version of xinference
- 内网无法启动内置的模型,使用自定义的方式定义了一个yi-vl-chat的模型,运行的时候报错
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from inference.