Giter Site home page Giter Site logo

Comments (9)

qinxuye avatar qinxuye commented on June 17, 2024

调用报错有错误栈吗?

from inference.

bigzws avatar bigzws commented on June 17, 2024

屏幕截图 2024-03-12 145107
bb88e6e284609d6e24a005946232a01

from inference.

qinxuye avatar qinxuye commented on June 17, 2024

xinference 日志的错误有没有

from inference.

bigzws avatar bigzws commented on June 17, 2024

imagedocker
无任何报错

from inference.

qinxuye avatar qinxuye commented on June 17, 2024

感觉 dify 的请求没有打过来?dify 的版本是最新的吗

from inference.

bigzws avatar bigzws commented on June 17, 2024

dify v0.5.8,在单卡上可以调用rerank模型。测试将qwen 1.5 运行在GPU1上,也可以被正常调用。只有bge-reranker存在这个问题

from inference.

bigzws avatar bigzws commented on June 17, 2024

找到原因了,启动rerank模型失败的机器,cuda版本12.2;启动rerank模型成功的机器cuda版本12.1

from inference.

qinxuye avatar qinxuye commented on June 17, 2024

我们镜像应该是基于12.1 的。

from inference.

qinxuye avatar qinxuye commented on June 17, 2024

先关闭,碰到问题可以再开。

from inference.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.