Giter Site home page Giter Site logo

VL模型效果非常差 about belle HOT 10 CLOSED

lucasjinreal avatar lucasjinreal commented on June 13, 2024
VL模型效果非常差

from belle.

Comments (10)

wen2cheng avatar wen2cheng commented on June 13, 2024

目前数据里面以开源数据为主,包含中文ocr的很少,所以表现会差一些,另外想强化对话能力,基于少量纯文本指令再微调一下就可以

from belle.

lucasjinreal avatar lucasjinreal commented on June 13, 2024

很难说是差一些,感觉完全不可用。

为什么chat能力变这么多?

from belle.

wen2cheng avatar wen2cheng commented on June 13, 2024

目前在指令微调阶段还没混合纯文本指令数据进去,另外微调阶段的中文多模态指令数据相比占比还是少一些,可能会影响在中文对话能力上的表现,
不过我们在混合多模态指令数据和中文的纯文本指令数据继续微调之后就会正常很多

from belle.

wen2cheng avatar wen2cheng commented on June 13, 2024

我这边试了一下,在中文对话场景下对话能力确实下降厉害,英文的好一些,主要原因应该还是中英数据占比问题,后续会再优化一下模型

from belle.

lucasjinreal avatar lucasjinreal commented on June 13, 2024

是从qwen的chat模型训练的,还是base模型?

from belle.

wen2cheng avatar wen2cheng commented on June 13, 2024

chat模型

from belle.

wen2cheng avatar wen2cheng commented on June 13, 2024

模型更新了一版

from belle.

lucasjinreal avatar lucasjinreal commented on June 13, 2024

有评测过吗

from belle.

wen2cheng avatar wen2cheng commented on June 13, 2024

目前在mme上评测的感知能力可以到1620分,不过还是以具体体验为准

from belle.

lucasjinreal avatar lucasjinreal commented on June 13, 2024

指的是,对话能力是否能保持,非图片

from belle.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.