Comments (6)
GanymedeNil
commented on August 29, 2024
embedding模型一般都是需要在特定的领域知识做相关微调，如果是拿bert做embedding，可以具体看bert的微调。
from document.ai.
yungangwu
commented on August 29, 2024
我现在已经有相关的领域知识了，我想基于你已经训练出来的text2vec-large来做微调，这个可行吗？有相关的方法可以做吗
from document.ai.
GanymedeNil
commented on August 29, 2024
我现在已经有相关的领域知识了，我想基于你已经训练出来的text2vec-large来做微调，这个可行吗？有相关的方法可以做吗
参考https://github.com/shibing624/text2vec 进行数据准备和训练。预训练模型可以和我一样使用https://github.com/ymcui/LERT （最终的文本匹配任务的准确度主要还是依赖预训练模型）。
from document.ai.
yungangwu
commented on August 29, 2024
感谢，这里的预训练模型是指我们使用的LLM是吧？看样子还是对LLM，针对特定领域知识做lora来的好一些啊
from document.ai.
GanymedeNil
commented on August 29, 2024
感谢，这里的预训练模型是指我们使用的LLM是吧？看样子还是对LLM，针对特定领域知识做lora来的好一些啊
推荐你详细了解一下NLP整个技术路线。你这句话里面有好几处相互矛盾的技术点。如果还有其他与本仓库相关技术问题，可以后续继续提问。
from document.ai.
Mike4Ellis
commented on August 29, 2024
请问可以用无监督领域文本直接在GanymedeNil/text2vec-large-chinese模型上做微调吗？
from document.ai.
Related Issues (20)
- 关于qdrant库上传点的时候title选择的问题 HOT 2
- 关于自训练的Embedding模型的问题
- 关于自训练 Embeddings 问题 HOT 7
- 提示我被限额了，我明明刚充值的钱
- 关于GPT fine-tune HOT 5
- 数据集爬虫咨询 HOT 1
- 想咨询您具体的问题，方便私下联系么？付费咨询
- 请教vectors_config=VectorParams(size=1536, distance=Distance.COSINE)参数问题 HOT 3
- text2vec模型效果怎么样 HOT 6
- 这个想法真的很不错
- 如何增加本地知识库呢 HOT 1
- SentenceTransformer 调用的问题 HOT 2
- 如果解决调用调用慢的问题
- 如何支持流式输出 HOT 1
- 向量数据库查询到的应该是和问题相似的内容吧 HOT 3
- 如何在现有Embedding模型基础上使用无监督数据微调？ HOT 3
- 如何在现有Embedding模型基础上使用无监督数据微调？
- 您好，请问方便分享text2vec-large/base-chinese的数据集吗 HOT 1
- 二次预训练中的一些小问题
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from document.ai.