Comments (2)
fredi-python
commented on June 6, 2024
No, you don't need to have the llama weights for this install.
This guide uses the full vicuna weights, instead of only the deltas.
Normally you need to merge the vicuna deltas with the llama weights, but thanks to a user on HF(HuggingFace) who has already merged it, we can use the full vicuna weights.
from vicuna-installation-guide.
Proper231
commented on June 6, 2024
ahhh ok, thank you for the clarification
from vicuna-installation-guide.
Related Issues (16)
- Doesnt open after pressing any key
- gpu inference HOT 1
- make -j error HOT 3
- run issue HOT 2
- Unable to load model error still occurring HOT 9
- how to generate a llama.cpp server with fastchat api HOT 1
- Example of using embedding
- unable to load model HOT 1
- Installation failure: make -j gives error HOT 2
- Hugging face wget command fails with Username/Password Authentication Failed. HOT 4
- Error loading model: is this really a GGML file? HOT 9
- Run it on GPU HOT 1
- why github.com/fredi-python/llama.cpp HOT 1
- Different and sometimes wrong answers with ggml-vic13b-q5_1.bin + ggml-vic13b-uncensored-q5_1.bin HOT 2
- A little confused. HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vicuna-installation-guide.