Comments (6)
To resolve the "model 'llama2' not found" error, follow these steps:
- Confirm Ollama is installed on your system. If not, install it following the official documentation.
- Execute
ollama run llama2
in your terminal to ensure Ollama is running with the Llama2 model. - In the Supabase dashboard (
http://localhost:54323
), navigate to themodels
table and add a new row for the Llama2 model with the necessary details. - Update the
user_settings
table to include"ollama/llama2"
in themodels
field for your account, ensuring the Llama2 model is selectable and integrated into Quivr.
These steps are based on the latest Quivr documentation, ensuring the Llama2 model is correctly recognized by the system.
Details
Sources
About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
To continue the conversation, mention @dosu.
from quivr.
It seems like the "model 'llama2' not found" error persists despite following the initial troubleshooting steps. This issue typically indicates that the inference API cannot locate the 'llama2' model, which could be due to several reasons. Here's a more focused approach to diagnose and resolve this:
-
Verify Model Name: Ensure the model name "ollama/llama2" is correctly specified in all configurations, including the Supabase dashboard where you manage the
models
anduser_settings
tables. -
Check Ollama Service Logs: Look into the Ollama service logs to confirm that the 'llama2' model is indeed loaded. If not, consider restarting the Ollama service.
-
Confirm Endpoint URL: Double-check the endpoint URL used by the inference API to ensure it correctly points to the 'llama2' model's location.
-
Review Model Compatibility: Make sure the 'llama2' model is compatible with your current version of Quivr by checking the model compatibility in the Quivr codebase.
If after these steps the issue remains, please share more detailed information about the steps you're taking when encountering this error, including any relevant code snippets or additional log outputs. This will help in pinpointing the exact cause of the problem.
Details
Sources
- docs/developers/contribution/llm/ollama.mdx
- docs/configuring/new-model.mdx
- backend/modules/brain/service/utils/init.py
- backend/modules/brain/rags/quivr_rag.py
About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
To continue the conversation, mention @dosu.
from quivr.
To integrate your custom model within Quivr and avoid the 'llama2' model not found error, especially since you're not intending to use 'llama2', ensure you've correctly added your custom model to the Supabase models
table and updated the user_settings
table accordingly. Here's a concise guide:
- Supabase Dashboard: Access your dashboard, navigate to the
models
table, and add a new row for your custom model with all necessary details. - Update
user_settings
: In theuser_settings
table, add your custom model to themodels
field. Ensure the model's name is correctly entered, matching exactly what Ollama expects, including case sensitivity. - Correct Model Identifier: Double-check the model identifier in all configurations to ensure it matches the expected format and spelling.
If you've done all the above and still face issues, it might be due to an invalid Brain ID, model compatibility, or configuration problems. Consulting the Quivr Discord community or Ollama's support resources could provide further assistance.
This approach focuses on ensuring your custom model is correctly recognized and integrated, addressing the specific error you're encountering.
Details
Sources
- docs/developers/contribution/llm/ollama.mdx
- docs/configuring/new-model.mdx
- backend/modules/brain/rags/quivr_rag.py
About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
To continue the conversation, mention @dosu.
from quivr.
All the steps you mentioned, I have completed, but it still prompts an error.
from quivr.
I don't want to use llama2, I want to use a custom model.
from quivr.
I am certain that I have filled in correctly.
from quivr.
Related Issues (20)
- [Bug]: Website HOT 2
- [Bug]: login button is not working cause of javascript HOT 4
- [Bug]: Knowledge articles are not being used HOT 5
- [Bug]: Cannot connect to localhost. Error: EACCES: permission denied, scandir '/app/public/.well-known'] HOT 10
- [Feature]: demo issue typo
- [Bug]: Api Not authenticated HOT 2
- [Bug]: Setting up locally shows screen "Talk to Quivr Unpaid users have access to a free and limited demo of Quivr" HOT 16
- [Bug]: Unable to Access Login Page and Enter Credentials HOT 6
- [Bug]: While creating a new brain in localhost instance of Quivr, I am getting error HOT 16
- [Bug]: HOT 5
- [Bug]:
- [Bug]: error /app/node_modules/sharp: Command failed. HOT 2
- LocalAI support HOT 3
- [Bug]: GPT4 Brain code is not clean
- [Bug]: Unable to start backend-core HOT 8
- [Bug]: How to use the embedding model of ollama HOT 2
- [Bug]: runtime error: slice bounds out of range [1:0] HOT 1
- [Bug]: No model on ollama was used to answer HOT 18
- [Bug]: Not able to create brain on AWS Linux HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from quivr.