Using Ollama insted of ChatGPT

[Billy-Mitchell]

Using Ollama insted of ChatGPT

[dustinwloring1988]

with the code base now it would not be as easy as changing a few line of code. Unless we wait for ollama to implement function calling as i do not believe they have yet. We could always try though prompt engineering but it would not be as robust.

[dustinwloring1988]

Here is how your curl command would have to look that you send:

curl http://localhost:11434/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama3",
		"stream": false,
		"format": "json",
		
        "messages": [
            {
                "role": "system",
                "content": "You are a helpful assistant."
            },
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'

[Billy-Mitchell]

Hi and thank you for your response.

I am quite new to the AI/LLM world and there is a lot to learn, so I didn't fully realize that function calling was something primarily available in OpenAI and other paid services.

I see that it is something planned in LangChain, but as you say, it would probably involve more than just changing a few lines of code.

Thanks again for your response :-)