Not showing all model after update to latest version

[askareija]

Not showing all model after update to latest version

[rjmacarthy]

Hello, please make sure that your Ollama settings in the extension settings are correct i.e hostname and port.

In the provider config the model dropdown is populated based on api/tags from Ollama api. For other providers I am lazy and just put a text box there.

I will make it more clear for future release. The endpoint for Ollama should be /v1/chat/completions.

Hope it helps,

[askareija]

okay it's working thanks. But if i'm using dev container, i have to change this host to host.docker.internal, and if i'm using local host is localhost. a little bit complicated. looks like my workaround was create 2 providers with the same model name, but only hostname is different.

[rjmacarthy]

Everyone has different setup, I just made it so it can be flexible for everyone, some more complicated than others.

Many thanks!

[askareija]

thank you, last question, i'm using stable-code for FIM, but it's always return 400, is there anything wrong?

nevermind, looks like the API path for FIM is /api/generate

[orkutmuratyilmaz]

Same here, with Manjaro Linux.

[rjmacarthy]

Hello, the model select and provider manager was updated in this release.

https://github.com/rjmacarthy/twinny/releases/tag/v3.11.0

Different providers/models can now be set here without opening the settings menu everytime.

Hope that helps.

[askareija]

i'm using ollama and only ollama that doesn't have model name field.

ollama:

llamacpp/other provider:

also i don't know the API path for ollama, i've tried /api/chat, using llamacpp but it return 400 and twinny become endless loading.

now i'm using latest version 3.11.19

[askareija]

thank you, last question, i'm using stable-code for FIM, but it's always return 400, is there anything wrong?