[Advanced Paste > Paste with AI] Custom Model / Endpoint Selection

[nathancartlidge]

[Advanced Paste > Paste with AI] Custom Model / Endpoint Selection

[minzdrav]

It would be nice to have local models too.
For example: https://ollama.com/
It supports Llama 3, Phi3, and a lot of other models: https://ollama.com/library
C# client: https://github.com/awaescher/OllamaSharp

[nathancartlidge]

@minzdrav This would be enabled by my proposed change - Ollama provides partial support for the OpenAI API schema, so you'd be able to point the plugin at your local model

[wcwong]

In particular, supporting an Azure OpenAI endpoint would be great first implementation. It would be even better if the Azure implementation supported Managed Identities so we don't end up with the unmanageable mess of API key distribution and rotation.