Can't get the FIM to work with LM Studio

[Wyzix33]

Can't get the FIM to work with LM Studio

[rjmacarthy]

Hello, it seems you are using WizardCoder for FIM but with codellama template. I don't know which fim template WizardCoder supports or if it supports FIM. You should try a different model. Either deepseek base or codellama-code.

https://github.com/rjmacarthy/twinny/blob/main/docs/providers.md#fim-auto-complete-2

I see here: https://huggingface.co/epinnock/wizardcoder-1b-merged#fill-in-the-middle that WizardCoder uses the same FIM template as Starcoder, please try that as the FIM template, or use custom and edit your own.

See docs for recommended settings.

[Wyzix33]

thanks for the answer, I've made progress but still not good enough, at least now i can get the FIM to work, here is what i get, I will try other LLM maybe the ones i got are not good...

Sequence.01_1.mp4

[rjmacarthy]

Hey, starcoder2 has an issue with completions, I have not been successful with it either. Please try codellama or deepseek-coder. Many thanks.